00010000:00010000:3.0F:1788684417.790402:0:17160:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0F:1788684418.813472:0:17159:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1788684419.215721:0:17151:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934622 is committed 00000020:00080000:3.0:1788684419.215750:0:17151:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff8d664867ee40 refcount 2 committed 0 result 0 batchid 4294967530 00000020:00080000:3.0:1788684419.215756:0:17151:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8d677706ae00 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff8d664867e780 00000020:00080000:3.0:1788684419.215760:0:17151:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff8d677706ab00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff8d6645b7aa00 00000020:00080000:2.0F:1788684419.217213:0:17210:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 4294967530 committed batchid 8 00000020:00080000:2.0:1788684419.217335:0:17210:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00010000:00010000:1.0:1788684419.218931:0:3609:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8d6746cb3200/0x44bac02bd54adc20 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 18403 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684419.218947:0:3609:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d6746cb3200/0x44bac02bd54adc20 lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 18403 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684419.218956:0:3609:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d6746cb3200/0x44bac02bd54adc20 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 18403 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684419.218963:0:3609:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d6746cb3200 already unused, calling callback (ffffffffc18a84f0) 00010000:00010000:1.0:1788684419.218969:0:3609:0:(ldlm_request.c:377:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d6746cb3200/0x44bac02bd54adc20 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 18403 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684419.218977:0:3609:0:(ldlm_request.c:1415:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d6746cb3200/0x44bac02bd54adc20 lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 18403 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684419.219002:0:3609:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8d6641869500) 00010000:00010000:1.0:1788684419.219005:0:3609:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788684419.219011:0:3609:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d6746cb3200/0x44bac02bd54adc20 lrc: 2/0,0 mode: --/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 18403 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684419.219017:0:3609:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d6746cb3200/0x44bac02bd54adc20 lrc: 0/0,0 mode: --/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 18403 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788684419.711613:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d67450b0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3623:1875571085882368:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788684419.711716:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788684419.711785:0:17176:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085882368 00000100:00100000:1.0:1788684419.711795:0:17176:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085882368 00000100:00100000:1.0:1788684419.711851:0:17176:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1788684419.711861:0:17176:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67450b3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3623:x1875571085882368:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1788684419.711909:0:17176:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446293504 avail 1300054016 00000100:00100000:1.0:1788684419.711981:0:17176:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67450b3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3623:x1875571085882368:12345-0@lo:41:osp-pre-0-1.0 Request processed in 121us (264us total) trans 0 rc 0/0 00000100:00100000:1.0:1788684419.711989:0:17176:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1788684419.712045:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d67450b0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3623:1875571085882368:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788684419.714317:0:3624:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d67450b0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3624:1875571085882496:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788684419.714450:0:3624:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788684419.714525:0:17177:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085882496 00000100:00100000:1.0:1788684419.714533:0:17177:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085882496 00000100:00100000:1.0:1788684419.714584:0:17177:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1788684419.714593:0:17177:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67450b3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3624:x1875571085882496:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1788684419.714634:0:17177:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:1.0:1788684419.714693:0:17177:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67450b3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3624:x1875571085882496:12345-0@lo:41:osp-pre-1-0.0 Request processed in 100us (243us total) trans 0 rc 0/0 00000100:00100000:1.0:1788684419.714701:0:17177:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1788684419.714758:0:3624:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d67450b0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3624:1875571085882496:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788684419.721040:0:3625:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6646d31c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3625:1875571085882624:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788684419.721196:0:3625:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788684419.721261:0:18681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085882624 00000100:00100000:2.0:1788684419.721270:0:18681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085882624 00000100:00100000:2.0:1788684419.721356:0:18681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1788684419.721408:0:18681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6646d31500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3625:x1875571085882624:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1788684419.721443:0:18681:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:2.0:1788684419.721487:0:18681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6646d31500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3625:x1875571085882624:12345-0@lo:13:osp-pre-0-1.0 Request processed in 122us (291us total) trans 0 rc 0/0 00000100:00100000:2.0:1788684419.721495:0:18681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1788684419.721555:0:3625:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6646d31c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3625:1875571085882624:0@lo:13:osp-pre-0-1.0 00000100:00080000:1.0:1788684419.721645:0:17166:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1788684419.840797:0:17160:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1788684420.606061:0:17922:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1788684420.866756:0:17159:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788684420.926170:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:3.0:1788684420.928994:0:17173:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073230592 00000100:00100000:3.0:1788684420.929015:0:17173:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073230592 00000100:00100000:3.0:1788684420.929100:0:17173:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 65 00000100:00100000:3.0:1788684420.929115:0:17173:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6647a62680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c4cf9959-ce83-48ba-884e-11c1ebaf899c+13:15575:x1875571073230592:12345-192.168.206.44@tcp:60:lhsmtool_posix.0 00000100:00100000:3.0:1788684420.935507:0:17173:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6647a62680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c4cf9959-ce83-48ba-884e-11c1ebaf899c+13:15575:x1875571073230592:12345-192.168.206.44@tcp:60:lhsmtool_posix.0 Request processed in 6378us (9334us total) trans 0 rc 0/0 00000100:00100000:3.0:1788684420.935582:0:17173:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 65 00000100:00100000:3.0:1788684420.943166:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:3.0:1788684420.943210:0:18403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073230720 00000100:00100000:3.0:1788684420.943223:0:18403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073230720 00000100:00100000:3.0:1788684420.943292:0:18403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 66 00000100:00100000:3.0:1788684420.943305:0:18403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d677fbc1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c4cf9959-ce83-48ba-884e-11c1ebaf899c+5:15575:x1875571073230720:12345-192.168.206.44@tcp:60:lhsmtool_posix.0 00000100:00100000:3.0:1788684420.943449:0:18403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d677fbc1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c4cf9959-ce83-48ba-884e-11c1ebaf899c+5:15575:x1875571073230720:12345-192.168.206.44@tcp:60:lhsmtool_posix.0 Request processed in 147us (296us total) trans 0 rc 0/0 00000100:00100000:3.0:1788684420.943457:0:18403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 66 00000100:00080000:3.0:1788684420.946827:0:17166:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1788684420.946840:0:17166:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788684420.955250:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:3.0:1788684420.955294:0:17175:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073230976 00000100:00100000:3.0:1788684420.955312:0:17175:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073230976 00000100:00100000:3.0:1788684420.955389:0:17175:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 12 00000100:00100000:3.0:1788684420.955401:0:17175:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d677fbc3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c4cf9959-ce83-48ba-884e-11c1ebaf899c+13:15575:x1875571073230976:12345-192.168.206.44@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1788684420.957032:0:17175:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d677fbc3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:c4cf9959-ce83-48ba-884e-11c1ebaf899c+14:15575:x1875571073230976:12345-192.168.206.44@tcp:35:lhsmtool_posix.0 Request processed in 1621us (1779us total) trans 8589934623 rc 0/0 00000100:00100000:3.0:1788684420.957046:0:17175:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 12 00000100:00100000:2.0:1788684421.758031:0:3625:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788684421.758060:0:3625:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6646d31c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3625:1875571085882752:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788684421.758164:0:3625:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788684421.758245:0:3625:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6648e83100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3625:1875571085883136:0@lo:400:kworker.0 00000100:00100000:2.0:1788684421.758274:0:3625:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788684421.758299:0:3625:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d677fa83100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3625:1875571085883648:0@lo:400:kworker.0 00000100:00100000:0.0F:1788684421.758310:0:17912:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085883136 00000100:00100000:2.0:1788684421.758320:0:3625:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788684421.758326:0:17912:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085883136 00000100:00100000:2.0:1788684421.758338:0:3625:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d677fb47800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3625:1875571085884160:0@lo:400:kworker.0 00000100:00100000:2.0:1788684421.758363:0:3625:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788684421.758391:0:17912:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085883648 00000100:00100000:0.0:1788684421.758395:0:17912:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085883648 00000100:00100000:2.0:1788684421.758396:0:3625:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:2.0:1788684421.758402:0:3625:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6648e83800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3625:1875571085883264:0@lo:400:kworker.0 00000100:00100000:0.0:1788684421.758413:0:17912:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1788684421.758422:0:17912:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6646d31180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3625:x1875571085883136:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788684421.758426:0:3625:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788684421.758441:0:3625:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d677fa81180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3625:1875571085883776:0@lo:400:kworker.0 00000100:00100000:2.0:1788684421.758472:0:3625:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788684421.758492:0:3625:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d677fb46300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3625:1875571085884288:0@lo:400:kworker.0 00000100:00100000:0.0:1788684421.758492:0:17912:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6646d31180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3625:x1875571085883136:12345-0@lo:400:kworker.0 Request processed in 71us (217us total) trans 0 rc 0/0 00000100:00100000:2.0:1788684421.758511:0:3625:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788684421.758512:0:17912:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1788684421.758530:0:17912:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1788684421.758536:0:17912:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6648667b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3625:x1875571085883648:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788684421.758545:0:3625:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6648e83100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3625:1875571085883136:0@lo:400:kworker.0 00000100:00100000:1.0:1788684421.758630:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6648e82680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3623:1875571085882880:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788684421.758857:0:3625:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d677fa83100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3625:1875571085883648:0@lo:400:kworker.0 00000100:00100000:2.0:1788684421.758919:0:18682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085882752 00000100:00100000:2.0:1788684421.758923:0:18682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085882752 00000100:00100000:2.0:1788684421.758964:0:18682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1788684421.758972:0:18682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6646d33800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3625:x1875571085882752:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1788684421.758997:0:18682:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 4218880 granted 26324672 pending 0 free 3915849728 avail 3684327424 00000100:00100000:2.0:1788684421.759041:0:18682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6646d33800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3625:x1875571085882752:12345-0@lo:13:osp-pre-1-1.0 Request processed in 70us (878us total) trans 0 rc 0/0 00000100:00100000:2.0:1788684421.759048:0:18682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1788684421.759069:0:3624:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6648e80e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c986901f-6089-4802-a23d-1179db951431:3624:1875571085883008:0@lo:400:kworker.0 00000100:00100000:2.0:1788684421.759104:0:3624:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788684421.759130:0:3624:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6648e81500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3624:1875571085883520:0@lo:400:kworker.0 00000100:00100000:2.0:1788684421.759166:0:3624:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788684421.759185:0:3624:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d677fb47100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3624:1875571085884032:0@lo:400:kworker.0 00000100:00100000:2.0:1788684421.759208:0:3624:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788684421.759242:0:17163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085883008 00000100:00100000:2.0:1788684421.759247:0:17163:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085883008 00000100:00100000:2.0:1788684421.759272:0:17163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 170 00000100:00100000:2.0:1788684421.759280:0:17163:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d664108f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c986901f-6089-4802-a23d-1179db951431+24:3624:x1875571085883008:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788684421.759317:0:17163:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d664108f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c986901f-6089-4802-a23d-1179db951431+24:3624:x1875571085883008:12345-0@lo:400:kworker.0 Request processed in 38us (212us total) trans 0 rc 0/0 00000100:00100000:2.0:1788684421.759333:0:17163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 170 00000100:00100000:2.0:1788684421.759402:0:3624:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6648e80e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c986901f-6089-4802-a23d-1179db951431:3624:1875571085883008:0@lo:400:kworker.0 00000100:00100000:2.0:1788684421.759439:0:3625:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6646d31c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3625:1875571085882752:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788684421.759474:0:18680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085883264 00000100:00100000:2.0:1788684421.759478:0:18680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085883264 00000100:00100000:2.0:1788684421.759507:0:18680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085883776 00000100:00100000:2.0:1788684421.759510:0:18680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085883776 00000100:00100000:2.0:1788684421.759531:0:18680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1788684421.759537:0:18680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6648599f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3625:x1875571085883264:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788684421.760908:0:17173:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085884160 00000100:00100000:3.0:1788684421.760918:0:17173:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085884160 00000100:00100000:3.0:1788684421.760966:0:17173:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085884288 00000100:00100000:3.0:1788684421.760969:0:17173:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085884288 00000100:00100000:3.0:1788684421.760983:0:17173:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085883520 00000100:00100000:3.0:1788684421.760986:0:17173:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085883520 00000100:00100000:3.0:1788684421.761002:0:17173:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085884032 00000100:00100000:3.0:1788684421.761005:0:17173:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085884032 00000100:00100000:3.0:1788684421.761022:0:17173:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1788684421.761031:0:17173:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6648600a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3625:x1875571085884160:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788684421.761110:0:17173:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6648600a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3625:x1875571085884160:12345-0@lo:400:kworker.0 Request processed in 80us (2746us total) trans 0 rc 0/0 00000100:00100000:3.0:1788684421.761118:0:17173:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1788684421.761134:0:17173:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1788684421.761277:0:17173:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d664856ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3625:x1875571085884288:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788684421.761314:0:17173:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d664856ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3625:x1875571085884288:12345-0@lo:400:kworker.0 Request processed in 41us (2801us total) trans 0 rc 0/0 00000100:00100000:3.0:1788684421.761320:0:17173:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1788684421.761333:0:17173:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1788684421.761340:0:17173:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d664856ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3624:x1875571085883520:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788684421.761414:0:17173:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d664856ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3624:x1875571085883520:12345-0@lo:400:kworker.0 Request processed in 75us (2247us total) trans 0 rc 0/0 00000100:00100000:3.0:1788684421.761437:0:17173:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1788684421.761451:0:17173:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1788684421.761457:0:17173:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d664856f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3624:x1875571085884032:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788684421.761489:0:17173:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d664856f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3624:x1875571085884032:12345-0@lo:400:kworker.0 Request processed in 33us (2280us total) trans 0 rc 0/0 00000100:00100000:3.0:1788684421.761495:0:17173:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1788684421.761523:0:19567:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1788684421.761532:0:19567:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d664856df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3625:x1875571085883776:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788684421.761567:0:19567:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d664856df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3625:x1875571085883776:12345-0@lo:400:kworker.0 Request processed in 37us (3094us total) trans 0 rc 0/0 00000100:00100000:3.0:1788684421.761573:0:19567:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00080000:3.0:1788684421.762950:0:17166:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788684421.762960:0:17166:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1788684421.762963:0:17166:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788684421.762967:0:17166:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788684421.763012:0:3624:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d677fbc0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3624:1875571085884544:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788684421.763093:0:3624:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788684421.763238:0:18680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6648599f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3625:x1875571085883264:12345-0@lo:400:kworker.0 Request processed in 39us (1149us total) trans 0 rc 0/0 00000100:00100000:2.0:1788684421.763252:0:18680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1788684421.763284:0:20360:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085884544 00000100:00100000:2.0:1788684421.763292:0:20360:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085884544 00000100:00100000:2.0:1788684421.763333:0:20360:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1788684421.763342:0:20360:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d677fbc0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3624:x1875571085884544:12345-0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788684421.763631:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788684421.763678:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6648e82300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3623:1875571085883392:0@lo:400:kworker.0 00000100:00100000:1.0:1788684421.763704:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788684421.763724:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d677fb44e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3623:1875571085883904:0@lo:400:kworker.0 00000100:00100000:1.0:1788684421.763748:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788684421.763765:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d677fb45500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3623:1875571085884416:0@lo:400:kworker.0 00000100:00100000:1.0:1788684421.763797:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788684421.763866:0:18681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085882880 00000100:00100000:1.0:1788684421.763870:0:18681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085882880 00000100:00100000:1.0:1788684421.763903:0:18681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1788684421.763910:0:18681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67450b0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3623:x1875571085882880:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788684421.763929:0:18681:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 4218880 granted 26324672 pending 0 free 3915849728 avail 3684327424 00000100:00100000:1.0:1788684421.763981:0:18681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67450b0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3623:x1875571085882880:12345-0@lo:13:osp-pre-1-0.0 Request processed in 72us (351us total) trans 0 rc 0/0 00000100:00100000:1.0:1788684421.763987:0:18681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1788684421.764008:0:17172:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085883904 00000100:00100000:1.0:1788684421.764011:0:17172:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085883904 00000100:00100000:1.0:1788684421.764039:0:17172:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085884416 00000100:00100000:1.0:1788684421.764041:0:17172:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085884416 00000100:00100000:1.0:1788684421.764060:0:17172:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1788684421.764065:0:17172:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67450b1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3623:x1875571085883904:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788684421.764095:0:17172:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67450b1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3623:x1875571085883904:12345-0@lo:400:kworker.0 Request processed in 30us (346us total) trans 0 rc 0/0 00000100:00100000:1.0:1788684421.764101:0:17172:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1788684421.764110:0:17172:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1788684421.764115:0:17172:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67450b3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3623:x1875571085884416:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788684421.764135:0:17172:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67450b3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3623:x1875571085884416:12345-0@lo:400:kworker.0 Request processed in 20us (338us total) trans 0 rc 0/0 00000100:00100000:1.0:1788684421.764140:0:17172:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00080000:1.0:1788684421.764176:0:17166:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1788684421.764181:0:17166:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788684421.764222:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6648e82680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3623:1875571085882880:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788684421.764234:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d677fb44e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3623:1875571085883904:0@lo:400:kworker.0 00010000:00080000:1.0:1788684421.764246:0:3623:0:(ldlm_request.c:1670:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d677fb45500 x1875571085884416/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788684437 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788684421.764264:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d677fb45500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3623:1875571085884416:0@lo:400:kworker.0 00000100:00100000:1.0:1788684421.764319:0:18677:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085883392 00000100:00100000:1.0:1788684421.764323:0:18677:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085883392 00000100:00100000:1.0:1788684421.764347:0:18677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1788684421.764353:0:18677:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67450b0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3623:x1875571085883392:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788684421.764414:0:18677:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67450b0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3623:x1875571085883392:12345-0@lo:400:kworker.0 Request processed in 61us (708us total) trans 0 rc 0/0 00000100:00100000:1.0:1788684421.764421:0:18677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1788684421.764537:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6648e82300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3623:1875571085883392:0@lo:400:kworker.0 00000100:00100000:1.0:1788684421.764597:0:3625:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6648e83800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3625:1875571085883264:0@lo:400:kworker.0 00000100:00100000:1.0:1788684421.764612:0:3625:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d677fa81180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3625:1875571085883776:0@lo:400:kworker.0 00000100:00100000:1.0:1788684421.764626:0:3625:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d677fb46300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3625:1875571085884288:0@lo:400:kworker.0 00010000:00080000:1.0:1788684421.764639:0:3625:0:(ldlm_request.c:1670:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d677fb47800 x1875571085884160/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788684437 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788684421.764659:0:3625:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d677fb47800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3625:1875571085884160:0@lo:400:kworker.0 00000100:00100000:0.0:1788684421.767327:0:17912:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6648667b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3625:x1875571085883648:12345-0@lo:400:kworker.0 Request processed in 8777us (8990us total) trans 0 rc 0/0 00000100:00100000:0.0:1788684421.767347:0:17912:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00002000:00000024:2.0:1788684421.767459:0:20360:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:2.0:1788684421.767561:0:20360:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d677fbc0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3624:x1875571085884544:12345-0@lo:13:osp-pre-0-0.0 Request processed in 4218us (4466us total) trans 0 rc 0/0 00000100:00100000:2.0:1788684421.767572:0:20360:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1788684421.768950:0:3624:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d677fbc0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3624:1875571085884544:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788684421.768977:0:3624:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6648e81500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3624:1875571085883520:0@lo:400:kworker.0 00000100:00100000:3.0:1788684421.768991:0:3624:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d677fb47100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3624:1875571085884032:0@lo:400:kworker.0 00000100:00100000:3.0:1788684421.830919:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:3.0:1788684421.830976:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:3.0:1788684421.831010:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:3.0:1788684421.831051:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:3.0:1788684421.831097:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:3.0:1788684421.831123:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:3.0:1788684421.831143:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:3.0:1788684421.831161:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:3.0:1788684421.831184:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:3.0:1788684421.831228:0:18403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073231360 00000100:00100000:3.0:1788684421.831241:0:18403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073231360 00000100:00100000:2.0:1788684421.831287:0:17165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073231104 00000100:00100000:2.0:1788684421.831294:0:17165:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073231104 00000100:00100000:3.0:1788684421.831299:0:18403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073231232 00000100:00100000:3.0:1788684421.831304:0:18403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073231232 00000100:00100000:3.0:1788684421.831323:0:18403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073231872 00000100:00100000:3.0:1788684421.831326:0:18403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073231872 00000100:00100000:2.0:1788684421.831340:0:17165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 171 00000100:00100000:2.0:1788684421.831351:0:17165:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d664108d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:558e5e46-625a-47f1-bf34-9eb61f632413+13:2393:x1875571073231104:12345-192.168.206.44@tcp:400:kworker.0 00000100:00100000:3.0:1788684421.831359:0:18403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073231744 00000100:00100000:3.0:1788684421.831363:0:18403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073231744 00000100:00100000:3.0:1788684421.831421:0:18403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 76 00000100:00100000:3.0:1788684421.831429:0:18403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d677fbc0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c4cf9959-ce83-48ba-884e-11c1ebaf899c+5:2393:x1875571073231360:12345-192.168.206.44@tcp:400:kworker.0 00000100:00100000:2.0:1788684421.831498:0:17165:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d664108d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:558e5e46-625a-47f1-bf34-9eb61f632413+13:2393:x1875571073231104:12345-192.168.206.44@tcp:400:kworker.0 Request processed in 148us (593us total) trans 0 rc 0/0 00000100:00100000:2.0:1788684421.831515:0:17165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 171 00000100:00100000:0.0:1788684421.831535:0:17171:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 77 00000100:00100000:0.0:1788684421.831548:0:17171:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d677fbc0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c4cf9959-ce83-48ba-884e-11c1ebaf899c+14:2393:x1875571073231232:12345-192.168.206.44@tcp:400:kworker.0 00000100:00100000:1.0:1788684421.831634:0:19204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073231616 00000100:00100000:1.0:1788684421.831639:0:19204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073231616 00000100:00100000:3.0:1788684421.832351:0:18403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d677fbc0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c4cf9959-ce83-48ba-884e-11c1ebaf899c+5:2393:x1875571073231360:12345-192.168.206.44@tcp:400:kworker.0 Request processed in 916us (1368us total) trans 0 rc 0/0 00000100:00100000:3.0:1788684421.832361:0:18403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 76 00000100:00100000:3.0:1788684421.832419:0:18403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 78 00000100:00100000:3.0:1788684421.832430:0:18403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6747a6ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:55cddeac-d533-48cb-9ea5-95cbce9430eb+5:2392:x1875571073231872:12345-192.168.206.44@tcp:400:kworker.0 00000100:00100000:3.0:1788684421.832468:0:18403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6747a6ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:55cddeac-d533-48cb-9ea5-95cbce9430eb+5:2392:x1875571073231872:12345-192.168.206.44@tcp:400:kworker.0 Request processed in 42us (1371us total) trans 0 rc 0/0 00000100:00100000:3.0:1788684421.832475:0:18403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 78 00000100:00100000:3.0:1788684421.832488:0:18403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 79 00000100:00100000:3.0:1788684421.832495:0:18403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6747a6c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:55cddeac-d533-48cb-9ea5-95cbce9430eb+6:2392:x1875571073231744:12345-192.168.206.44@tcp:400:kworker.0 00000100:00100000:3.0:1788684421.832558:0:18403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6747a6c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:55cddeac-d533-48cb-9ea5-95cbce9430eb+6:2392:x1875571073231744:12345-192.168.206.44@tcp:400:kworker.0 Request processed in 63us (1434us total) trans 0 rc 0/0 00000100:00100000:3.0:1788684421.832575:0:18403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 79 00000100:00100000:3.0:1788684421.832600:0:18679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073231488 00000100:00100000:3.0:1788684421.832606:0:18679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073231488 00000100:00100000:0.0:1788684421.839010:0:17171:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d677fbc0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c4cf9959-ce83-48ba-884e-11c1ebaf899c+14:2393:x1875571073231232:12345-192.168.206.44@tcp:400:kworker.0 Request processed in 7446us (7979us total) trans 0 rc 0/0 00000100:00100000:0.0:1788684421.839030:0:17171:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 77 00000100:00100000:0.0:1788684421.839141:0:18677:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073232000 00000100:00100000:0.0:1788684421.839151:0:18677:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073232000 00000100:00100000:1.0:1788684421.839988:0:19204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073232128 00000100:00100000:1.0:1788684421.839998:0:19204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073232128 00000100:00100000:3.0:1788684421.847496:0:18679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 31 00000100:00100000:3.0:1788684421.847593:0:18679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d677fbc2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c4cf9959-ce83-48ba-884e-11c1ebaf899c+5:2392:x1875571073231616:12345-192.168.206.44@tcp:400:kworker.0 00000100:00100000:3.0:1788684421.847723:0:18679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d677fbc2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c4cf9959-ce83-48ba-884e-11c1ebaf899c+5:2392:x1875571073231616:12345-192.168.206.44@tcp:400:kworker.0 Request processed in 211us (16670us total) trans 0 rc 0/0 00000100:00100000:3.0:1788684421.847732:0:18679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 31 00000100:00100000:3.0:1788684421.847758:0:18679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 28 00000100:00100000:3.0:1788684421.847767:0:18679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6747a6dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c4cf9959-ce83-48ba-884e-11c1ebaf899c+5:2389:x1875571073231488:12345-192.168.206.44@tcp:9:kworker.0 00000020:00000080:3.0:1788684421.847794:0:18679:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x44bac02bd54ad956 00000100:00080000:3.0:1788684421.847824:0:18679:0:(import.c:65:import_set_state_nolock()) ffff8d66459a8000 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1788684421.847887:0:18679:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 8589934594 00000100:00100000:3.0:1788684421.848040:0:18679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6747a6dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c4cf9959-ce83-48ba-884e-11c1ebaf899c+2:2389:x1875571073231488:12345-192.168.206.44@tcp:9:kworker.0 Request processed in 274us (16895us total) trans 0 rc 0/0 00000100:00100000:3.0:1788684421.848049:0:18679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 28 00010000:00010000:3.0:1788684421.848081:0:17160:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1788684421.848123:0:17166:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788684421.848129:0:17166:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788684421.848133:0:17166:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788684421.848137:0:17166:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788684421.848662:0:18677:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 29 00000100:00100000:0.0:1788684421.848677:0:18677:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6747a6ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:55cddeac-d533-48cb-9ea5-95cbce9430eb+5:2389:x1875571073232000:12345-192.168.206.44@tcp:9:kworker.0 00000020:00000080:0.0:1788684421.848705:0:18677:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x44bac02bd54ad98e 00000100:00080000:0.0:1788684421.848713:0:18677:0:(import.c:65:import_set_state_nolock()) ffff8d664658e000 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1788684421.848782:0:18677:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 8589934594 00000100:00100000:0.0:1788684421.848862:0:18677:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6747a6ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:55cddeac-d533-48cb-9ea5-95cbce9430eb+2:2389:x1875571073232000:12345-192.168.206.44@tcp:9:kworker.0 Request processed in 191us (17700us total) trans 0 rc 0/0 00000100:00100000:0.0:1788684421.848877:0:18677:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 29 00010000:00010000:0.0:1788684421.848932:0:17159:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788684421.849690:0:19204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 30 00000100:00100000:1.0:1788684421.849707:0:19204:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6747a6d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:55cddeac-d533-48cb-9ea5-95cbce9430eb+5:2389:x1875571073232128:12345-192.168.206.44@tcp:9:kworker.0 00000020:00000080:1.0:1788684421.849734:0:19204:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x44bac02bd54ad995 00000100:00080000:1.0:1788684421.849751:0:19204:0:(import.c:65:import_set_state_nolock()) ffff8d664658d800 : changing import state from FULL to CLOSED 00010000:00010000:1.0:1788684421.849805:0:17160:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00000004:1.0:1788684421.849844:0:19204:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 8589934600 00000100:00100000:1.0:1788684421.849974:0:19204:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6747a6d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:55cddeac-d533-48cb-9ea5-95cbce9430eb+2:2389:x1875571073232128:12345-192.168.206.44@tcp:9:kworker.0 Request processed in 274us (18788us total) trans 0 rc 0/0 00000100:00100000:1.0:1788684421.849982:0:19204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 30 00010000:00010000:0.0:1788684421.885976:0:17159:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788684422.909774:0:17160:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788684423.936116:0:17159:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788684424.829676:0:3626:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788684424.829705:0:3626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d67450b2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3626:1875571085884672:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788684424.829801:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788684424.830133:0:17177:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085884672 00000100:00100000:2.0:1788684424.830145:0:17177:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085884672 00000100:00100000:2.0:1788684424.830568:0:17177:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1788684424.830580:0:17177:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67450b1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3626:x1875571085884672:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1788684424.830626:0:17177:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:2.0:1788684424.830710:0:17177:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67450b1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3626:x1875571085884672:12345-0@lo:41:osp-pre-1-0.0 Request processed in 132us (909us total) trans 0 rc 0/0 00000100:00100000:2.0:1788684424.830718:0:17177:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1788684424.832994:0:3626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d677fb45f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3626:1875571085884800:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788684424.833100:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788684424.833209:0:3626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d67450b2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3626:1875571085884672:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788684424.835519:0:17176:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085884800 00000100:00100000:3.0:1788684424.835534:0:17176:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085884800 00000100:00100000:3.0:1788684424.835598:0:17176:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1788684424.835614:0:17176:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67450b1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3626:x1875571085884800:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1788684424.835669:0:17176:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446293504 avail 1300054016 00000100:00100000:3.0:1788684424.835783:0:17176:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67450b1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3626:x1875571085884800:12345-0@lo:41:osp-pre-0-1.0 Request processed in 170us (2683us total) trans 0 rc 0/0 00000100:00100000:3.0:1788684424.835790:0:17176:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1788684424.835949:0:3626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d677fb45f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3626:1875571085884800:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788684424.844798:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d67450b2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3623:1875571085884928:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788684424.844909:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788684424.844989:0:18681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085884928 00000100:00100000:2.0:1788684424.845000:0:18681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085884928 00000100:00100000:2.0:1788684424.845084:0:18681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1788684424.845097:0:18681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d664856d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3623:x1875571085884928:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1788684424.845150:0:18681:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923513344 avail 3691991040 00000100:00100000:2.0:1788684424.845215:0:18681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d664856d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3623:x1875571085884928:12345-0@lo:13:osp-pre-0-1.0 Request processed in 121us (306us total) trans 0 rc 0/0 00000100:00100000:2.0:1788684424.845224:0:18681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00080000:2.0:1788684424.845252:0:17166:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788684424.845299:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d67450b2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3623:1875571085884928:0@lo:13:osp-pre-0-1.0 00000001:00080000:1.0:1788684424.845454:0:17151:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934623 is committed 00000020:00080000:1.0:1788684424.845468:0:17151:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 4294967530 batchid updated 00000020:00080000:2.0:1788684424.846672:0:17210:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4294967530 00000020:00080000:2.0:1788684424.846697:0:17210:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4294967530 00010000:00010000:1.0:1788684424.968614:0:17160:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1788684425.311220:0:20547:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1d: Test Project ID with remote access ========================================================== 04:47:03 (1788684423) 00010000:00010000:3.0:1788684425.984357:0:17159:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1788684426.558566:0:17206:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:1.0:1788684426.558576:0:17206:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788684426.558598:0:17206:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:1.0:1788684426.558608:0:17206:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:0.0:1788684426.877706:0:3624:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d664856e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3624:1875571085885056:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788684426.877776:0:3624:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788684426.878004:0:20360:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085885056 00000100:00100000:2.0:1788684426.878019:0:20360:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085885056 00000100:00100000:2.0:1788684426.878071:0:20360:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1788684426.878080:0:20360:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d677fb47480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3624:x1875571085885056:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1788684426.878106:0:20360:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 4218880 granted 17886912 pending 0 free 3915849728 avail 3684327424 00000100:00100000:2.0:1788684426.878149:0:20360:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d677fb47480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3624:x1875571085885056:12345-0@lo:13:osp-pre-1-1.0 Request processed in 70us (372us total) trans 0 rc 0/0 00000100:00100000:2.0:1788684426.878156:0:20360:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1788684426.878183:0:3626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d664856fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3626:1875571085885312:0@lo:400:kworker.0 00000100:00100000:2.0:1788684426.878212:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788684426.878239:0:3626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d677fa81180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3626:1875571085885824:0@lo:400:kworker.0 00000100:00100000:2.0:1788684426.878261:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788684426.878279:0:3626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6648e82300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3626:1875571085886336:0@lo:400:kworker.0 00000100:00100000:2.0:1788684426.878302:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788684426.878322:0:3626:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:2.0:1788684426.878328:0:3626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d664856f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c986901f-6089-4802-a23d-1179db951431:3626:1875571085885184:0@lo:400:kworker.0 00000100:00100000:2.0:1788684426.878393:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788684426.878417:0:3626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6646d31c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3626:1875571085885696:0@lo:400:kworker.0 00000100:00100000:2.0:1788684426.878439:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788684426.878457:0:3626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6648e83800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3626:1875571085886208:0@lo:400:kworker.0 00000100:00100000:2.0:1788684426.878476:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1788684426.878513:0:17166:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788684426.878528:0:17176:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085885312 00000100:00100000:2.0:1788684426.878532:0:17176:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085885312 00000100:00100000:2.0:1788684426.878568:0:17176:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085885824 00000100:00100000:2.0:1788684426.878572:0:17176:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085885824 00000100:00100000:2.0:1788684426.878587:0:17176:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1788684426.878593:0:17176:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6648e83100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3626:x1875571085885312:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788684426.878654:0:17176:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6648e83100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3626:x1875571085885312:12345-0@lo:400:kworker.0 Request processed in 61us (441us total) trans 0 rc 0/0 00000100:00100000:2.0:1788684426.878660:0:17176:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1788684426.878671:0:17176:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1788684426.878677:0:17176:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6647909180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3626:x1875571085885824:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788684426.878704:0:17176:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6647909180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3626:x1875571085885824:12345-0@lo:400:kworker.0 Request processed in 28us (443us total) trans 0 rc 0/0 00000100:00100000:2.0:1788684426.878710:0:17176:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1788684426.878728:0:18403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085886336 00000100:00100000:2.0:1788684426.878731:0:18403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085886336 00000100:00100000:2.0:1788684426.878757:0:18403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085885696 00000100:00100000:2.0:1788684426.878759:0:18403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085885696 00000100:00100000:2.0:1788684426.878768:0:18403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085886208 00000100:00100000:2.0:1788684426.878770:0:18403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085886208 00000100:00100000:2.0:1788684426.878781:0:18403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:2.0:1788684426.878786:0:18403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6647908e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3626:x1875571085886336:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788684426.878812:0:18403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6647908e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3626:x1875571085886336:12345-0@lo:400:kworker.0 Request processed in 27us (510us total) trans 0 rc 0/0 00000100:00100000:2.0:1788684426.878818:0:18403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:2.0:1788684426.878828:0:18403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:2.0:1788684426.878833:0:18403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6647908380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3626:x1875571085885696:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788684426.878855:0:18403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6647908380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3626:x1875571085885696:12345-0@lo:400:kworker.0 Request processed in 22us (416us total) trans 0 rc 0/0 00000100:00100000:2.0:1788684426.878860:0:18403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:2.0:1788684426.878871:0:18403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:2.0:1788684426.878876:0:18403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6647908000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3626:x1875571085886208:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788684426.878926:0:18403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6647908000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3626:x1875571085886208:12345-0@lo:400:kworker.0 Request processed in 49us (448us total) trans 0 rc 0/0 00000100:00100000:2.0:1788684426.878931:0:18403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:2.0:1788684426.878950:0:17164:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085885184 00000100:00100000:2.0:1788684426.878953:0:17164:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085885184 00000100:00100000:2.0:1788684426.878975:0:17164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 172 00000100:00100000:2.0:1788684426.878981:0:17164:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d664108e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c986901f-6089-4802-a23d-1179db951431+24:3626:x1875571085885184:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788684426.879009:0:17164:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d664108e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c986901f-6089-4802-a23d-1179db951431+24:3626:x1875571085885184:12345-0@lo:400:kworker.0 Request processed in 28us (615us total) trans 0 rc 0/0 00000100:00100000:2.0:1788684426.879014:0:17164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 172 00000100:00080000:2.0:1788684426.879047:0:17166:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788684426.879050:0:17166:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788684426.879061:0:3624:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d664856d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3624:1875571085885568:0@lo:400:kworker.0 00000100:00100000:2.0:1788684426.879082:0:3624:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788684426.879100:0:3624:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6648e81500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3624:1875571085886080:0@lo:400:kworker.0 00000100:00100000:2.0:1788684426.879116:0:3624:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788684426.879130:0:3624:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6648e80e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3624:1875571085886592:0@lo:400:kworker.0 00000100:00100000:2.0:1788684426.879147:0:3624:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788684426.879186:0:3624:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d664856e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3624:1875571085885056:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788684426.879205:0:3624:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:2.0:1788684426.879211:0:3624:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d664856c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3624:1875571085885440:0@lo:400:kworker.0 00000100:00100000:2.0:1788684426.879232:0:3624:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788684426.879252:0:3624:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d677fa83100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3624:1875571085885952:0@lo:400:kworker.0 00000100:00100000:2.0:1788684426.879272:0:3624:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788684426.879288:0:3624:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6648e82680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3624:1875571085886464:0@lo:400:kworker.0 00000100:00100000:2.0:1788684426.879316:0:3624:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788684426.879343:0:19567:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085885568 00000100:00100000:2.0:1788684426.879346:0:19567:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085885568 00000100:00100000:2.0:1788684426.879400:0:19567:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085885440 00000100:00100000:2.0:1788684426.879404:0:19567:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085885440 00000100:00100000:2.0:1788684426.879422:0:19567:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085885952 00000100:00100000:2.0:1788684426.879425:0:19567:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085885952 00000100:00100000:2.0:1788684426.879439:0:19567:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1788684426.879445:0:19567:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6647909880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3624:x1875571085885568:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788684426.879477:0:19567:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6647909880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3624:x1875571085885568:12345-0@lo:400:kworker.0 Request processed in 32us (393us total) trans 0 rc 0/0 00000100:00100000:2.0:1788684426.879483:0:19567:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1788684426.879496:0:19567:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1788684426.879501:0:19567:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d664790aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3624:x1875571085885440:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788684426.879528:0:19567:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d664790aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3624:x1875571085885440:12345-0@lo:400:kworker.0 Request processed in 27us (295us total) trans 0 rc 0/0 00000100:00100000:2.0:1788684426.879534:0:19567:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1788684426.879545:0:19567:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1788684426.879550:0:19567:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d664790ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3624:x1875571085885952:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788684426.879575:0:19567:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d664790ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3624:x1875571085885952:12345-0@lo:400:kworker.0 Request processed in 25us (302us total) trans 0 rc 0/0 00000100:00100000:2.0:1788684426.879581:0:19567:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1788684426.879604:0:17172:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085886080 00000100:00100000:2.0:1788684426.879607:0:17172:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085886080 00000100:00100000:2.0:1788684426.879640:0:17172:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085886592 00000100:00100000:2.0:1788684426.879644:0:17172:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085886592 00000100:00100000:2.0:1788684426.879658:0:17172:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085886464 00000100:00100000:2.0:1788684426.879660:0:17172:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085886464 00000100:00100000:2.0:1788684426.879683:0:17172:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:2.0:1788684426.879688:0:17172:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d664790b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3624:x1875571085886080:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788684426.879717:0:17172:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d664790b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3624:x1875571085886080:12345-0@lo:400:kworker.0 Request processed in 29us (600us total) trans 0 rc 0/0 00000100:00100000:2.0:1788684426.879723:0:17172:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:2.0:1788684426.879735:0:17172:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:2.0:1788684426.879741:0:17172:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6647909500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3624:x1875571085886592:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788684426.879767:0:17172:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6647909500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3624:x1875571085886592:12345-0@lo:400:kworker.0 Request processed in 26us (618us total) trans 0 rc 0/0 00000100:00100000:2.0:1788684426.879773:0:17172:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:2.0:1788684426.879784:0:17172:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:2.0:1788684426.879790:0:17172:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6647908a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3624:x1875571085886464:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788684426.879816:0:17172:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6647908a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3624:x1875571085886464:12345-0@lo:400:kworker.0 Request processed in 26us (499us total) trans 0 rc 0/0 00000100:00100000:2.0:1788684426.879822:0:17172:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00080000:2.0:1788684426.879841:0:17166:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788684426.879844:0:17166:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1788684426.879847:0:17166:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788684426.879848:0:17166:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788684426.879869:0:3626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d664856f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c986901f-6089-4802-a23d-1179db951431:3626:1875571085885184:0@lo:400:kworker.0 00000100:00100000:2.0:1788684426.879881:0:3626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6646d31c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3626:1875571085885696:0@lo:400:kworker.0 00000100:00100000:2.0:1788684426.879893:0:3626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6648e83800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3626:1875571085886208:0@lo:400:kworker.0 00000100:00100000:2.0:1788684426.879904:0:3626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d664856fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3626:1875571085885312:0@lo:400:kworker.0 00000100:00100000:2.0:1788684426.879914:0:3626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d677fa81180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3626:1875571085885824:0@lo:400:kworker.0 00010000:00080000:2.0:1788684426.879938:0:3626:0:(ldlm_request.c:1670:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d6648e82300 x1875571085886336/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788684442 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788684426.879949:0:3626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6648e82300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3626:1875571085886336:0@lo:400:kworker.0 00000100:00100000:2.0:1788684426.879985:0:3624:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d664856c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3624:1875571085885440:0@lo:400:kworker.0 00000100:00100000:2.0:1788684426.879994:0:3624:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d677fa83100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3624:1875571085885952:0@lo:400:kworker.0 00000100:00100000:2.0:1788684426.880002:0:3624:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6648e82680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3624:1875571085886464:0@lo:400:kworker.0 00000100:00100000:2.0:1788684426.880011:0:3624:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d664856d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3624:1875571085885568:0@lo:400:kworker.0 00000100:00100000:2.0:1788684426.880020:0:3624:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6648e81500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3624:1875571085886080:0@lo:400:kworker.0 00010000:00080000:2.0:1788684426.880030:0:3624:0:(ldlm_request.c:1670:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d6648e80e00 x1875571085886592/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788684442 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788684426.880039:0:3624:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6648e80e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3624:1875571085886592:0@lo:400:kworker.0 00000100:00100000:1.0:1788684426.880944:0:3625:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d677fb45180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3625:1875571085886720:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788684426.880991:0:3625:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788684426.881167:0:18682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085886720 00000100:00100000:0.0:1788684426.881174:0:18682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085886720 00000100:00100000:0.0:1788684426.881217:0:18682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1788684426.881226:0:18682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67450b2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3625:x1875571085886720:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788684426.881244:0:18682:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 4218880 granted 17886912 pending 0 free 3915849728 avail 3684327424 00000100:00100000:0.0:1788684426.881291:0:18682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67450b2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3625:x1875571085886720:12345-0@lo:13:osp-pre-1-0.0 Request processed in 66us (299us total) trans 0 rc 0/0 00000100:00100000:0.0:1788684426.881298:0:18682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1788684426.881400:0:3625:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d677fb45180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3625:1875571085886720:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788684426.887080:0:3626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6647909c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3626:1875571085886848:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788684426.887158:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788684426.887980:0:18681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085886848 00000100:00100000:1.0:1788684426.887991:0:18681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085886848 00000100:00100000:1.0:1788684426.888043:0:18681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1788684426.888060:0:18681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d664876c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3626:x1875571085886848:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788684426.888089:0:18681:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923513344 avail 3691991040 00000100:00100000:1.0:1788684426.895012:0:18681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d664876c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3626:x1875571085886848:12345-0@lo:13:osp-pre-0-0.0 Request processed in 6946us (7847us total) trans 0 rc 0/0 00000100:00100000:1.0:1788684426.895026:0:18681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1788684426.895195:0:3626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6647909c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3626:1875571085886848:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788684426.937225:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:3.0:1788684426.937275:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:3.0:1788684426.937309:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:3.0:1788684426.937333:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:3.0:1788684426.937361:0:17173:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073232512 00000100:00100000:3.0:1788684426.937394:0:17173:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073232512 00000100:00100000:3.0:1788684426.937455:0:17173:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073232768 00000100:00100000:3.0:1788684426.937459:0:17173:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073232768 00000100:00100000:3.0:1788684426.937475:0:17173:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073232384 00000100:00100000:3.0:1788684426.937478:0:17173:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073232384 00000100:00100000:3.0:1788684426.937512:0:17173:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 86 00000100:00100000:3.0:1788684426.937523:0:17173:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d664876ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c4cf9959-ce83-48ba-884e-11c1ebaf899c+5:2393:x1875571073232512:12345-192.168.206.44@tcp:400:kworker.0 00000100:00100000:0.0:1788684426.937671:0:17163:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073232256 00000100:00100000:0.0:1788684426.937676:0:17163:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073232256 00000100:00100000:0.0:1788684426.937708:0:17163:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 173 00000100:00100000:0.0:1788684426.937715:0:17163:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d664108cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:558e5e46-625a-47f1-bf34-9eb61f632413+13:2393:x1875571073232256:12345-192.168.206.44@tcp:400:kworker.0 00000100:00100000:0.0:1788684426.937786:0:17163:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d664108cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:558e5e46-625a-47f1-bf34-9eb61f632413+13:2393:x1875571073232256:12345-192.168.206.44@tcp:400:kworker.0 Request processed in 70us (568us total) trans 0 rc 0/0 00000100:00100000:0.0:1788684426.937794:0:17163:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 173 00000100:00100000:3.0:1788684426.937991:0:17173:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d664876ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c4cf9959-ce83-48ba-884e-11c1ebaf899c+5:2393:x1875571073232512:12345-192.168.206.44@tcp:400:kworker.0 Request processed in 470us (715us total) trans 0 rc 0/0 00000100:00100000:3.0:1788684426.937999:0:17173:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 86 00000100:00100000:3.0:1788684426.938012:0:17173:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 87 00000100:00100000:3.0:1788684426.938018:0:17173:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d664876d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:55cddeac-d533-48cb-9ea5-95cbce9430eb+6:2393:x1875571073232768:12345-192.168.206.44@tcp:400:kworker.0 00000100:00100000:3.0:1788684426.938039:0:17173:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d664876d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:55cddeac-d533-48cb-9ea5-95cbce9430eb+6:2393:x1875571073232768:12345-192.168.206.44@tcp:400:kworker.0 Request processed in 21us (730us total) trans 0 rc 0/0 00000100:00100000:3.0:1788684426.938058:0:17173:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 87 00000100:00100000:3.0:1788684426.938070:0:17173:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 88 00000100:00100000:3.0:1788684426.938077:0:17173:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d664876e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c4cf9959-ce83-48ba-884e-11c1ebaf899c+13:2393:x1875571073232384:12345-192.168.206.44@tcp:400:kworker.0 00000100:00100000:3.0:1788684426.938102:0:17173:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d664876e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c4cf9959-ce83-48ba-884e-11c1ebaf899c+13:2393:x1875571073232384:12345-192.168.206.44@tcp:400:kworker.0 Request processed in 25us (766us total) trans 0 rc 0/0 00000100:00100000:3.0:1788684426.938107:0:17173:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 88 00000100:00080000:3.0:1788684426.938126:0:17166:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788684426.938129:0:17166:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788684426.953287:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:0.0:1788684426.953391:0:19567:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073232640 00000100:00100000:0.0:1788684426.953403:0:19567:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073232640 00000100:00100000:0.0:1788684426.953465:0:19567:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 35 00000100:00100000:0.0:1788684426.953475:0:19567:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d677709a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:c4cf9959-ce83-48ba-884e-11c1ebaf899c+5:2393:x1875571073232640:12345-192.168.206.44@tcp:400:kworker.0 00000100:00080000:3.0:1788684426.953781:0:17166:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788684426.953883:0:19567:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d677709a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:c4cf9959-ce83-48ba-884e-11c1ebaf899c+5:2393:x1875571073232640:12345-192.168.206.44@tcp:400:kworker.0 Request processed in 408us (604us total) trans 0 rc 0/0 00000100:00100000:0.0:1788684426.953891:0:19567:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 35 00000100:00100000:3.0:1788684426.958533:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:0.0:1788684426.958829:0:17173:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073232896 00000100:00100000:0.0:1788684426.958850:0:17173:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073232896 00000100:00100000:0.0:1788684426.958927:0:17173:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 89 00000100:00100000:0.0:1788684426.958937:0:17173:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6777098000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:55cddeac-d533-48cb-9ea5-95cbce9430eb+5:2393:x1875571073232896:12345-192.168.206.44@tcp:400:kworker.0 00000100:00100000:0.0:1788684426.959008:0:17173:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6777098000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:55cddeac-d533-48cb-9ea5-95cbce9430eb+5:2393:x1875571073232896:12345-192.168.206.44@tcp:400:kworker.0 Request processed in 72us (487us total) trans 0 rc 0/0 00000100:00100000:0.0:1788684426.959016:0:17173:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 89 00000100:00080000:3.0:1788684426.959126:0:17166:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:1.0:1788684427.009335:0:17160:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1788684427.903911:0:19491:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 55cddeac-d533-48cb-9ea5-95cbce9430eb 00000020:00000080:3.0:1788684427.903921:0:19491:0:(genops.c:885:class_export_put()) final put ffff8d664658a000/55cddeac-d533-48cb-9ea5-95cbce9430eb 00000020:00000080:0.0:1788684427.904009:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff8d664658a000/55cddeac-d533-48cb-9ea5-95cbce9430eb for lustre-OST0001 00000020:00000080:0.0:1788684427.904068:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8d664658d800 for lustre-OST0001 00000001:00100000:3.0:1788684427.909253:0:18674:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 55cddeac-d533-48cb-9ea5-95cbce9430eb 00000020:00000080:3.0:1788684427.909262:0:18674:0:(genops.c:885:class_export_put()) final put ffff8d664658f000/55cddeac-d533-48cb-9ea5-95cbce9430eb 00000001:00100000:3.0:1788684427.909287:0:18674:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of c4cf9959-ce83-48ba-884e-11c1ebaf899c 00000020:00000080:3.0:1788684427.909289:0:18674:0:(genops.c:885:class_export_put()) final put ffff8d664844f800/c4cf9959-ce83-48ba-884e-11c1ebaf899c 00000020:00000080:2.0:1788684427.909550:0:14645:0:(genops.c:844:class_export_destroy()) destroying export ffff8d664658f000/55cddeac-d533-48cb-9ea5-95cbce9430eb for lustre-OST0000 00000020:00000080:2.0:1788684427.909897:0:14645:0:(genops.c:844:class_export_destroy()) destroying export ffff8d664844f800/c4cf9959-ce83-48ba-884e-11c1ebaf899c for lustre-OST0000 00000020:00000080:2.0:1788684427.909932:0:14645:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8d664658e000 for lustre-OST0000 00000020:00000080:2.0:1788684427.909937:0:14645:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8d66459a8000 for lustre-OST0000 00010000:00010000:3.0:1788684428.033021:0:17159:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788684429.053518:0:17160:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788684429.928548:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:0.0:1788684429.928670:0:17174:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073233152 00000100:00100000:0.0:1788684429.928685:0:17174:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073233152 00000100:00100000:0.0:1788684429.928778:0:17174:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 13 00000100:00100000:0.0:1788684429.928791:0:17174:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6648555c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c4cf9959-ce83-48ba-884e-11c1ebaf899c+13:16339:x1875571073233152:12345-192.168.206.44@tcp:35:umount.0 00000001:00080000:0.0:1788684429.929031:0:17174:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934624 00000001:00080000:0.0:1788684429.929291:0:17174:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934625 00000100:00100000:0.0:1788684429.929589:0:17174:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6648555c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c4cf9959-ce83-48ba-884e-11c1ebaf899c+16:16339:x1875571073233152:12345-192.168.206.44@tcp:35:umount.0 Request processed in 800us (1057us total) trans 8589934626 rc 0/0 00000100:00100000:0.0:1788684429.929597:0:17174:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 13 00000020:00080000:0.0:1788684429.929602:0:17174:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00000100:00080000:3.0:1788684429.929825:0:17166:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788684429.933837:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:2.0:1788684429.933885:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:3.0:1788684429.935086:0:17156:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073233280 00000100:00100000:3.0:1788684429.935098:0:17156:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073233280 00000100:00100000:3.0:1788684429.935307:0:17156:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073233408 00000100:00100000:3.0:1788684429.935311:0:17156:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073233408 00000100:00100000:0.0:1788684429.935420:0:17158:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 3 00000100:00100000:0.0:1788684429.935433:0:17158:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d664790bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:558e5e46-625a-47f1-bf34-9eb61f632413+14:2390:x1875571073233280:12345-192.168.206.44@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788684429.935449:0:17158:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788684429.935480:0:17158:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d66479a1a00/0x44bac02bd54ad92c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x44801000000000 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3e35 expref: 14 pid: 17164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684429.935495:0:17158:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788684429.935612:0:17158:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d664790bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:558e5e46-625a-47f1-bf34-9eb61f632413+13:2390:x1875571073233280:12345-192.168.206.44@tcp:103:ldlm_bl.0 Request processed in 163us (1765us total) trans 0 rc 0/0 00000100:00100000:0.0:1788684429.935620:0:17158:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 3 00000100:00100000:0.0:1788684429.935648:0:17158:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 4 00000100:00100000:0.0:1788684429.935655:0:17158:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67771e0450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:558e5e46-625a-47f1-bf34-9eb61f632413+12:2390:x1875571073233408:12345-192.168.206.44@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788684429.935662:0:17158:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788684429.935671:0:17158:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d66476d4400/0x44bac02bd54ad933 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3e66 expref: 12 pid: 17163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684429.935680:0:17158:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788684429.935699:0:17158:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67771e0450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:558e5e46-625a-47f1-bf34-9eb61f632413+11:2390:x1875571073233408:12345-192.168.206.44@tcp:103:ldlm_bl.0 Request processed in 45us (1814us total) trans 0 rc 0/0 00000100:00100000:0.0:1788684429.935705:0:17158:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 4 00000100:00100000:1.0:1788684429.940332:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:0.0:1788684429.940652:0:17158:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073233536 00000100:00100000:0.0:1788684429.940663:0:17158:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073233536 00000100:00100000:0.0:1788684429.940759:0:17158:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 5 00000100:00100000:0.0:1788684429.940779:0:17158:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67450b0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:558e5e46-625a-47f1-bf34-9eb61f632413+11:2390:x1875571073233536:12345-192.168.206.44@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788684429.940795:0:17158:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788684429.940980:0:17158:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d66476d5c00/0x44bac02bd54ad9b8 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801000000000 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3f1c expref: 11 pid: 17165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684429.940998:0:17158:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788684429.941093:0:17158:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67450b0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:558e5e46-625a-47f1-bf34-9eb61f632413+10:2390:x1875571073233536:12345-192.168.206.44@tcp:103:ldlm_bl.0 Request processed in 316us (768us total) trans 0 rc 0/0 00000100:00100000:0.0:1788684429.941113:0:17158:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 5 00000100:00100000:2.0:1788684429.947043:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:3.0:1788684429.947147:0:18679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073233664 00000100:00100000:3.0:1788684429.947156:0:18679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073233664 00000100:00100000:3.0:1788684429.947408:0:18679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 31 00000100:00100000:3.0:1788684429.947419:0:18679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d664790a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c4cf9959-ce83-48ba-884e-11c1ebaf899c+5:2389:x1875571073233664:12345-192.168.206.44@tcp:9:umount.0 00000020:00000080:3.0:1788684429.947454:0:18679:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x44bac02bd54ad94f 00000100:00080000:3.0:1788684429.947463:0:18679:0:(import.c:65:import_set_state_nolock()) ffff8d664658d000 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1788684429.947517:0:18679:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 8589934600 00000100:00100000:3.0:1788684429.947673:0:18679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d664790a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c4cf9959-ce83-48ba-884e-11c1ebaf899c+2:2389:x1875571073233664:12345-192.168.206.44@tcp:9:umount.0 Request processed in 256us (638us total) trans 0 rc 0/0 00000100:00100000:3.0:1788684429.947681:0:18679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 31 00010000:00010000:1.0:1788684429.947777:0:17159:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1788684429.948347:0:17166:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788684429.949653:0:3624:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788684429.949677:0:3624:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d67450b2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3624:1875571085886976:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788684429.949739:0:3624:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788684429.949830:0:17176:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085886976 00000100:00100000:1.0:1788684429.949837:0:17176:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085886976 00000100:00100000:1.0:1788684429.949888:0:17176:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1788684429.949896:0:17176:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6648554000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3624:x1875571085886976:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1788684429.949933:0:17176:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:1.0:1788684429.949977:0:17176:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6648554000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3624:x1875571085886976:12345-0@lo:41:osp-pre-1-0.0 Request processed in 81us (237us total) trans 0 rc 0/0 00000100:00100000:1.0:1788684429.949983:0:17176:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1788684429.950021:0:3624:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d67450b2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3624:1875571085886976:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788684429.950083:0:3623:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788684429.950090:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d67450b2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3623:1875571085887104:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788684429.950139:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788684429.950185:0:20360:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085887104 00000100:00100000:1.0:1788684429.950189:0:20360:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085887104 00000100:00080000:2.0:1788684429.950215:0:17166:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788684429.950225:0:20360:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1788684429.950233:0:20360:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d677fab7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3623:x1875571085887104:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1788684429.950252:0:20360:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923513344 avail 3691991040 00000100:00100000:1.0:1788684429.950293:0:20360:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d677fab7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3623:x1875571085887104:12345-0@lo:13:osp-pre-0-1.0 Request processed in 61us (153us total) trans 0 rc 0/0 00000100:00100000:1.0:1788684429.950307:0:20360:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1788684429.950342:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d67450b2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3623:1875571085887104:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788684429.951588:0:3625:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d677fb46a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3625:1875571085887232:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788684429.951664:0:3625:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788684429.951812:0:17912:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085887232 00000100:00100000:2.0:1788684429.951829:0:17912:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085887232 00000100:00100000:2.0:1788684429.951928:0:17912:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1788684429.951940:0:17912:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d677fab6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3625:x1875571085887232:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1788684429.951967:0:17912:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446293504 avail 1300054016 00000100:00100000:2.0:1788684429.953134:0:17912:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d677fab6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3625:x1875571085887232:12345-0@lo:41:osp-pre-0-1.0 Request processed in 1192us (1464us total) trans 0 rc 0/0 00000100:00100000:2.0:1788684429.953147:0:17912:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1788684429.954463:0:3625:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d677fb46a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3625:1875571085887232:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788684429.972223:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:3.0:1788684429.972312:0:18403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073234560 00000100:00100000:3.0:1788684429.972321:0:18403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073234560 00000100:00100000:3.0:1788684429.972412:0:18403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 67 00000100:00100000:3.0:1788684429.972421:0:18403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d664790b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c4cf9959-ce83-48ba-884e-11c1ebaf899c+16:2389:x1875571073234560:12345-192.168.206.44@tcp:39:umount.0 00000020:00000080:3.0:1788684429.972452:0:18403:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x44bac02bd54ad941 00000020:00010000:3.0:1788684429.972478:0:18403:0:(genops.c:1921:obd_stale_export_put()) Put export ffff8d677cb8c800: total 0 00000100:00080000:3.0:1788684429.972482:0:18403:0:(import.c:65:import_set_state_nolock()) ffff8d677cb89800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1788684429.972506:0:18403:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934626 00000100:00100000:3.0:1788684429.972664:0:18403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d664790b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c4cf9959-ce83-48ba-884e-11c1ebaf899c+15:2389:x1875571073234560:12345-192.168.206.44@tcp:39:umount.0 Request processed in 243us (449us total) trans 8589934627 rc 0/0 00000100:00100000:3.0:1788684429.972672:0:18403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 67 00000020:00010000:0.0:1788684429.973567:0:17160:0:(genops.c:1907:obd_stale_export_get()) Get export ffff8d677cb8c800: total 0 00010000:00010000:0.0:1788684429.973573:0:17160:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788684429.973631:0:17160:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff8d677cb8c800, canceled 0 locks, left on hash table 8. 00010000:00010000:0.0:1788684429.973663:0:17160:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8d6641869c00) 00010000:00010000:0.0:1788684429.973666:0:17160:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1788684429.973675:0:17160:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d6746d3ee00/0x44bac02bd54adb6a lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3f8c expref: 14 pid: 17173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684429.973694:0:17160:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8d6750b68800) 00010000:00010000:0.0:1788684429.973696:0:17160:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788684429.973700:0:17160:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d5600/0x44bac02bd54ada28 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3f2a expref: 13 pid: 18403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684429.973731:0:17160:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d677cc3ca00) 00010000:00010000:0.0:1788684429.973733:0:17160:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788684429.973737:0:17160:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d66479a1000/0x44bac02bd54ada67 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3f38 expref: 12 pid: 17173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684429.973748:0:17160:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff8d6641869500) 00010000:00010000:0.0:1788684429.973750:0:17160:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1788684429.973753:0:17160:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d6746d3e200/0x44bac02bd54adbf6 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3fb6 expref: 11 pid: 17173 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684429.973767:0:17160:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8d6641869c00) 00010000:00010000:0.0:1788684429.973770:0:17160:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1788684429.973774:0:17160:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d6746cb2600/0x44bac02bd54adc51 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3fd9 expref: 10 pid: 18403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684429.973808:0:17160:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff8d6750b68700) 00010000:00010000:0.0:1788684429.973810:0:17160:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788684429.973814:0:17160:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d5800/0x44bac02bd54ada0c lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3f23 expref: 9 pid: 17171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684429.973828:0:17160:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff8d6752340900) 00010000:00010000:0.0:1788684429.973831:0:17160:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1788684429.973835:0:17160:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d6746cb3000/0x44bac02bd54adaec lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3f62 expref: 8 pid: 18403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684429.973849:0:17160:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff8d6641869c00) 00010000:00010000:0.0:1788684429.973852:0:17160:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788684429.973855:0:17160:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d4c00/0x44bac02bd54adb9b lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3fa1 expref: 7 pid: 17171 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684429.973868:0:17160:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff8d677cb8c800, canceled 8 locks, left on hash table 0. 00010000:00010000:0.0:1788684429.973882:0:17160:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788684429.973884:0:17160:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788684429.973886:0:17160:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788684429.989248:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:0.0:1788684429.993040:0:17173:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073234688 00000100:00100000:0.0:1788684429.993062:0:17173:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073234688 00000100:00100000:0.0:1788684429.993183:0:17173:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 68 00000100:00080000:2.0:1788684429.993197:0:17166:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788684429.993205:0:17173:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d677fab5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c4cf9959-ce83-48ba-884e-11c1ebaf899c+5:2389:x1875571073234688:12345-192.168.206.44@tcp:39:umount.0 00000020:00000080:0.0:1788684429.993258:0:17173:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x44bac02bd54ad948 00000100:00080000:0.0:1788684429.993289:0:17173:0:(import.c:65:import_set_state_nolock()) ffff8d677cb8e800 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1788684429.993330:0:17173:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 2, last_transno is 8589934592 00010000:00010000:1.0:1788684429.993932:0:17159:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788684429.994127:0:17173:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d677fab5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c4cf9959-ce83-48ba-884e-11c1ebaf899c+3:2389:x1875571073234688:12345-192.168.206.44@tcp:39:umount.0 Request processed in 930us (4893us total) trans 8589934593 rc 0/0 00000100:00100000:0.0:1788684429.994139:0:17173:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 68 00010000:00010000:0.0:1788684430.082339:0:17160:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1788684430.847430:0:17922:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1788684431.103875:0:17159:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788684431.999358:0:3626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d677fb44380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3626:1875571085887360:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788684431.999458:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788684431.999557:0:18681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085887360 00000100:00100000:1.0:1788684431.999572:0:18681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085887360 00000100:00100000:1.0:1788684431.999676:0:18681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1788684431.999690:0:18681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6648556680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3626:x1875571085887360:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788684431.999731:0:18681:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3915849728 avail 3684327424 00000100:00100000:1.0:1788684431.999817:0:18681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6648556680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3626:x1875571085887360:12345-0@lo:13:osp-pre-1-0.0 Request processed in 131us (358us total) trans 0 rc 0/0 00000100:00100000:1.0:1788684431.999825:0:18681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1788684431.999887:0:3626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d677fb44380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3626:1875571085887360:0@lo:13:osp-pre-1-0.0 00000100:00080000:3.0:1788684431.999978:0:17166:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788684432.000237:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d664790a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3623:1875571085887488:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788684432.000287:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788684432.000643:0:3623:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788684432.000653:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6648557b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3623:1875571085887616:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788684432.000684:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788684432.000849:0:18681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085887488 00000100:00100000:3.0:1788684432.000873:0:18681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085887488 00000100:00100000:3.0:1788684432.000926:0:18681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085887616 00000100:00100000:3.0:1788684432.000929:0:18681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085887616 00000100:00100000:3.0:1788684432.000944:0:18681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1788684432.000953:0:18681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d677fb44000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3623:x1875571085887488:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788684432.000978:0:18681:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923513344 avail 3691991040 00000100:00100000:3.0:1788684432.001022:0:18681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d677fb44000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3623:x1875571085887488:12345-0@lo:13:osp-pre-0-0.0 Request processed in 70us (734us total) trans 0 rc 0/0 00000100:00100000:3.0:1788684432.001030:0:18681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1788684432.001044:0:18681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1788684432.001052:0:18681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d677fb46d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3623:x1875571085887616:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1788684432.001063:0:18681:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3915849728 avail 3684327424 00000100:00100000:3.0:1788684432.001088:0:18681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d677fb46d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3623:x1875571085887616:12345-0@lo:13:osp-pre-1-1.0 Request processed in 38us (403us total) trans 0 rc 0/0 00000100:00100000:3.0:1788684432.001095:0:18681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00080000:0.0:1788684432.001163:0:17166:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788684432.001167:0:17166:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788684432.001197:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6648557b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3623:1875571085887616:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788684432.001213:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d664790a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3623:1875571085887488:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788684432.001459:0:3625:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d677fab5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c986901f-6089-4802-a23d-1179db951431:3625:1875571085887744:0@lo:400:kworker.0 00000100:00100000:0.0:1788684432.001498:0:3625:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788684432.001604:0:17165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085887744 00000100:00100000:2.0:1788684432.001609:0:17165:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085887744 00000100:00100000:2.0:1788684432.001642:0:17165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 174 00000100:00100000:2.0:1788684432.001648:0:17165:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d664108f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c986901f-6089-4802-a23d-1179db951431+24:3625:x1875571085887744:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788684432.001715:0:3626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d677fab7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3626:1875571085887872:0@lo:400:kworker.0 00000100:00100000:3.0:1788684432.001748:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788684432.001783:0:17177:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085887872 00000100:00100000:3.0:1788684432.001787:0:17177:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085887872 00000100:00100000:3.0:1788684432.001815:0:17177:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1788684432.001821:0:17177:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6648557800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3626:x1875571085887872:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788684432.001858:0:17177:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6648557800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3626:x1875571085887872:12345-0@lo:400:kworker.0 Request processed in 37us (109us total) trans 0 rc 0/0 00000100:00100000:3.0:1788684432.001865:0:17177:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1788684432.001893:0:3626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d677fab7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3626:1875571085887872:0@lo:400:kworker.0 00000100:00100000:1.0:1788684432.002068:0:3624:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d677fab6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3624:1875571085888128:0@lo:400:kworker.0 00000100:00100000:1.0:1788684432.002096:0:3624:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788684432.002127:0:3624:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d677fab4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3624:1875571085888640:0@lo:400:kworker.0 00000100:00100000:1.0:1788684432.002153:0:3624:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788684432.002173:0:3624:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:1.0:1788684432.002178:0:3624:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d677fab5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3624:1875571085888000:0@lo:400:kworker.0 00000100:00100000:1.0:1788684432.002200:0:3624:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788684432.002218:0:3624:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d677fab6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3624:1875571085888512:0@lo:400:kworker.0 00000100:00100000:1.0:1788684432.002259:0:3624:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788684432.002288:0:18403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085888640 00000100:00100000:1.0:1788684432.002293:0:18403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085888640 00000100:00100000:1.0:1788684432.002328:0:18403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085888000 00000100:00100000:1.0:1788684432.002331:0:18403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085888000 00000100:00100000:1.0:1788684432.002342:0:18403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085888512 00000100:00100000:1.0:1788684432.002344:0:18403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085888512 00000100:00100000:1.0:1788684432.002355:0:18403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:1.0:1788684432.002361:0:18403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d677fab5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3624:x1875571085888640:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788684432.002429:0:18403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d677fab5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3624:x1875571085888640:12345-0@lo:400:kworker.0 Request processed in 68us (275us total) trans 0 rc 0/0 00000100:00100000:1.0:1788684432.002436:0:18403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:1.0:1788684432.002448:0:18403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:1.0:1788684432.002453:0:18403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d677fab6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3624:x1875571085888000:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788684432.002476:0:18403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d677fab6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3624:x1875571085888000:12345-0@lo:400:kworker.0 Request processed in 24us (276us total) trans 0 rc 0/0 00000100:00100000:1.0:1788684432.002482:0:18403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:1.0:1788684432.002492:0:18403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:1.0:1788684432.002497:0:18403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d677fab4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3624:x1875571085888512:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788684432.002519:0:18403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d677fab4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3624:x1875571085888512:12345-0@lo:400:kworker.0 Request processed in 22us (260us total) trans 0 rc 0/0 00000100:00100000:1.0:1788684432.002525:0:18403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:1.0:1788684432.002558:0:3624:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d677fab5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3624:1875571085888000:0@lo:400:kworker.0 00000100:00100000:1.0:1788684432.002567:0:3624:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d677fab6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3624:1875571085888512:0@lo:400:kworker.0 00010000:00080000:1.0:1788684432.002579:0:3624:0:(ldlm_request.c:1670:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d677fab4a80 x1875571085888640/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788684448 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788684432.002619:0:3624:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d677fab4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3624:1875571085888640:0@lo:400:kworker.0 00000100:00100000:1.0:1788684432.002642:0:3626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d677fab4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3626:1875571085888384:0@lo:400:kworker.0 00000100:00100000:1.0:1788684432.002665:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788684432.002681:0:3626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d677fab5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3626:1875571085888896:0@lo:400:kworker.0 00000100:00100000:1.0:1788684432.002701:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788684432.002718:0:3626:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:1.0:1788684432.002723:0:3626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d677fab4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3626:1875571085888256:0@lo:400:kworker.0 00000100:00100000:1.0:1788684432.002744:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788684432.002761:0:3626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d677fab4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3626:1875571085888768:0@lo:400:kworker.0 00000100:00100000:1.0:1788684432.002778:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788684432.002801:0:19204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085888256 00000100:00100000:1.0:1788684432.002805:0:19204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085888256 00000100:00100000:1.0:1788684432.002837:0:19204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1788684432.002844:0:19204:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d677fab5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3626:x1875571085888256:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788684432.002877:0:19204:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d677fab5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3626:x1875571085888256:12345-0@lo:400:kworker.0 Request processed in 33us (131us total) trans 0 rc 0/0 00000100:00100000:1.0:1788684432.002883:0:19204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1788684432.002903:0:17171:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085888384 00000100:00100000:1.0:1788684432.002907:0:17171:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085888384 00000100:00100000:1.0:1788684432.002921:0:17171:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085888896 00000100:00100000:1.0:1788684432.002924:0:17171:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085888896 00000100:00100000:1.0:1788684432.002934:0:17171:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085888768 00000100:00100000:1.0:1788684432.002936:0:17171:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085888768 00000100:00100000:1.0:1788684432.002948:0:17171:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:1.0:1788684432.002953:0:17171:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d677fab4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3626:x1875571085888384:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788684432.002989:0:17171:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d677fab4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3626:x1875571085888384:12345-0@lo:400:kworker.0 Request processed in 35us (323us total) trans 0 rc 0/0 00000100:00100000:1.0:1788684432.002994:0:17171:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:1.0:1788684432.003005:0:17171:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:1.0:1788684432.003010:0:17171:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d677fab6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3626:x1875571085888896:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788684432.003032:0:17171:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d677fab6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3626:x1875571085888896:12345-0@lo:400:kworker.0 Request processed in 22us (331us total) trans 0 rc 0/0 00000100:00100000:1.0:1788684432.003037:0:17171:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:1.0:1788684432.003047:0:17171:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:1.0:1788684432.003052:0:17171:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d677fab7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3626:x1875571085888768:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788684432.003074:0:17171:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d677fab7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3626:x1875571085888768:12345-0@lo:400:kworker.0 Request processed in 22us (294us total) trans 0 rc 0/0 00000100:00100000:1.0:1788684432.003078:0:17171:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:1.0:1788684432.003104:0:3626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d677fab4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3626:1875571085888256:0@lo:400:kworker.0 00000100:00100000:1.0:1788684432.003114:0:3626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d677fab4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3626:1875571085888768:0@lo:400:kworker.0 00000100:00100000:1.0:1788684432.003122:0:3626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d677fab4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3626:1875571085888384:0@lo:400:kworker.0 00010000:00080000:1.0:1788684432.003131:0:3626:0:(ldlm_request.c:1670:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d677fab5c00 x1875571085888896/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788684448 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788684432.003140:0:3626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d677fab5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3626:1875571085888896:0@lo:400:kworker.0 00000100:00080000:1.0:1788684432.003183:0:17166:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788684432.003188:0:17166:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788684432.003191:0:17166:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788684432.003291:0:17912:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085888128 00000100:00100000:3.0:1788684432.003302:0:17912:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085888128 00000100:00100000:3.0:1788684432.003338:0:17912:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1788684432.003344:0:17912:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d677fab7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3624:x1875571085888128:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788684432.003405:0:17912:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d677fab7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3624:x1875571085888128:12345-0@lo:400:kworker.0 Request processed in 61us (1307us total) trans 0 rc 0/0 00000100:00100000:3.0:1788684432.003412:0:17912:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1788684432.003435:0:3624:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d677fab6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3624:1875571085888128:0@lo:400:kworker.0 00000100:00100000:2.0:1788684432.003512:0:17165:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d664108f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c986901f-6089-4802-a23d-1179db951431+24:3625:x1875571085887744:12345-0@lo:400:kworker.0 Request processed in 1862us (2011us total) trans 0 rc 0/0 00000100:00100000:2.0:1788684432.003521:0:17165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 174 00000100:00100000:0.0:1788684432.003638:0:3625:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d677fab5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c986901f-6089-4802-a23d-1179db951431:3625:1875571085887744:0@lo:400:kworker.0 00000100:00100000:3.0:1788684432.055329:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:3.0:1788684432.055430:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:3.0:1788684432.055479:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:3.0:1788684432.055547:0:17172:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073235072 00000100:00100000:3.0:1788684432.055560:0:17172:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073235072 00000100:00100000:3.0:1788684432.055642:0:17172:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073234944 00000100:00100000:3.0:1788684432.055646:0:17172:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073234944 00000100:00100000:3.0:1788684432.055686:0:17172:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 96 00000100:00100000:3.0:1788684432.055698:0:17172:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6648557b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:55cddeac-d533-48cb-9ea5-95cbce9430eb+5:2391:x1875571073235072:12345-192.168.206.44@tcp:400:kworker.0 00000100:00100000:3.0:1788684432.055795:0:17172:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6648557b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:55cddeac-d533-48cb-9ea5-95cbce9430eb+5:2391:x1875571073235072:12345-192.168.206.44@tcp:400:kworker.0 Request processed in 99us (364us total) trans 0 rc 0/0 00000100:00100000:3.0:1788684432.055805:0:17172:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 96 00000100:00100000:3.0:1788684432.055826:0:17172:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 97 00000100:00100000:3.0:1788684432.055833:0:17172:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d66477ed180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:55cddeac-d533-48cb-9ea5-95cbce9430eb+6:2391:x1875571073234944:12345-192.168.206.44@tcp:400:kworker.0 00000100:00100000:3.0:1788684432.055860:0:17172:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d66477ed180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:55cddeac-d533-48cb-9ea5-95cbce9430eb+6:2391:x1875571073234944:12345-192.168.206.44@tcp:400:kworker.0 Request processed in 28us (390us total) trans 0 rc 0/0 00000100:00100000:3.0:1788684432.055867:0:17172:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 97 00000100:00100000:0.0:1788684432.056055:0:17164:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073234816 00000100:00100000:0.0:1788684432.056061:0:17164:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073234816 00000100:00100000:0.0:1788684432.056111:0:17164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 175 00000100:00100000:0.0:1788684432.056119:0:17164:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d664108ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:558e5e46-625a-47f1-bf34-9eb61f632413+10:2391:x1875571073234816:12345-192.168.206.44@tcp:400:kworker.0 00000100:00100000:0.0:1788684432.056300:0:17164:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d664108ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:558e5e46-625a-47f1-bf34-9eb61f632413+10:2391:x1875571073234816:12345-192.168.206.44@tcp:400:kworker.0 Request processed in 180us (994us total) trans 0 rc 0/0 00000100:00100000:0.0:1788684432.056308:0:17164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 175 00000100:00080000:1.0:1788684432.056504:0:17166:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788684432.056510:0:17166:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:0.0:1788684432.126242:0:17160:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788684432.523078:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:3.0:1788684432.523127:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:3.0:1788684432.523186:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:1.0:1788684432.523347:0:20196:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073235200 00000100:00100000:1.0:1788684432.523363:0:20196:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073235200 00000100:00100000:0.0:1788684432.523419:0:17157:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073235456 00000100:00100000:0.0:1788684432.523433:0:17157:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073235456 00000100:00100000:1.0:1788684432.523493:0:20196:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073235328 00000100:00100000:1.0:1788684432.523499:0:20196:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073235328 00000100:00100000:2.0:1788684432.523515:0:17156:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 6 00000100:00100000:2.0:1788684432.523579:0:17156:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d66477eea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:558e5e46-625a-47f1-bf34-9eb61f632413+12:2393:x1875571073235200:12345-192.168.206.44@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788684432.523611:0:17156:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788684432.523643:0:17156:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d6746d3e400/0x44bac02bd54ad96b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x44801000000000 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3ea5 expref: 12 pid: 17165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684432.523667:0:17156:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788684432.523765:0:17156:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d66477eea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:558e5e46-625a-47f1-bf34-9eb61f632413+11:2393:x1875571073235200:12345-192.168.206.44@tcp:103:ldlm_bl.0 Request processed in 181us (697us total) trans 0 rc 0/0 00000100:00100000:1.0:1788684432.525932:0:20196:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 7 00000100:00100000:1.0:1788684432.525955:0:20196:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d66477ef480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:558e5e46-625a-47f1-bf34-9eb61f632413+11:2393:x1875571073235328:12345-192.168.206.44@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788684432.525974:0:20196:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788684432.526072:0:20196:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d6746d3ea00/0x44bac02bd54ad972 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3ed6 expref: 11 pid: 17165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684432.526094:0:20196:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788684432.526165:0:20196:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d66477ef480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:558e5e46-625a-47f1-bf34-9eb61f632413+10:2393:x1875571073235328:12345-192.168.206.44@tcp:103:ldlm_bl.0 Request processed in 219us (2978us total) trans 0 rc 0/0 00000100:00100000:1.0:1788684432.526173:0:20196:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 7 00000100:00100000:3.0:1788684432.526484:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:1.0:1788684432.526531:0:17172:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073235712 00000100:00100000:1.0:1788684432.526541:0:17172:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073235712 00000100:00100000:1.0:1788684432.526725:0:17172:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 69 00000100:00100000:1.0:1788684432.526736:0:17172:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d66477ec380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:55cddeac-d533-48cb-9ea5-95cbce9430eb+6:2389:x1875571073235712:12345-192.168.206.44@tcp:39:umount.0 00000020:00000080:1.0:1788684432.526779:0:17172:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x44bac02bd54ad980 00000020:00010000:1.0:1788684432.526788:0:17172:0:(genops.c:1921:obd_stale_export_put()) Put export ffff8d6746da9800: total 0 00000100:00080000:1.0:1788684432.526794:0:17172:0:(import.c:65:import_set_state_nolock()) ffff8d6746dad800 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1788684432.526820:0:17172:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934627 00000100:00100000:2.0:1788684432.526967:0:17156:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 6 00000100:00100000:1.0:1788684432.526978:0:17172:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d66477ec380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:55cddeac-d533-48cb-9ea5-95cbce9430eb+5:2389:x1875571073235712:12345-192.168.206.44@tcp:39:umount.0 Request processed in 242us (494us total) trans 8589934628 rc 0/0 00000100:00100000:1.0:1788684432.527000:0:17172:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 69 00000020:00010000:2.0:1788684432.527150:0:17159:0:(genops.c:1907:obd_stale_export_get()) Get export ffff8d6746da9800: total 0 00010000:00010000:2.0:1788684432.527239:0:17159:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff8d6746da9800, canceled 0 locks, left on hash table 1. 00010000:00010000:2.0:1788684432.527278:0:17159:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d677cc3ca00) 00010000:00010000:2.0:1788684432.527282:0:17159:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788684432.527291:0:17159:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d66479a0e00/0x44bac02bd54ada75 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3f3f expref: 4 pid: 17172 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684432.527332:0:17159:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff8d6746da9800, canceled 1 locks, left on hash table 0. 00010000:00010000:2.0:1788684432.527347:0:17159:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788684432.527349:0:17159:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788684432.527351:0:17159:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788684432.528116:0:17157:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 8 00000100:00100000:0.0:1788684432.528133:0:17157:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d66477ec000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:558e5e46-625a-47f1-bf34-9eb61f632413+8:2393:x1875571073235456:12345-192.168.206.44@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788684432.528151:0:17157:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788684432.528168:0:17157:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d66477b0800/0x44bac02bd54ad9b1 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3f15 expref: 8 pid: 17165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684432.528183:0:17157:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788684432.528244:0:17157:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d66477ec000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:558e5e46-625a-47f1-bf34-9eb61f632413+7:2393:x1875571073235456:12345-192.168.206.44@tcp:103:ldlm_bl.0 Request processed in 117us (5117us total) trans 0 rc 0/0 00000100:00100000:0.0:1788684432.528251:0:17157:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 8 00000100:00100000:3.0:1788684432.540254:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:1.0:1788684432.540417:0:18403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073235840 00000100:00100000:1.0:1788684432.540431:0:18403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073235840 00000100:00100000:1.0:1788684432.540657:0:18403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 70 00000100:00100000:1.0:1788684432.540687:0:18403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d66477eca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:55cddeac-d533-48cb-9ea5-95cbce9430eb+5:2389:x1875571073235840:12345-192.168.206.44@tcp:39:umount.0 00000020:00000080:1.0:1788684432.540741:0:18403:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x44bac02bd54ad987 00000100:00080000:1.0:1788684432.540755:0:18403:0:(import.c:65:import_set_state_nolock()) ffff8d677cbfa800 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1788684432.540864:0:18403:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 2, last_transno is 8589934593 00000100:00100000:1.0:1788684432.541061:0:18403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d66477eca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:55cddeac-d533-48cb-9ea5-95cbce9430eb+3:2389:x1875571073235840:12345-192.168.206.44@tcp:39:umount.0 Request processed in 376us (821us total) trans 8589934594 rc 0/0 00000100:00100000:1.0:1788684432.541071:0:18403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 70 00010000:00010000:0.0:1788684432.542070:0:17160:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788684432.589820:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:0.0:1788684432.589938:0:17165:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073236096 00000100:00100000:0.0:1788684432.589952:0:17165:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073236096 00000100:00100000:0.0:1788684432.590028:0:17165:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 176 00000100:00100000:0.0:1788684432.590041:0:17165:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6647a13450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:558e5e46-625a-47f1-bf34-9eb61f632413+7:2389:x1875571073236096:12345-192.168.206.44@tcp:251:umount.0 00000020:00000080:0.0:1788684432.590100:0:17165:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x44bac02bd54ad91e 00000020:00010000:0.0:1788684432.590111:0:17165:0:(genops.c:1921:obd_stale_export_put()) Put export ffff8d677cc68000: total 0 00000100:00080000:0.0:1788684432.590116:0:17165:0:(import.c:65:import_set_state_nolock()) ffff8d67488fa800 : changing import state from FULL to CLOSED 00000020:00010000:1.0:1788684432.590202:0:17159:0:(genops.c:1907:obd_stale_export_get()) Get export ffff8d677cc68000: total 0 00010000:00010000:1.0:1788684432.590208:0:17159:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788684432.590222:0:17165:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6647a13450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:558e5e46-625a-47f1-bf34-9eb61f632413+3:2389:x1875571073236096:12345-192.168.206.44@tcp:251:umount.0 Request processed in 183us (418us total) trans 0 rc 0/0 00000100:00100000:0.0:1788684432.590230:0:17165:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 176 00010000:00010000:1.0:1788684432.590267:0:17159:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff8d677cc68000, canceled 0 locks, left on hash table 1. 00010000:00010000:1.0:1788684432.590305:0:17159:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d66476d4e00/0x44bac02bd54ad925 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801000000000 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3e2e expref: 2 pid: 17163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684432.590322:0:17159:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff8d677cc68000, canceled 1 locks, left on hash table 0. 00000020:00000080:1.0:1788684432.590333:0:17159:0:(genops.c:885:class_export_put()) final put ffff8d677cc68000/558e5e46-625a-47f1-bf34-9eb61f632413 00010000:00010000:1.0:1788684432.590354:0:17159:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788684432.590357:0:17159:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788684432.590359:0:17159:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1788684432.590481:0:14645:0:(genops.c:844:class_export_destroy()) destroying export ffff8d677cc68000/558e5e46-625a-47f1-bf34-9eb61f632413 for MGS 00000020:00000080:0.0:1788684432.598999:0:14645:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8d67488fa800 for MGS 00010000:00010000:2.0:1788684433.150430:0:17160:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788684434.173750:0:17159:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:1.0:1788684434.741796:0:20742:0:(tgt_mount.c:2195:server_umount_begin()) umount -f 00000020:01000004:1.0:1788684434.760724:0:20742:0:(tgt_mount.c:2065:server_put_super()) server put_super lustre-MDT0000 00010000:00010000:1.0:1788684434.760803:0:20742:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.144@tcp lock: ffff8d6647890400/0x44bac02bd54ad4e1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x44bac02bd54ad4e8 expref: -99 pid: 17150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684434.760824:0:20742:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.144@tcp lock: ffff8d6647890400/0x44bac02bd54ad4e1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x44bac02bd54ad4e8 expref: -99 pid: 17150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684434.760833:0:20742:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.144@tcp lock: ffff8d6647890400/0x44bac02bd54ad4e1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000400000000 nid: local remote: 0x44bac02bd54ad4e8 expref: -99 pid: 17150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684434.760866:0:20742:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.144@tcp lock: ffff8d6647890400/0x44bac02bd54ad4e1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000400000000 nid: local remote: 0x44bac02bd54ad4e8 expref: -99 pid: 17150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684434.760903:0:20742:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:1.0:1788684434.760910:0:20742:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:1.0:1788684434.760939:0:20742:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1788684434.760945:0:20742:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 3 00000100:00080000:1.0:1788684434.760953:0:20742:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00080000:1.0:1788684434.760988:0:20742:0:(import.c:65:import_set_state_nolock()) ffff8d67749d9000 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00010000:00010000:0.0:1788684434.761056:0:17160:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788684434.761066:0:17160:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.144@tcp lock: ffff8d6647890400/0x44bac02bd54ad4e1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000400000000 nid: local remote: 0x44bac02bd54ad4e8 expref: -99 pid: 17150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684434.761087:0:17160:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d6647890400 already unused, calling callback (ffffffffc1297c20) 10000000:00010000:0.0:1788684434.761091:0:17160:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.144@tcp lock: ffff8d6647890400/0x44bac02bd54ad4e1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000400000000 nid: local remote: 0x44bac02bd54ad4e8 expref: -99 pid: 17150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684434.761100:0:17160:0:(ldlm_request.c:1390:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.144@tcp lock: ffff8d6647890400/0x44bac02bd54ad4e1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1008400000000 nid: local remote: 0x44bac02bd54ad4e8 expref: -99 pid: 17150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788684434.761108:0:17160:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.144@tcp lock: ffff8d6647890400/0x44bac02bd54ad4e1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1009400000000 nid: local remote: 0x44bac02bd54ad4e8 expref: -99 pid: 17150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788684434.761114:0:17160:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1788684434.761117:0:17160:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:0.0:1788684434.761120:0:17160:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:0.0:1788684434.761156:0:17160:0:(ldlm_request.c:1438:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.144@tcp lock: ffff8d6647890400/0x44bac02bd54ad4e1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0x44bac02bd54ad4e8 expref: -99 pid: 17150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684434.761164:0:17160:0:(ldlm_request.c:1497:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788684434.761199:0:17160:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.144@tcp lock: ffff8d6647890400/0x44bac02bd54ad4e1 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0x44bac02bd54ad4e8 expref: -99 pid: 17150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684434.761207:0:17160:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.144@tcp lock: ffff8d6647890400/0x44bac02bd54ad4e1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0x44bac02bd54ad4e8 expref: -99 pid: 17150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684434.761228:0:17160:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788684434.761230:0:17160:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788684434.761232:0:17160:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788684434.761242:0:3624:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788684434.761265:0:3624:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d677fb44a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c986901f-6089-4802-a23d-1179db951431:3624:1875571085889152:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788684434.761354:0:3624:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788684434.761911:0:17158:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085889152 00000100:00100000:0.0:1788684434.761923:0:17158:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085889152 00000100:00100000:0.0:1788684434.761999:0:17158:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1788684434.762012:0:17158:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d677fb44700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c986901f-6089-4802-a23d-1179db951431+24:3624:x1875571085889152:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788684434.762032:0:17158:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788684434.762059:0:17158:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d677711d600/0x44bac02bd54ad4e8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x44bac02bd54ad4e1 expref: 24 pid: 17165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684434.762082:0:17158:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788684434.762134:0:17158:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d677fb44700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c986901f-6089-4802-a23d-1179db951431+23:3624:x1875571085889152:12345-0@lo:103:ldlm_bl.0 Request processed in 124us (780us total) trans 0 rc 0/0 00000100:00100000:0.0:1788684434.762141:0:17158:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1788684434.762205:0:3624:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d677fb44a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c986901f-6089-4802-a23d-1179db951431:3624:1875571085889152:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788684434.762811:0:3622:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d677fab5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3622:1875571085889024:0@lo:39:umount.0 00000100:00100000:3.0:1788684434.762875:0:3622:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788684434.769597:0:17173:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085889024 00000100:00100000:1.0:1788684434.769624:0:17173:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085889024 00000100:00100000:1.0:1788684434.769729:0:17173:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1788684434.769745:0:17173:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6780030380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3622:x1875571085889024:12345-0@lo:39:umount.0 00000020:00000080:1.0:1788684434.769793:0:17173:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x44bac02bd54ad512 00000100:00080000:1.0:1788684434.769810:0:17173:0:(import.c:65:import_set_state_nolock()) ffff8d6775ee2800 : changing import state from FULL to CLOSED 00000100:00100000:1.0:1788684434.769981:0:17173:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6780030380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+1:3622:x1875571085889024:12345-0@lo:39:umount.0 Request processed in 231us (7096us total) trans 0 rc 0/0 00000100:00100000:1.0:1788684434.769989:0:17173:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000020:00000080:1.0:1788684434.770001:0:17173:0:(genops.c:885:class_export_put()) final put ffff8d6775ee5000/lustre-MDT0000-lwp-MDT0000_UUID 00000100:00080000:0.0:1788684434.770008:0:3622:0:(import.c:65:import_set_state_nolock()) ffff8d67749d9000 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:0.0:1788684434.770021:0:3622:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d677fab5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3622:1875571085889024:0@lo:39:umount.0 00000020:00000080:1.0:1788684434.770032:0:14645:0:(genops.c:844:class_export_destroy()) destroying export ffff8d6775ee5000/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000 00000100:00080000:0.0:1788684434.770071:0:20742:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1788684434.770075:0:20742:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 4 00000100:00100000:0.0:1788684434.770081:0:20742:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1788684434.770084:0:14645:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8d6775ee2800 for lustre-MDT0000 00010000:00010000:2.0:1788684434.770452:0:17159:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788684434.772623:0:20742:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.144@tcp lock: ffff8d6647891000/0x44bac02bd54ad432 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x44bac02bd54ad439 expref: -99 pid: 17150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684434.772647:0:20742:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.144@tcp lock: ffff8d6647891000/0x44bac02bd54ad432 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x44bac02bd54ad439 expref: -99 pid: 17150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684434.772655:0:20742:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.144@tcp lock: ffff8d6647891000/0x44bac02bd54ad432 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000400000000 nid: local remote: 0x44bac02bd54ad439 expref: -99 pid: 17150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684434.772662:0:20742:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.144@tcp lock: ffff8d6647891000/0x44bac02bd54ad432 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000400000000 nid: local remote: 0x44bac02bd54ad439 expref: -99 pid: 17150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684434.772704:0:20742:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788684434.772713:0:20742:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.144@tcp lock: ffff8d66479a1600/0x44bac02bd54ad7ea lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x44bac02bd54ad7f1 expref: -99 pid: 17168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684434.772720:0:20742:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.144@tcp lock: ffff8d66479a1600/0x44bac02bd54ad7ea lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x44bac02bd54ad7f1 expref: -99 pid: 17168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684434.772727:0:20742:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.144@tcp lock: ffff8d66479a1600/0x44bac02bd54ad7ea lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x44bac02bd54ad7f1 expref: -99 pid: 17168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684434.772733:0:20742:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.144@tcp lock: ffff8d66479a1600/0x44bac02bd54ad7ea lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x44bac02bd54ad7f1 expref: -99 pid: 17168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684434.772850:0:20742:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1788684434.772861:0:20742:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.144@tcp lock: ffff8d66476d5200/0x44bac02bd54ad9e9 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x44bac02bd54ad9f0 expref: -99 pid: 17168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684434.772869:0:20742:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.144@tcp lock: ffff8d66476d5200/0x44bac02bd54ad9e9 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x44bac02bd54ad9f0 expref: -99 pid: 17168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684434.772876:0:20742:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.144@tcp lock: ffff8d66476d5200/0x44bac02bd54ad9e9 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x44bac02bd54ad9f0 expref: -99 pid: 17168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684434.772882:0:20742:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.144@tcp lock: ffff8d66476d5200/0x44bac02bd54ad9e9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x44bac02bd54ad9f0 expref: -99 pid: 17168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684434.772976:0:17159:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1788684434.772988:0:17159:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.144@tcp lock: ffff8d6647891000/0x44bac02bd54ad432 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000400000000 nid: local remote: 0x44bac02bd54ad439 expref: -99 pid: 17150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684434.772995:0:17159:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d6647891000 already unused, calling callback (ffffffffc1297c20) 10000000:00010000:1.0:1788684434.773000:0:17159:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.144@tcp lock: ffff8d6647891000/0x44bac02bd54ad432 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000400000000 nid: local remote: 0x44bac02bd54ad439 expref: -99 pid: 17150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684434.773017:0:17159:0:(ldlm_request.c:1390:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.144@tcp lock: ffff8d6647891000/0x44bac02bd54ad432 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1008400000000 nid: local remote: 0x44bac02bd54ad439 expref: -99 pid: 17150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788684434.773025:0:17159:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.144@tcp lock: ffff8d6647891000/0x44bac02bd54ad432 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1009400000000 nid: local remote: 0x44bac02bd54ad439 expref: -99 pid: 17150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788684434.773031:0:17159:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1788684434.773034:0:17159:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-MDT0000: stopping, won't requeue 00010000:00010000:1.0:1788684434.773083:0:17159:0:(ldlm_request.c:1438:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.144@tcp lock: ffff8d6647891000/0x44bac02bd54ad432 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0x44bac02bd54ad439 expref: -99 pid: 17150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684434.773091:0:17159:0:(ldlm_request.c:1497:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788684434.773792:0:20742:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1788684434.773806:0:20742:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.144@tcp lock: ffff8d6647891200/0x44bac02bd54ad424 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x44bac02bd54ad42b expref: -99 pid: 17150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684434.773828:0:20742:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.144@tcp lock: ffff8d6647891200/0x44bac02bd54ad424 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x44bac02bd54ad42b expref: -99 pid: 17150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684434.773835:0:20742:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.144@tcp lock: ffff8d6647891200/0x44bac02bd54ad424 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x44bac02bd54ad42b expref: -99 pid: 17150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684434.773841:0:20742:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.144@tcp lock: ffff8d6647891200/0x44bac02bd54ad424 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x44bac02bd54ad42b expref: -99 pid: 17150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684434.773849:0:20742:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 10000000:01000000:0.0:1788684434.773853:0:20742:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-MDT0000 10000000:01000000:0.0:1788684434.773861:0:20742:0:(mgc_request.c:547:config_log_end()) end config log lustre-MDT0000 (0) 00000020:01000004:0.0:1788684434.774050:0:20742:0:(tgt_mount.c:2115:server_put_super()) stopping lustre-MDT0000 00000020:01000000:0.0:1788684434.774055:0:20742:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000 (flags='F') 00000020:00000080:0.0:1788684434.774061:0:20742:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788684434.774068:0:20742:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000: forcing exports to disconnect: 4/13 00000020:00080000:0.0:1788684434.774077:0:20742:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff8d66459ac000 lustre-MDT0000-lwp-OST0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1788684434.774084:0:20742:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff8d6646cc2800 lustre-MDT0000-lwp-OST0000_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1788684434.774088:0:20742:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff8d677cc6b000 lustre-MDT0000-lwp-MDT0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1788684434.774092:0:20742:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff8d6647915000 lustre-MDT0001-mdtlov_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1788684434.774101:0:20742:0:(genops.c:1819:print_export_data()) lustre-MDT0000: UNLINKED ffff8d6746da9800 55cddeac-d533-48cb-9ea5-95cbce9430eb 192.168.206.44@tcp 2 (0 2 0) 1 0 0 0: 0000000000000000 8589934599 stale:0 00000020:00080000:0.0:1788684434.774106:0:20742:0:(genops.c:1819:print_export_data()) lustre-MDT0000: UNLINKED ffff8d677cb8c800 c4cf9959-ce83-48ba-884e-11c1ebaf899c 192.168.206.44@tcp 5 (0 5 0) 1 0 0 0: 0000000000000000 8589934623 stale:0 00000020:00080000:0.0:1788684434.774112:0:20742:0:(genops.c:1553:class_disconnect_exports()) OBD device 5 (ffff8d66465e19c0) has exports, disconnecting them 00000020:00080000:0.0:1788684434.774117:0:20742:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff8d66459ac000), last request at 1788684432 00000020:00000080:0.0:1788684434.774125:0:20742:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x44bac02bd54ad749 00000100:00080000:0.0:1788684434.774158:0:20742:0:(import.c:65:import_set_state_nolock()) ffff8d66459aa000 : changing import state from FULL to CLOSED 00010000:00010000:1.0:1788684434.774242:0:17159:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.144@tcp lock: ffff8d6647891000/0x44bac02bd54ad432 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0x44bac02bd54ad439 expref: -99 pid: 17150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684434.774251:0:17159:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.144@tcp lock: ffff8d6647891000/0x44bac02bd54ad432 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0x44bac02bd54ad439 expref: -99 pid: 17150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684434.774269:0:17159:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1788684434.774274:0:17159:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.144@tcp lock: ffff8d66479a1600/0x44bac02bd54ad7ea lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x44bac02bd54ad7f1 expref: -99 pid: 17168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684434.774280:0:17159:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d66479a1600 already unused, calling callback (ffffffffc1297c20) 10000000:00010000:1.0:1788684434.774283:0:17159:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.144@tcp lock: ffff8d66479a1600/0x44bac02bd54ad7ea lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x44bac02bd54ad7f1 expref: -99 pid: 17168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684434.774290:0:17159:0:(ldlm_request.c:1390:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.144@tcp lock: ffff8d66479a1600/0x44bac02bd54ad7ea lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x44bac02bd54ad7f1 expref: -99 pid: 17168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788684434.774297:0:17159:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.144@tcp lock: ffff8d66479a1600/0x44bac02bd54ad7ea lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x44bac02bd54ad7f1 expref: -99 pid: 17168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788684434.774309:0:17159:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 10000000:01000000:1.0:1788684434.774311:0:17159:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-mdtir: stopping, won't requeue 10000000:01000000:1.0:1788684434.774313:0:17159:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-mdtir 00010000:00010000:1.0:1788684434.774361:0:17159:0:(ldlm_request.c:1438:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.144@tcp lock: ffff8d66479a1600/0x44bac02bd54ad7ea lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x44bac02bd54ad7f1 expref: -99 pid: 17168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788684434.774469:0:3624:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d677fab4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c986901f-6089-4802-a23d-1179db951431:3624:1875571085889280:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788684434.774484:0:17159:0:(ldlm_request.c:1497:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788684434.774511:0:17159:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.144@tcp lock: ffff8d66479a1600/0x44bac02bd54ad7ea lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x44bac02bd54ad7f1 expref: -99 pid: 17168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684434.774517:0:17159:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.144@tcp lock: ffff8d66479a1600/0x44bac02bd54ad7ea lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x44bac02bd54ad7f1 expref: -99 pid: 17168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684434.774527:0:17159:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788684434.774530:0:17159:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.144@tcp lock: ffff8d66476d5200/0x44bac02bd54ad9e9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x44bac02bd54ad9f0 expref: -99 pid: 17168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684434.774535:0:17159:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d66476d5200 already unused, calling callback (ffffffffc1297c20) 10000000:00010000:1.0:1788684434.774537:0:17159:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.144@tcp lock: ffff8d66476d5200/0x44bac02bd54ad9e9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x44bac02bd54ad9f0 expref: -99 pid: 17168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684434.774543:0:17159:0:(ldlm_request.c:1390:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.144@tcp lock: ffff8d66476d5200/0x44bac02bd54ad9e9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0x44bac02bd54ad9f0 expref: -99 pid: 17168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788684434.774550:0:17159:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.144@tcp lock: ffff8d66476d5200/0x44bac02bd54ad9e9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0x44bac02bd54ad9f0 expref: -99 pid: 17168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788684434.774554:0:17159:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:1.0:1788684434.774557:0:17159:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:1.0:1788684434.774564:0:17159:0:(mgc_request.c:130:config_log_put()) dropping config log params 00000100:00100000:3.0:1788684434.774567:0:3624:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788684434.774589:0:17159:0:(ldlm_request.c:1438:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.144@tcp lock: ffff8d66476d5200/0x44bac02bd54ad9e9 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x44bac02bd54ad9f0 expref: -99 pid: 17168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684434.774595:0:17159:0:(ldlm_request.c:1497:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788684434.774602:0:17159:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.144@tcp lock: ffff8d66476d5200/0x44bac02bd54ad9e9 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x44bac02bd54ad9f0 expref: -99 pid: 17168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684434.774607:0:17159:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.144@tcp lock: ffff8d66476d5200/0x44bac02bd54ad9e9 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x44bac02bd54ad9f0 expref: -99 pid: 17168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684434.774617:0:17159:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788684434.774620:0:17159:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.144@tcp lock: ffff8d6647891200/0x44bac02bd54ad424 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x44bac02bd54ad42b expref: -99 pid: 17150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684434.774625:0:17159:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d6647891200 already unused, calling callback (ffffffffc1297c20) 10000000:00010000:1.0:1788684434.774627:0:17159:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.144@tcp lock: ffff8d6647891200/0x44bac02bd54ad424 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x44bac02bd54ad42b expref: -99 pid: 17150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684434.774634:0:17159:0:(ldlm_request.c:1390:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.144@tcp lock: ffff8d6647891200/0x44bac02bd54ad424 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x44bac02bd54ad42b expref: -99 pid: 17150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788684434.774639:0:17159:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.144@tcp lock: ffff8d6647891200/0x44bac02bd54ad424 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x44bac02bd54ad42b expref: -99 pid: 17150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788684434.774644:0:17159:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 10000000:01000000:1.0:1788684434.774646:0:17159:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-barrier: stopping, won't requeue 10000000:01000000:1.0:1788684434.774648:0:17159:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-barrier 00000100:00100000:3.0:1788684434.774662:0:17157:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085889280 00010000:00010000:1.0:1788684434.774663:0:17159:0:(ldlm_request.c:1438:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.144@tcp lock: ffff8d6647891200/0x44bac02bd54ad424 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x44bac02bd54ad42b expref: -99 pid: 17150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684434.774668:0:17159:0:(ldlm_request.c:1497:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:3.0:1788684434.774672:0:17157:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085889280 00010000:00010000:1.0:1788684434.774684:0:17159:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.144@tcp lock: ffff8d6647891200/0x44bac02bd54ad424 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x44bac02bd54ad42b expref: -99 pid: 17150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684434.774690:0:17159:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.144@tcp lock: ffff8d6647891200/0x44bac02bd54ad424 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x44bac02bd54ad42b expref: -99 pid: 17150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684434.774699:0:17159:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788684434.774700:0:17159:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788684434.774703:0:17159:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788684434.774714:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d677fab5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c986901f-6089-4802-a23d-1179db951431:3623:1875571085889664:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788684434.774733:0:17157:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1788684434.774742:0:17157:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6780033100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c986901f-6089-4802-a23d-1179db951431+23:3624:x1875571085889280:12345-0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788684434.774747:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788684434.774760:0:17157:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788684434.774779:0:17157:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d677711c000/0x44bac02bd54ad439 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x44bac02bd54ad432 expref: 23 pid: 17164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788684434.774779:0:3625:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d677fab4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c986901f-6089-4802-a23d-1179db951431:3625:1875571085889408:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788684434.774796:0:17157:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788684434.774802:0:3625:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788684434.774820:0:3625:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788684434.774825:0:3625:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d677fab4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c986901f-6089-4802-a23d-1179db951431:3625:1875571085889536:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788684434.774828:0:17157:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6780033100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c986901f-6089-4802-a23d-1179db951431+22:3624:x1875571085889280:12345-0@lo:103:ldlm_bl.0 Request processed in 87us (261us total) trans 0 rc 0/0 00000100:00100000:3.0:1788684434.774836:0:17157:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1788684434.774844:0:3625:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788684434.774851:0:17157:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085889664 00000100:00100000:3.0:1788684434.774854:0:17157:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085889664 00000100:00100000:1.0:1788684434.774865:0:20196:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085889408 00000100:00100000:3.0:1788684434.774867:0:17157:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085889536 00000100:00100000:1.0:1788684434.774868:0:20196:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085889408 00000100:00100000:3.0:1788684434.774869:0:17157:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085889536 00000100:00100000:3.0:1788684434.774882:0:17157:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1788684434.774887:0:17157:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67771e2c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c986901f-6089-4802-a23d-1179db951431+24:3623:x1875571085889664:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788684434.774895:0:17157:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788684434.774905:0:17157:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d677711de00/0x44bac02bd54ad42b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x44bac02bd54ad424 expref: 24 pid: 17163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684434.774928:0:17157:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788684434.774962:0:17157:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67771e2c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c986901f-6089-4802-a23d-1179db951431+23:3623:x1875571085889664:12345-0@lo:103:ldlm_bl.0 Request processed in 75us (214us total) trans 0 rc 0/0 00000100:00100000:3.0:1788684434.774969:0:17157:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1788684434.775089:0:17157:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1788684434.775095:0:17157:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d677fab6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c986901f-6089-4802-a23d-1179db951431+22:3625:x1875571085889536:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788684434.775102:0:17157:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788684434.775112:0:17157:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d6746d3ec00/0x44bac02bd54ad9f0 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x44bac02bd54ad9e9 expref: 22 pid: 17163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684434.775120:0:17157:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788684434.775147:0:17157:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d677fab6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c986901f-6089-4802-a23d-1179db951431+21:3625:x1875571085889536:12345-0@lo:103:ldlm_bl.0 Request processed in 52us (301us total) trans 0 rc 0/0 00000100:00100000:3.0:1788684434.775153:0:17157:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1788684434.775183:0:20196:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1788684434.775191:0:20196:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d677fab5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c986901f-6089-4802-a23d-1179db951431+20:3625:x1875571085889408:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788684434.775199:0:20196:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788684434.775209:0:20196:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d66479a1800/0x44bac02bd54ad7f1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x44bac02bd54ad7ea expref: 20 pid: 17165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684434.775307:0:17160:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788684434.775350:0:20196:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000020:00080000:0.0:1788684434.775443:0:20742:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff8d66459ac000): rc 0 00000020:00000080:0.0:1788684434.775447:0:20742:0:(genops.c:885:class_export_put()) final put ffff8d66459ac000/lustre-MDT0000-lwp-OST0001_UUID 00000020:00080000:0.0:1788684434.775466:0:20742:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff8d6646cc2800), last request at 1788684432 00000020:00000080:0.0:1788684434.775473:0:20742:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x44bac02bd54ad6af 00000100:00080000:0.0:1788684434.775481:0:20742:0:(import.c:65:import_set_state_nolock()) ffff8d6646cc1000 : changing import state from FULL to CLOSED 00000020:00000080:2.0:1788684434.775487:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff8d66459ac000/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000 00000020:00080000:0.0:1788684434.775497:0:20742:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff8d6646cc2800): rc 0 00000020:00000080:0.0:1788684434.775499:0:20742:0:(genops.c:885:class_export_put()) final put ffff8d6646cc2800/lustre-MDT0000-lwp-OST0000_UUID 00000020:00080000:0.0:1788684434.775505:0:20742:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff8d677cc6b000), last request at 1788684358 00000020:00000080:0.0:1788684434.775508:0:20742:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x44bac02bd54ad600 00000100:00080000:0.0:1788684434.775511:0:20742:0:(import.c:65:import_set_state_nolock()) ffff8d677cc6b800 : changing import state from FULL to CLOSED 00000020:00080000:0.0:1788684434.775520:0:20742:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff8d677cc6b000): rc 0 00000020:00000080:0.0:1788684434.775521:0:20742:0:(genops.c:885:class_export_put()) final put ffff8d677cc6b000/lustre-MDT0000-lwp-MDT0001_UUID 00000020:00080000:0.0:1788684434.775526:0:20742:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff8d6647915000), last request at 1788684358 00000020:00000080:0.0:1788684434.775529:0:20742:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x44bac02bd54ad5a5 00000100:00080000:0.0:1788684434.775532:0:20742:0:(import.c:65:import_set_state_nolock()) ffff8d6775fa0800 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1788684434.775540:0:20742:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934628 00000020:00000080:2.0:1788684434.775547:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8d66459aa000 for lustre-MDT0000 00000020:00000080:2.0:1788684434.775552:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff8d6646cc2800/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000 00000020:00000080:2.0:1788684434.775571:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff8d677cc6b000/lustre-MDT0000-lwp-MDT0001_UUID for lustre-MDT0000 00000020:00000080:2.0:1788684434.775603:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8d6646cc1000 for lustre-MDT0000 00000020:00000080:2.0:1788684434.775607:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8d677cc6b800 for lustre-MDT0000 00010000:00010000:2.0:1788684434.775614:0:17160:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:0.0:1788684434.775645:0:20742:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff8d6647915000): rc 0 00000004:00000080:0.0:1788684434.775652:0:20742:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=400866e7 len=0 karg=ffffb81ec56f7ae0 00000100:00080000:0.0:1788684434.775676:0:20742:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:0.0:1788684434.775679:0:20742:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 3 00000100:00080000:0.0:1788684434.776774:0:20742:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID 00000100:00080000:0.0:1788684434.776806:0:20742:0:(import.c:65:import_set_state_nolock()) ffff8d677487b000 lustre-MDT0001_UUID: changing import state from FULL to CONNECTING 00000100:00100000:0.0:1788684434.776859:0:3622:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d677fb44a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3622:1875571085889792:0@lo:39:umount.0 00000100:00100000:0.0:1788684434.777116:0:3622:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788684434.778050:0:3625:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d677fab4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c986901f-6089-4802-a23d-1179db951431:3625:1875571085889536:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788684434.778099:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d677fab5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:c986901f-6089-4802-a23d-1179db951431:3623:1875571085889664:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788684434.778150:0:3624:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d677fab4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c986901f-6089-4802-a23d-1179db951431:3624:1875571085889280:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788684434.778182:0:17159:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1788684434.778673:0:20742:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:2.0:1788684434.778679:0:20742:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934594 gen 3 00000004:00080000:2.0:1788684434.778701:0:20742:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:2.0:1788684434.778764:0:20742:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000100:00080000:2.0:1788684434.778793:0:20742:0:(import.c:65:import_set_state_nolock()) ffff8d677cf21800 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 00000100:00080000:2.0:1788684434.778806:0:20742:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:2.0:1788684434.778809:0:20742:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934598 gen 3 00000004:00080000:2.0:1788684434.778817:0:20742:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:2.0:1788684434.778888:0:20742:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000100:00080000:2.0:1788684434.778898:0:20742:0:(import.c:65:import_set_state_nolock()) ffff8d677cf25000 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00000020:00080000:2.0:1788684434.778948:0:20742:0:(genops.c:1558:class_disconnect_exports()) OBD device 5 (ffff8d66465e19c0) has no exports 00000100:00100000:0.0:1788684434.779404:0:3622:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d664790b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3622:1875571085889920:0@lo:9:umount.0 00000100:00100000:0.0:1788684434.779479:0:3622:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788684434.779507:0:3622:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6647908700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3622:1875571085890048:0@lo:9:umount.0 00000100:00100000:0.0:1788684434.779530:0:3622:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788684434.779570:0:18679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085889920 00000100:00100000:0.0:1788684434.779588:0:18679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085889920 00000100:00100000:0.0:1788684434.779649:0:18679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085890048 00000100:00100000:0.0:1788684434.779652:0:18679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085890048 00000100:00100000:0.0:1788684434.779677:0:18679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1788684434.779686:0:18679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d677fb47b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3622:x1875571085889920:12345-0@lo:9:umount.0 00000020:00000080:0.0:1788684434.779715:0:18679:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x44bac02bd54ad76c 00000100:00080000:0.0:1788684434.779725:0:18679:0:(import.c:65:import_set_state_nolock()) ffff8d664658f800 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1788684434.779773:0:18679:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 8589934594 00000100:00100000:0.0:1788684434.779947:0:18679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d677fb47b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+2:3622:x1875571085889920:12345-0@lo:9:umount.0 Request processed in 262us (468us total) trans 0 rc 0/0 00000100:00100000:0.0:1788684434.779956:0:18679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1788684434.780505:0:18679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1788684434.780519:0:18679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d677fb45880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3622:x1875571085890048:12345-0@lo:9:umount.0 00000020:00000080:0.0:1788684434.780536:0:18679:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x44bac02bd54ad773 00000100:00080000:0.0:1788684434.780543:0:18679:0:(import.c:65:import_set_state_nolock()) ffff8d664658b800 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1788684434.780573:0:18679:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 8589934600 00000100:00100000:0.0:1788684434.780687:0:18679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d677fb45880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+2:3622:x1875571085890048:12345-0@lo:9:umount.0 Request processed in 171us (1155us total) trans 0 rc 0/0 00000100:00100000:3.0:1788684434.780748:0:17176:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085889792 00000100:00100000:3.0:1788684434.780754:0:17176:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085889792 00000100:00100000:3.0:1788684434.780791:0:17176:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1788684434.780798:0:17176:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d677fb45c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3622:x1875571085889792:12345-0@lo:39:umount.0 00000020:00000080:3.0:1788684434.780818:0:17176:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x44bac02bd54ad62a 00000100:00080000:3.0:1788684434.780823:0:17176:0:(import.c:65:import_set_state_nolock()) ffff8d678003b800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1788684434.780837:0:17176:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 2, last_transno is 8589934594 00000100:00100000:3.0:1788684434.780938:0:17176:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d677fb45c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+3:3622:x1875571085889792:12345-0@lo:39:umount.0 Request processed in 140us (3822us total) trans 8589934595 rc 0/0 00000100:00100000:3.0:1788684434.780945:0:17176:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1788684434.781144:0:20196:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d677fab5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c986901f-6089-4802-a23d-1179db951431+19:3625:x1875571085889408:12345-0@lo:103:ldlm_bl.0 Request processed in 5951us (6337us total) trans 0 rc 0/0 00000100:00100000:1.0:1788684434.781165:0:20196:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00080000:1.0:1788684434.781224:0:17166:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788684434.781229:0:17166:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1788684434.781490:0:17160:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788684434.781528:0:3625:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d677fab4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c986901f-6089-4802-a23d-1179db951431:3625:1875571085889408:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788684434.781903:0:18679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00080000:0.0:1788684434.781967:0:3622:0:(import.c:65:import_set_state_nolock()) ffff8d677cf21800 lustre-OST0000_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:0.0:1788684434.782084:0:3622:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00010000:00010000:3.0:1788684434.782496:0:17159:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:0.0:1788684434.782588:0:3622:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1788684434.782596:0:3622:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d664790b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3622:1875571085889920:0@lo:9:umount.0 00000100:00080000:0.0:1788684434.782621:0:3622:0:(import.c:65:import_set_state_nolock()) ffff8d677cf25000 lustre-OST0001_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:0.0:1788684434.782640:0:3622:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:0.0:1788684434.782642:0:3622:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1788684434.782645:0:3622:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6647908700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3622:1875571085890048:0@lo:9:umount.0 00000100:00080000:0.0:1788684434.782664:0:3622:0:(import.c:65:import_set_state_nolock()) ffff8d677487b000 lustre-MDT0001_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:0.0:1788684434.782670:0:3622:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d677fb44a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3622:1875571085889792:0@lo:39:umount.0 00000020:00080000:2.0:1788684434.789883:0:20742:0:(genops.c:1558:class_disconnect_exports()) OBD device 5 (ffff8d66465e19c0) has no exports 00000020:00000080:2.0:1788684434.882811:0:20742:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x44bac02bd54ad47f 00000020:00000080:2.0:1788684434.882827:0:20742:0:(genops.c:885:class_export_put()) final put ffff8d677487a800/lustre-QMT0000_UUID 00000020:01000000:2.0:1788684434.882847:0:20742:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-QMT0000 (flags='') 00000020:00000080:0.0:1788684434.883429:0:14645:0:(genops.c:844:class_export_destroy()) destroying export ffff8d677487a800/lustre-QMT0000_UUID for lustre-QMT0000 00000020:00000080:1.0:1788684434.883459:0:20742:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788684434.883475:0:20742:0:(obd_config.c:956:class_cleanup()) lustre-QMT0000: forcing exports to disconnect: 0/1 00000020:00080000:1.0:1788684434.883483:0:20742:0:(genops.c:1558:class_disconnect_exports()) OBD device 7 (ffff8d66465e4d40) has no exports 00000020:00000080:0.0:1788684434.883895:0:20742:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x44bac02bd54ad478 00000020:00000080:0.0:1788684434.883903:0:20742:0:(genops.c:885:class_export_put()) final put ffff8d67488e8000/lustre-MDT0000-osd_UUID 00000020:00000080:0.0:1788684434.883958:0:20742:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788684434.883966:0:20742:0:(obd_config.c:883:class_detach()) detach on obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:0.0:1788684434.883968:0:20742:0:(genops.c:885:class_export_put()) final put ffff8d67488e3000/lustre-QMT0000_UUID 00000020:00000080:0.0:1788684434.883972:0:20742:0:(genops.c:844:class_export_destroy()) destroying export ffff8d67488e3000/lustre-QMT0000_UUID for lustre-QMT0000 00000020:01000000:0.0:1788684434.883978:0:20742:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-QMT0000 (lustre-QMT0000_UUID) 00000020:00000080:1.0:1788684434.884175:0:14645:0:(genops.c:844:class_export_destroy()) destroying export ffff8d67488e8000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000100:00100000:0.0:1788684435.070229:0:3623:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788684435.070247:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d677fb46680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3623:1875571085890176:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788684435.070308:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788684435.070424:0:17177:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085890176 00000100:00100000:0.0:1788684435.070430:0:17177:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085890176 00000100:00100000:0.0:1788684435.070464:0:17177:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1788684435.070470:0:17177:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d677fb44700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3623:x1875571085890176:12345-0@lo:41:osp-pre-0-1.0 00000020:00080000:0.0:1788684435.070478:0:17177:0:(tgt_handler.c:807:tgt_request_handle()) operation 41 on unconnected OST from 12345-0@lo 00000100:00100000:0.0:1788684435.070516:0:17177:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d677fb44700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3623:x1875571085890176:12345-0@lo:41:osp-pre-0-1.0 Request processed in 44us (207us total) trans 0 rc -107/-107 00000100:00100000:0.0:1788684435.070539:0:17177:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:02020000:0.0:1788684435.070585:0:3623:0:(client.c:1505:ptlrpc_check_status()) lustre-MDT0000-osp-MDT0001: operation mds_statfs to node 0@lo failed: rc = -107 00000100:00100000:2.0:1788684435.071827:0:3625:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d677fb44380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3625:1875571085890304:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788684435.071879:0:3625:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788684435.071948:0:18681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085890304 00000100:00100000:2.0:1788684435.071954:0:18681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085890304 00000100:00100000:2.0:1788684435.072015:0:18681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1788684435.072023:0:18681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6647909f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3625:x1875571085890304:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1788684435.072053:0:18681:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923513344 avail 3691991040 00000100:00100000:2.0:1788684435.072094:0:18681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6647909f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3625:x1875571085890304:12345-0@lo:13:osp-pre-0-1.0 Request processed in 72us (214us total) trans 0 rc 0/0 00000100:00100000:2.0:1788684435.072100:0:18681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1788684435.072139:0:3625:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d677fb44380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3625:1875571085890304:0@lo:13:osp-pre-0-1.0 00000100:00080000:1.0:1788684435.074409:0:17166:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788684435.086974:0:3623:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-osp-MDT0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:0.0:1788684435.086985:0:3623:0:(import.c:65:import_set_state_nolock()) ffff8d677cc88800 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:0.0:1788684435.086991:0:3623:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:0.0:1788684435.103602:0:3623:0:(import.c:65:import_set_state_nolock()) ffff8d677cc88800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788684435.103623:0:3623:0:(import.c:545:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 439 00000100:00080000:0.0:1788684435.103638:0:3623:0:(import.c:665:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8d677cc88800 using connection 192.168.206.144@tcp/0@lo 00000100:00100000:0.0:1788684435.104015:0:3623:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8d677fb46a00 x1875571085890432/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788684435.104148:0:3622:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d677fb46a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3622:1875571085890432:0@lo:38:ptlrpcd_00_00.0 00000100:00100000:1.0:1788684435.104267:0:3622:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788684435.104408:0:17912:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085890432 00000100:00100000:3.0:1788684435.104419:0:17912:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085890432 00000100:00100000:3.0:1788684435.104482:0:17912:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1788684435.104491:0:17912:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d677fab7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:3622:x1875571085890432:12345-0@lo:38:ptlrpcd_00_00.0 00010000:02000000:3.0:1788684435.104512:0:17912:0:(ldlm_lib.c:1203:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:3.0:1788684435.108844:0:17912:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d677fab7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:3622:x1875571085890432:12345-0@lo:38:ptlrpcd_00_00.0 Request processed in 4338us (4562us total) trans 0 rc -19/-19 00000100:00100000:3.0:1788684435.108863:0:17912:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00080000:1.0:1788684435.109078:0:3622:0:(import.c:65:import_set_state_nolock()) ffff8d677cc88800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788684435.109085:0:3622:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1788684435.109092:0:3622:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d677fb46a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3622:1875571085890432:0@lo:38:ptlrpcd_00_00.0 00010000:00010000:1.0:1788684435.197743:0:17160:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1788684436.100190:0:19491:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1788684436.100198:0:19491:0:(genops.c:885:class_export_put()) final put ffff8d6646589800/lustre-MDT0000-mdtlov_UUID 00000001:00100000:2.0:1788684436.100231:0:19491:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of c4cf9959-ce83-48ba-884e-11c1ebaf899c 00000020:00000080:2.0:1788684436.100233:0:19491:0:(genops.c:885:class_export_put()) final put ffff8d6646588000/c4cf9959-ce83-48ba-884e-11c1ebaf899c 00000020:00000080:1.0:1788684436.100303:0:14645:0:(genops.c:844:class_export_destroy()) destroying export ffff8d6646589800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001 00000020:00000080:1.0:1788684436.100354:0:14645:0:(genops.c:844:class_export_destroy()) destroying export ffff8d6646588000/c4cf9959-ce83-48ba-884e-11c1ebaf899c for lustre-OST0001 00000020:00000080:1.0:1788684436.100401:0:14645:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8d664658b800 for lustre-OST0001 00000020:00000080:1.0:1788684436.100406:0:14645:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8d664658d000 for lustre-OST0001 00000001:00100000:2.0:1788684436.100836:0:17151:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000020:00000080:2.0:1788684436.100840:0:17151:0:(genops.c:885:class_export_put()) final put ffff8d6647915000/lustre-MDT0001-mdtlov_UUID 00000001:00100000:2.0:1788684436.100861:0:17151:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 55cddeac-d533-48cb-9ea5-95cbce9430eb 00000001:00080000:2.0:1788684436.100869:0:17151:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934628 is committed 00000020:00000080:2.0:1788684436.100873:0:17151:0:(genops.c:885:class_export_put()) final put ffff8d6746da9800/55cddeac-d533-48cb-9ea5-95cbce9430eb 00000001:00100000:2.0:1788684436.100892:0:17151:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of c4cf9959-ce83-48ba-884e-11c1ebaf899c 00000001:00080000:2.0:1788684436.100896:0:17151:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934627 is committed 00000020:00000080:2.0:1788684436.100902:0:17151:0:(genops.c:885:class_export_put()) final put ffff8d677cb8c800/c4cf9959-ce83-48ba-884e-11c1ebaf899c 00000020:00000080:1.0:1788684436.100951:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff8d6647915000/lustre-MDT0001-mdtlov_UUID for lustre-MDT0000 00000020:00000080:1.0:1788684436.100994:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff8d6746da9800/55cddeac-d533-48cb-9ea5-95cbce9430eb for lustre-MDT0000 00000020:00000080:1.0:1788684436.101019:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff8d677cb8c800/c4cf9959-ce83-48ba-884e-11c1ebaf899c for lustre-MDT0000 00000020:00000080:1.0:1788684436.101037:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8d6775fa0800 for lustre-MDT0000 00000020:00000080:1.0:1788684436.101042:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8d6746dad800 for lustre-MDT0000 00000020:00000080:1.0:1788684436.101045:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8d677cb89800 for lustre-MDT0000 00000001:00100000:0.0:1788684436.105650:0:17903:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00080000:0.0:1788684436.105666:0:17903:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 8589934595 is committed 00000020:00000080:0.0:1788684436.105671:0:17903:0:(genops.c:885:class_export_put()) final put ffff8d67466d1000/lustre-MDT0000-mdtlov_UUID 00000001:00100000:0.0:1788684436.105697:0:17903:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of 55cddeac-d533-48cb-9ea5-95cbce9430eb 00000001:00080000:0.0:1788684436.105703:0:17903:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 8589934594 is committed 00000020:00000080:0.0:1788684436.105705:0:17903:0:(genops.c:885:class_export_put()) final put ffff8d677cbf8800/55cddeac-d533-48cb-9ea5-95cbce9430eb 00000001:00100000:0.0:1788684436.105710:0:17903:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of c4cf9959-ce83-48ba-884e-11c1ebaf899c 00000001:00080000:0.0:1788684436.105715:0:17903:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 8589934593 is committed 00000020:00000080:0.0:1788684436.105716:0:17903:0:(genops.c:885:class_export_put()) final put ffff8d677cb8d000/c4cf9959-ce83-48ba-884e-11c1ebaf899c 00000020:00000080:2.0:1788684436.105797:0:14645:0:(genops.c:844:class_export_destroy()) destroying export ffff8d67466d1000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001 00000020:00000080:2.0:1788684436.105858:0:14645:0:(genops.c:844:class_export_destroy()) destroying export ffff8d677cbf8800/55cddeac-d533-48cb-9ea5-95cbce9430eb for lustre-MDT0001 00000020:00000080:2.0:1788684436.105883:0:14645:0:(genops.c:844:class_export_destroy()) destroying export ffff8d677cb8d000/c4cf9959-ce83-48ba-884e-11c1ebaf899c for lustre-MDT0001 00000020:00000080:2.0:1788684436.105912:0:14645:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8d678003b800 for lustre-MDT0001 00000020:00000080:2.0:1788684436.105917:0:14645:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8d677cbfa800 for lustre-MDT0001 00000020:00000080:2.0:1788684436.105920:0:14645:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8d677cb8e800 for lustre-MDT0001 00010000:00010000:3.0:1788684436.221977:0:17159:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:2.0:1788684436.926145:0:20742:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8d6647a15ae0 - data ffff8d67675ef438/ffff8d6746f28800 00000020:01000000:2.0:1788684436.926298:0:20742:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8d66466f3660 - data ffff8d676771d948/ffff8d674696bc00 00000001:00000004:2.0:1788684436.937596:0:20742:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934628 00000100:00080000:3.0:1788684436.992230:0:20742:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:3.0:1788684436.992239:0:20742:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 4 00000100:00100000:3.0:1788684436.992251:0:20742:0:(client.c:3164:ptlrpc_free_committed()) @@@ free request with old gen req@ffff8d677fb44a80 x1875571085889792/t8589934595(8589934595) o39->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/224 e 0 to 0 dl 1788684444 ref 1 fl Complete:RNQU/204/0 rc 0/0 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788684436.992274:0:20742:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00080000:3.0:1788684436.993252:0:20742:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:3.0:1788684436.993257:0:20742:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934594 gen 4 00000004:00080000:3.0:1788684436.993270:0:20742:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1788684436.993272:0:20742:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:3.0:1788684436.995117:0:17195:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:3.0:1788684436.995125:0:17195:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xa:0x0] index 1 count 1 00000040:00080000:3.0:1788684436.995139:0:17195:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x2:0x0] index 2 count 2 00000100:00080000:1.0:1788684436.997772:0:20742:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:1.0:1788684436.997780:0:20742:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934598 gen 4 00000004:00080000:1.0:1788684436.997801:0:20742:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1788684436.997803:0:20742:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:3.0:1788684436.998176:0:17197:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:3.0:1788684436.998181:0:17197:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xc:0x0] index 2 count 1 00000040:00080000:3.0:1788684436.998191:0:17197:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x5:0x0] index 2 count 2 00000020:00000080:1.0:1788684437.009934:0:20742:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x44bac02bd54ad447 00000020:00000080:1.0:1788684437.009947:0:20742:0:(genops.c:885:class_export_put()) final put ffff8d6748319800/lustre-MDT0000-osd_UUID 00000020:00000080:3.0:1788684437.010463:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff8d6748319800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:1.0:1788684437.012953:0:20742:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x44bac02bd54ad45c 00000020:00000080:1.0:1788684437.012967:0:20742:0:(genops.c:885:class_export_put()) final put ffff8d67488e2800/lustre-MDT0000-mdtlov_UUID 00000020:01000000:1.0:1788684437.013090:0:20742:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-mdtlov (flags='') 00000020:00000080:1.0:1788684437.013097:0:20742:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788684437.013106:0:20742:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-mdtlov: forcing exports to disconnect: 0/2 00000020:00080000:1.0:1788684437.013110:0:20742:0:(genops.c:1558:class_disconnect_exports()) OBD device 4 (ffff8d66465e3380) has no exports 00000004:01000000:1.0:1788684437.013463:0:20742:0:(lod_lov.c:59:lod_putref()) destroying 2 ltd desc 00000020:00000080:1.0:1788684437.013473:0:20742:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x44bac02bd54ad4be 00000020:00000080:1.0:1788684437.013478:0:20742:0:(genops.c:885:class_export_put()) final put ffff8d67488fd800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1788684437.015338:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff8d67488e2800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:01000000:1.0:1788684437.015885:0:20742:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osc-MDT0000 (flags='') 00000020:00000080:1.0:1788684437.015896:0:20742:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788684437.015906:0:20742:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:1.0:1788684437.015910:0:20742:0:(genops.c:1558:class_disconnect_exports()) OBD device 10 (ffff8d6647430000) has no exports 00000020:00000080:3.0:1788684437.016003:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff8d67488fd800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:00000080:1.0:1788684437.016033:0:20742:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x44bac02bd54ad4b7 00000020:00000080:1.0:1788684437.016040:0:20742:0:(genops.c:885:class_export_put()) final put ffff8d677cf21000/lustre-MDT0000-osd_UUID 00000020:00000080:3.0:1788684437.016239:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff8d677cf21000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:01000000:1.0:1788684437.016707:0:20742:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0001-osc-MDT0000: client import never connected 00000100:00080000:1.0:1788684437.016712:0:20742:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:1.0:1788684437.016715:0:20742:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934598 gen 5 00000004:00080000:1.0:1788684437.016722:0:20742:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1788684437.016724:0:20742:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1788684437.016800:0:20742:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788684437.016808:0:20742:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1788684437.016815:0:20742:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x44bac02bd54ad4a9 00000020:00000080:1.0:1788684437.016820:0:20742:0:(genops.c:885:class_export_put()) final put ffff8d677cf24000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1788684437.020348:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8d677cf25000 for lustre-OST0001-osc-MDT0000 00000020:00000080:3.0:1788684437.020389:0:38:0:(genops.c:885:class_export_put()) final put ffff8d677cf24800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1788684437.020393:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff8d677cf24800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:01000000:3.0:1788684437.020402:0:38:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:01000000:1.0:1788684437.021393:0:20742:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osc-MDT0000 (flags='') 00000020:00000080:1.0:1788684437.021404:0:20742:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788684437.021414:0:20742:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:1.0:1788684437.021419:0:20742:0:(genops.c:1558:class_disconnect_exports()) OBD device 9 (ffff8d6647434d40) has no exports 00000020:00000080:1.0:1788684437.021427:0:20742:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x44bac02bd54ad4a2 00000020:00000080:1.0:1788684437.021436:0:20742:0:(genops.c:885:class_export_put()) final put ffff8d677cf25800/lustre-MDT0000-osd_UUID 00000020:00000080:0.0:1788684437.021788:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff8d677cf24000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:00000080:0.0:1788684437.021803:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff8d677cf25800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:01000000:1.0:1788684437.022528:0:20742:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0000-osc-MDT0000: client import never connected 00000100:00080000:1.0:1788684437.022685:0:20742:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:1.0:1788684437.022690:0:20742:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934594 gen 5 00000004:00080000:1.0:1788684437.022698:0:20742:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1788684437.022700:0:20742:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1788684437.022753:0:20742:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788684437.022761:0:20742:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000004:01000000:1.0:1788684437.022777:0:20742:0:(lod_lov.c:59:lod_putref()) destroying 1 ltd desc 00000020:00000080:1.0:1788684437.022785:0:20742:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x44bac02bd54ad494 00000020:00000080:1.0:1788684437.022793:0:20742:0:(genops.c:885:class_export_put()) final put ffff8d677487c800/lustre-MDT0000-mdtlov_UUID 00000020:01000000:1.0:1788684437.022799:0:20742:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-osp-MDT0000 (flags='') 00000020:00000080:1.0:1788684437.022804:0:20742:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788684437.022808:0:20742:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-osp-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:1.0:1788684437.022811:0:20742:0:(genops.c:1558:class_disconnect_exports()) OBD device 8 (ffff8d677e3e99c0) has no exports 00000020:00000080:1.0:1788684437.022816:0:20742:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x44bac02bd54ad48d 00000020:00000080:1.0:1788684437.022820:0:20742:0:(genops.c:885:class_export_put()) final put ffff8d677487f000/lustre-MDT0000-osd_UUID 00000020:00000080:0.0:1788684437.022879:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8d677cf21800 for lustre-OST0000-osc-MDT0000 00000020:00000080:0.0:1788684437.022888:0:38:0:(genops.c:885:class_export_put()) final put ffff8d6774878000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1788684437.022890:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff8d6774878000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:01000000:0.0:1788684437.022896:0:38:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1788684437.022987:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff8d677487c800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001-osp-MDT0000 00000020:00000080:0.0:1788684437.022994:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff8d677487f000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:01000000:0.0:1788684437.026441:0:20742:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0001-osp-MDT0000: client import never connected 00000100:00080000:0.0:1788684437.026449:0:20742:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:0.0:1788684437.026454:0:20742:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 5 00000100:00100000:0.0:1788684437.026461:0:20742:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1788684437.026517:0:20742:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788684437.026528:0:20742:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-osp-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1788684437.026542:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8d677487b000 for lustre-MDT0001-osp-MDT0000 00000020:00000080:3.0:1788684437.026554:0:38:0:(genops.c:885:class_export_put()) final put ffff8d677487c000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1788684437.026558:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff8d677487c000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001-osp-MDT0000 00000020:00000080:0.0:1788684437.026563:0:20742:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:01000000:3.0:1788684437.026575:0:38:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-osp-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1788684437.026577:0:20742:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1788684437.026582:0:20742:0:(genops.c:885:class_export_put()) final put ffff8d674831a800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1788684437.026585:0:20742:0:(genops.c:844:class_export_destroy()) destroying export ffff8d674831a800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:01000000:0.0:1788684437.026590:0:20742:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-mdtlov (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1788684437.026714:0:20742:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x44bac02bd54ad463 00000020:00000080:0.0:1788684437.026721:0:20742:0:(genops.c:885:class_export_put()) final put ffff8d67488e0800/lustre-MDD0000_UUID 00000020:01000000:0.0:1788684437.026732:0:20742:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDD0000 (flags='') 00000020:00000080:0.0:1788684437.026736:0:20742:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788684437.026740:0:20742:0:(obd_config.c:956:class_cleanup()) lustre-MDD0000: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1788684437.026744:0:20742:0:(genops.c:1558:class_disconnect_exports()) OBD device 6 (ffff8d66465e0000) has no exports 00000020:00000080:0.0:1788684437.026760:0:20742:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788684437.026763:0:20742:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000020:00000080:3.0:1788684437.026773:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff8d67488e0800/lustre-MDD0000_UUID for lustre-MDD0000 00000020:00000080:0.0:1788684437.026774:0:20742:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x44bac02bd54ad46a 00000020:00000080:0.0:1788684437.026779:0:20742:0:(genops.c:885:class_export_put()) final put ffff8d67488e6000/lustre-MDT0000-osd_UUID 00000020:00000080:3.0:1788684437.026781:0:38:0:(genops.c:885:class_export_put()) final put ffff8d67488e2000/lustre-MDD0000_UUID 00000020:00000080:3.0:1788684437.026785:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff8d67488e2000/lustre-MDD0000_UUID for lustre-MDD0000 00000020:01000000:3.0:1788684437.026790:0:38:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDD0000 (lustre-MDD0000_UUID) 00000020:01000004:0.0:1788684437.026793:0:20742:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8d66484cb800 from lustre-MDT0000, refs=3 00000020:01000004:0.0:1788684437.026797:0:20742:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8d66484cb800 3 00000020:01000004:0.0:1788684437.026800:0:20742:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff8d66484cb800 from lustre-MDT0000 00000020:00000080:0.0:1788684437.026829:0:20742:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788684437.026833:0:20742:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:00000080:0.0:1788684437.026837:0:20742:0:(genops.c:885:class_export_put()) final put ffff8d674831f800/lustre-MDT0000_UUID 00000020:00000080:3.0:1788684437.026839:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff8d67488e6000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:0.0:1788684437.026840:0:20742:0:(genops.c:844:class_export_destroy()) destroying export ffff8d674831f800/lustre-MDT0000_UUID for lustre-MDT0000 00000020:01000000:0.0:1788684437.026853:0:20742:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000 (lustre-MDT0000_UUID) 00000020:01000004:0.0:1788684437.026893:0:20742:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 3 references. 00000020:01000004:0.0:1788684437.026898:0:20742:0:(tgt_mount.c:255:server_stop_mgs()) Stop MGS service MGS 00000020:01000000:0.0:1788684437.026901:0:20742:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGS (flags='F') 00000020:00000080:0.0:1788684437.026904:0:20742:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788684437.026907:0:20742:0:(obd_config.c:956:class_cleanup()) MGS: forcing exports to disconnect: 1/3 00000020:00080000:0.0:1788684437.026913:0:20742:0:(genops.c:1819:print_export_data()) MGS: ACTIVE ffff8d677e50e000 c986901f-6089-4802-a23d-1179db951431 0@lo 18 (0 0 13) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1788684437.026918:0:20742:0:(genops.c:1553:class_disconnect_exports()) OBD device 1 (ffff8d6647433380) has exports, disconnecting them 00000020:00080000:0.0:1788684437.026923:0:20742:0:(genops.c:1528:class_disconnect_export_list()) MGS: disconnecting export at 0@lo (ffff8d677e50e000), last request at 1788684344 00000020:00000080:0.0:1788684437.026935:0:20742:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x44bac02bd54ad40f 00000020:00010000:0.0:1788684437.026939:0:20742:0:(genops.c:1921:obd_stale_export_put()) Put export ffff8d677e50e000: total 0 00000100:00080000:0.0:1788684437.026943:0:20742:0:(import.c:65:import_set_state_nolock()) ffff8d677e50f000 : changing import state from FULL to CLOSED 00000020:00080000:0.0:1788684437.026966:0:20742:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff8d677e50e000): rc 0 00000020:00080000:0.0:1788684437.026971:0:20742:0:(genops.c:1558:class_disconnect_exports()) OBD device 1 (ffff8d6647433380) has no exports 00000100:00100000:0.0:1788684437.027033:0:17165:0:(service.c:3183:ptlrpc_main()) ll_mgs_0002: service thread [ffff8d67491aaa00:17165] 2 exiting: rc = 0 00000020:00010000:3.0:1788684437.027039:0:17160:0:(genops.c:1907:obd_stale_export_get()) Get export ffff8d677e50e000: total 0 00010000:00010000:3.0:1788684437.027068:0:17160:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff8d677e50e000, canceled 0 locks, left on hash table 13. 00010000:00010000:3.0:1788684437.027099:0:17160:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d677711d000/0x44bac02bd54ad734 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x44bac02bd54ad72d expref: 14 pid: 17163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684437.027122:0:17160:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d6746d3e000/0x44bac02bd54ad9e2 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x44bac02bd54ad9db expref: 13 pid: 17165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684437.027134:0:17160:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d66477b0a00/0x44bac02bd54ad7a4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x44bac02bd54ad79d expref: 12 pid: 17165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684437.027148:0:17160:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d6647890600/0x44bac02bd54ad670 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x44bac02bd54ad669 expref: 11 pid: 17165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684437.027170:0:17160:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d6647891c00/0x44bac02bd54ad70a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x44bac02bd54ad703 expref: 10 pid: 17165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684437.027182:0:17160:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d6647890800/0x44bac02bd54ad52e lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x44bac02bd54ad527 expref: 9 pid: 17164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684437.027204:0:17160:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d66477b0c00/0x44bac02bd54ad5eb lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x44bac02bd54ad5e4 expref: 8 pid: 17164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684437.027213:0:17160:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d66477b0e00/0x44bac02bd54ad53c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x44bac02bd54ad535 expref: 7 pid: 17165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684437.027224:0:17160:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d6647891e00/0x44bac02bd54ad69a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x44bac02bd54ad693 expref: 6 pid: 17165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684437.027233:0:17160:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d66477b1400/0x44bac02bd54ad9c6 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x44bac02bd54ad9bf expref: 5 pid: 17165 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684437.027243:0:17160:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d66476d4000/0x44bac02bd54ad9d4 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x44bac02bd54ad9cd expref: 4 pid: 17163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684437.027254:0:17160:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d66477b1000/0x44bac02bd54ad54a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x44bac02bd54ad543 expref: 3 pid: 17163 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684437.027262:0:17160:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d66477b1800/0x44bac02bd54ad41d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x44bac02bd54ad416 expref: 2 pid: 17164 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684437.027272:0:17160:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff8d677e50e000, canceled 13 locks, left on hash table 0. 00000020:00000080:3.0:1788684437.027286:0:17160:0:(genops.c:885:class_export_put()) final put ffff8d677e50e000/c986901f-6089-4802-a23d-1179db951431 00010000:00010000:3.0:1788684437.027303:0:17160:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788684437.027305:0:17160:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788684437.027307:0:17160:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788684437.027346:0:17163:0:(service.c:3183:ptlrpc_main()) ll_mgs_0000: service thread [ffff8d6646c30200:17163] 0 exiting: rc = 1 00000020:00000080:0.0:1788684437.027545:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff8d677e50e000/c986901f-6089-4802-a23d-1179db951431 for MGS 00000020:00000080:0.0:1788684437.027573:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8d677e50f000 for MGS 00000100:00100000:3.0:1788684437.031485:0:17164:0:(service.c:3183:ptlrpc_main()) ll_mgs_0001: service thread [ffff8d6646c31600:17164] 1 exiting: rc = 0 00000100:00100000:0.0:1788684437.031870:0:20742:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788684437.031884:0:20742:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788684437.031891:0:20742:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788684437.031897:0:20742:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788684437.031915:0:20742:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788684437.031927:0:20742:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788684437.031933:0:20742:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788684437.031939:0:20742:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788684437.031944:0:20742:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788684437.031950:0:20742:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788684437.031955:0:20742:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788684437.031960:0:20742:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788684437.031965:0:20742:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788684437.031970:0:20742:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788684437.031974:0:20742:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788684437.031979:0:20742:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788684437.031984:0:20742:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788684437.032000:0:20742:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788684437.032004:0:20742:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788684437.032009:0:20742:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788684437.032014:0:20742:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788684437.032020:0:20742:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788684437.032026:0:20742:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788684437.032031:0:20742:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788684437.032036:0:20742:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788684437.032040:0:20742:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788684437.032045:0:20742:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788684437.032050:0:20742:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788684437.032055:0:20742:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788684437.032060:0:20742:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788684437.032065:0:20742:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788684437.032070:0:20742:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788684437.032074:0:20742:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788684437.032079:0:20742:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788684437.032084:0:20742:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788684437.032089:0:20742:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788684437.032094:0:20742:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788684437.032100:0:20742:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788684437.032105:0:20742:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788684437.032109:0:20742:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788684437.032114:0:20742:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788684437.032119:0:20742:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788684437.032124:0:20742:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788684437.032129:0:20742:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788684437.032134:0:20742:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788684437.032139:0:20742:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788684437.032144:0:20742:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788684437.032149:0:20742:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788684437.032153:0:20742:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788684437.032169:0:20742:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788684437.032175:0:20742:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788684437.032180:0:20742:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788684437.032193:0:20742:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788684437.032198:0:20742:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788684437.032203:0:20742:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788684437.032208:0:20742:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788684437.032213:0:20742:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788684437.032218:0:20742:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788684437.032223:0:20742:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788684437.032229:0:20742:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788684437.032236:0:20742:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788684437.032241:0:20742:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788684437.032246:0:20742:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788684437.032252:0:20742:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:01000000:0.0:1788684437.035543:0:20742:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8d677e2612a0 - data ffff8d6751614e58/ffff8d677cb96400 00000020:01000000:0.0:1788684437.035679:0:20742:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8d6646640720 - data ffff8d6751749bd0/ffff8d66477aec00 00000020:00000080:0.0:1788684437.036562:0:20742:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x44bac02bd54ad3f3 00000020:00000080:0.0:1788684437.036580:0:20742:0:(genops.c:885:class_export_put()) final put ffff8d6648403000/lustre-MDT0000-osd_UUID 00000020:01000004:0.0:1788684437.036602:0:20742:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8d66484cb800 from MGS, refs=2 00000020:00000080:3.0:1788684437.036620:0:14645:0:(genops.c:844:class_export_destroy()) destroying export ffff8d6648403000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000004:0.0:1788684437.036708:0:20742:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8d66484cb800 2 00000020:01000004:0.0:1788684437.036714:0:20742:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff8d66484cb800 from MGS 00000020:00000080:0.0:1788684437.036743:0:20742:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788684437.036750:0:20742:0:(obd_config.c:883:class_detach()) detach on obd MGS (uuid MGS) 00000020:00000080:0.0:1788684437.036754:0:20742:0:(genops.c:885:class_export_put()) final put ffff8d6648402000/MGS 00000020:00000080:0.0:1788684437.036756:0:20742:0:(genops.c:844:class_export_destroy()) destroying export ffff8d6648402000/MGS for MGS 00000020:01000000:0.0:1788684437.036763:0:20742:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGS (MGS) 00000020:01000000:0.0:1788684437.036827:0:20742:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-MDT0000 (flags='F') 00000020:00000080:0.0:1788684437.036831:0:20742:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788684437.036836:0:20742:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-MDT0000: forcing exports to disconnect: 1/3 00000020:00080000:0.0:1788684437.036842:0:20742:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-MDT0000: ACTIVE ffff8d67488ed800 lustre-MDT0000-lwp-MDT0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1788684437.037138:0:20742:0:(genops.c:1553:class_disconnect_exports()) OBD device 11 (ffff8d67482e3380) has exports, disconnecting them 00000020:00080000:0.0:1788684437.037146:0:20742:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-MDT0000: disconnecting export at 0@lo (ffff8d67488ed800), last request at 1788684344 00000020:00000080:0.0:1788684437.037150:0:20742:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x44bac02bd54ad4f6 00000020:00080000:0.0:1788684437.037295:0:20742:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff8d67488ed800): rc 0 00000020:00000080:0.0:1788684437.037307:0:20742:0:(genops.c:885:class_export_put()) final put ffff8d67488ed800/lustre-MDT0000-lwp-MDT0000 00000020:00000080:3.0:1788684437.037432:0:14645:0:(genops.c:844:class_export_destroy()) destroying export ffff8d67488ed800/lustre-MDT0000-lwp-MDT0000 for lustre-MDT0000-lwp-MDT0000 00010000:01000000:1.0:1788684437.085253:0:20742:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-MDT0000: client import never connected 00000100:00080000:1.0:1788684437.085263:0:20742:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1788684437.085268:0:20742:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 5 00000100:00100000:1.0:1788684437.085275:0:20742:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1788684437.086148:0:14645:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8d67749d9000 for lustre-MDT0000-lwp-MDT0000 00000020:00000080:3.0:1788684437.086274:0:20742:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788684437.086295:0:20742:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000020:00000080:3.0:1788684437.086300:0:20742:0:(genops.c:885:class_export_put()) final put ffff8d67488e9800/lustre-MDT0000-lwp-MDT0000_UUID 00000020:00000080:3.0:1788684437.086305:0:20742:0:(genops.c:844:class_export_destroy()) destroying export ffff8d67488e9800/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000-lwp-MDT0000 00000020:01000000:3.0:1788684437.086311:0:20742:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-MDT0000 (lustre-MDT0000-lwp-MDT0000_UUID) 00000020:01000004:3.0:1788684437.086428:0:20742:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8d66484cb800 1 00000020:00000080:3.0:1788684437.086434:0:20742:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x44bac02bd54ad3e5 00000020:00000080:3.0:1788684437.086441:0:20742:0:(genops.c:885:class_export_put()) final put ffff8d6648402800/lustre-MDT0000-osd_UUID 00000020:01000000:3.0:1788684437.086447:0:20742:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-osd (flags='') 00000020:00000080:3.0:1788684437.086451:0:20742:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788684437.086455:0:20742:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-osd: forcing exports to disconnect: 0/2 00000020:00080000:3.0:1788684437.086459:0:20742:0:(genops.c:1558:class_disconnect_exports()) OBD device 0 (ffff8d677721b380) has no exports 00000020:00000080:1.0:1788684437.088957:0:14645:0:(genops.c:844:class_export_destroy()) destroying export ffff8d6648402800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000100:00080000:1.0:1788684437.120763:0:14645:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788684437.120770:0:14645:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1788684437.120773:0:14645:0:(import.c:65:import_set_state_nolock()) ffff8d677cc88800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788684437.120781:0:14645:0:(import.c:545:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 516 00000100:00080000:1.0:1788684437.120787:0:14645:0:(import.c:630:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1788684437.120795:0:14645:0:(import.c:665:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8d677cc88800 using connection 192.168.206.144@tcp/0@lo 00000100:00100000:1.0:1788684437.120819:0:14645:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8d677fab4000 x1875571085890688/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788684437.120944:0:3626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d677fab4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c986901f-6089-4802-a23d-1179db951431:3626:1875571085890560:0@lo:400:kworker.0 00000400:00000100:1.0:1788684437.120991:0:3626:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1875571085890560 offset 0 length 224: 4 00000100:00100000:1.0:1788684437.121028:0:3626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d674698e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3626:1875571085891200:0@lo:400:kworker.0 00000100:00100000:1.0:1788684437.121061:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788684437.121090:0:3626:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:1.0:1788684437.121099:0:3626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d674698f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3626:1875571085891072:0@lo:400:kworker.0 00000100:00100000:1.0:1788684437.121124:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788684437.121147:0:3626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d674698f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3626:1875571085891584:0@lo:400:kworker.0 00000100:00100000:1.0:1788684437.121171:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788684437.121203:0:3622:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d677fab4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3622:1875571085890688:0@lo:38:kworker.0 00000100:00100000:1.0:1788684437.121229:0:3622:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788684437.121257:0:3624:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d677fab4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3624:1875571085890944:0@lo:400:kworker.0 00000100:00100000:1.0:1788684437.121293:0:3624:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788684437.121312:0:3624:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d674698df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3624:1875571085891456:0@lo:400:kworker.0 00000100:00100000:1.0:1788684437.121331:0:3624:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788684437.121349:0:3624:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:1.0:1788684437.121354:0:3624:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d677fab5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3624:1875571085890816:0@lo:400:kworker.0 00000100:00100000:1.0:1788684437.121399:0:3624:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788684437.121422:0:3624:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d674698d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3624:1875571085891328:0@lo:400:kworker.0 00000100:00100000:1.0:1788684437.121460:0:3624:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788684437.121670:0:18403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085891200 00000100:00100000:1.0:1788684437.121679:0:18403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085891200 00000100:00100000:1.0:1788684437.121711:0:18403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085891072 00000100:00100000:1.0:1788684437.121714:0:18403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085891072 00000100:00100000:1.0:1788684437.121732:0:18403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085891584 00000100:00100000:1.0:1788684437.121735:0:18403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085891584 00000100:00100000:1.0:1788684437.121762:0:18403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085891456 00000100:00100000:1.0:1788684437.121765:0:18403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085891456 00000100:00100000:1.0:1788684437.121772:0:18403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085891328 00000100:00100000:1.0:1788684437.121774:0:18403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085891328 00000100:00100000:1.0:1788684437.121789:0:18403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:1.0:1788684437.121797:0:18403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d674698c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3626:x1875571085891584:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788684437.121857:0:18403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d674698c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3626:x1875571085891584:12345-0@lo:400:kworker.0 Request processed in 60us (686us total) trans 0 rc 0/0 00000100:00100000:1.0:1788684437.121864:0:18403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:1.0:1788684437.121881:0:18403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:1.0:1788684437.121888:0:18403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d674698dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3624:x1875571085891328:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788684437.121918:0:18403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d674698dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3624:x1875571085891328:12345-0@lo:400:kworker.0 Request processed in 31us (458us total) trans 0 rc 0/0 00000100:00100000:1.0:1788684437.121925:0:18403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:1.0:1788684437.121936:0:18403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1788684437.121940:0:18403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d674698d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3626:x1875571085891200:12345-0@lo:400:kworker.0 00000020:00080000:1.0:1788684437.121945:0:18403:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:1.0:1788684437.121968:0:18403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d674698d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3626:x1875571085891200:12345-0@lo:400:kworker.0 Request processed in 27us (908us total) trans 0 rc -107/-107 00000100:00100000:1.0:1788684437.121974:0:18403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1788684437.121984:0:18403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1788684437.121988:0:18403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d674698ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3626:x1875571085891072:12345-0@lo:400:kworker.0 00000020:00080000:1.0:1788684437.121991:0:18403:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:1.0:1788684437.122009:0:18403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d674698ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3626:x1875571085891072:12345-0@lo:400:kworker.0 Request processed in 21us (886us total) trans 0 rc -107/-107 00000100:00100000:1.0:1788684437.122015:0:18403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1788684437.122033:0:18403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1788684437.122037:0:18403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d674698ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3624:x1875571085891456:12345-0@lo:400:kworker.0 00000020:00080000:1.0:1788684437.122041:0:18403:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:1.0:1788684437.122062:0:18403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d674698ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3624:x1875571085891456:12345-0@lo:400:kworker.0 Request processed in 24us (731us total) trans 0 rc -107/-107 00000100:00100000:1.0:1788684437.122068:0:18403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1788684437.122242:0:17176:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085890688 00000100:00100000:1.0:1788684437.122247:0:17176:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085890688 00000100:00100000:1.0:1788684437.122601:0:17176:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1788684437.122608:0:17176:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d674698c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3622:x1875571085890688:12345-0@lo:38:kworker.0 00010000:00020000:1.0:1788684437.122628:0:17176:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1788684437.123101:0:3625:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788684437.123115:0:3625:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d677fb45180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3625:1875571085891712:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788684437.123290:0:3625:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788684437.123331:0:20360:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085891712 00000100:00100000:0.0:1788684437.123335:0:20360:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085891712 00000100:00100000:0.0:1788684437.123388:0:20360:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1788684437.123396:0:20360:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d677fb45f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3625:x1875571085891712:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1788684437.123417:0:20360:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3915849728 avail 3684327424 00000100:00100000:0.0:1788684437.123454:0:20360:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d677fb45f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3625:x1875571085891712:12345-0@lo:13:osp-pre-1-1.0 Request processed in 59us (164us total) trans 0 rc 0/0 00000100:00100000:0.0:1788684437.123461:0:20360:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1788684437.123587:0:3625:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d677fb45180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3625:1875571085891712:0@lo:13:osp-pre-1-1.0 00000100:00080000:3.0:1788684437.124042:0:17166:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788684437.124048:0:17166:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788684437.124062:0:19204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085890944 00000100:00100000:3.0:1788684437.124067:0:19204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085890944 00000100:00100000:3.0:1788684437.124102:0:19204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085890816 00000100:00100000:3.0:1788684437.124106:0:19204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085890816 00000100:00100000:3.0:1788684437.124142:0:19204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1788684437.124153:0:19567:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1788684437.124154:0:19204:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d674698ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3624:x1875571085890944:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788684437.124168:0:19567:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d674698c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3624:x1875571085890816:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788684437.131019:0:19204:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d674698ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3624:x1875571085890944:12345-0@lo:400:kworker.0 Request processed in 6858us (9714us total) trans 0 rc 0/0 00000100:00100000:3.0:1788684437.131035:0:19204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00080000:3.0:1788684437.131092:0:17166:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1788684437.131144:0:3624:0:(ldlm_request.c:1670:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d674698d500 x1875571085891328/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788684453 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788684437.131158:0:3624:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d674698d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3624:1875571085891328:0@lo:400:kworker.0 00000100:00100000:3.0:1788684437.131174:0:3624:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d677fab4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3624:1875571085890944:0@lo:400:kworker.0 00000100:00080000:3.0:1788684437.131205:0:3624:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:3.0:1788684437.131210:0:3624:0:(import.c:65:import_set_state_nolock()) ffff8d6646588800 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:3.0:1788684437.131214:0:3624:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00100000:2.0:1788684437.131655:0:19567:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d674698c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3624:x1875571085890816:12345-0@lo:400:kworker.0 Request processed in 7489us (10254us total) trans 0 rc 0/0 00000100:00100000:2.0:1788684437.131665:0:19567:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1788684437.145028:0:17176:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d674698c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3622:x1875571085890688:12345-0@lo:38:kworker.0 Request processed in 22412us (23790us total) trans 0 rc -19/-19 00000100:00100000:1.0:1788684437.145043:0:17176:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00080000:1.0:1788684437.146603:0:3622:0:(import.c:65:import_set_state_nolock()) ffff8d677cc88800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788684437.146613:0:3622:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1788684437.146617:0:3622:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d677fab4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3622:1875571085890688:0@lo:38:kworker.0 00000100:00080000:1.0:1788684437.147739:0:3626:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-MDT0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:1.0:1788684437.147745:0:3626:0:(import.c:65:import_set_state_nolock()) ffff8d6646494000 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:1.0:1788684437.147749:0:3626:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:1.0:1788684437.147755:0:3626:0:(import.c:65:import_set_state_nolock()) ffff8d6646494000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788684437.147759:0:3626:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 439 00000100:00080000:1.0:1788684437.147767:0:3626:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8d6646494000 using connection 192.168.206.144@tcp/0@lo 00000100:00100000:1.0:1788684437.147801:0:3626:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8d674698fb80 x1875571085891840/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788684437.147843:0:3626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d674698f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3626:1875571085891072:0@lo:400:kworker.0 00010000:00080000:1.0:1788684437.147861:0:3626:0:(ldlm_request.c:1670:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d674698f480 x1875571085891584/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788684453 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788684437.147872:0:3626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d674698f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3626:1875571085891584:0@lo:400:kworker.0 00000100:00080000:1.0:1788684437.147883:0:3626:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0000 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:1.0:1788684437.147887:0:3626:0:(import.c:65:import_set_state_nolock()) ffff8d6646cc0800 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:1.0:1788684437.147890:0:3626:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0000: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:1.0:1788684437.147893:0:3626:0:(import.c:65:import_set_state_nolock()) ffff8d6646cc0800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788684437.147897:0:3626:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 455 00000100:00080000:1.0:1788684437.147901:0:3626:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8d6646cc0800 using connection 192.168.206.144@tcp/0@lo 00000100:00100000:1.0:1788684437.147915:0:3626:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8d674698d880 x1875571085891968/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788684437.147925:0:3626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d674698e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3626:1875571085891200:0@lo:400:kworker.0 00000100:00100000:1.0:1788684437.147956:0:3622:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d674698fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3622:1875571085891840:0@lo:38:ptlrpcd_00_03.0 00000100:00100000:1.0:1788684437.148014:0:3622:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788684437.148043:0:3622:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d674698d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3622:1875571085891968:0@lo:38:ptlrpcd_00_03.0 00000100:00100000:1.0:1788684437.148065:0:3622:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788684437.148112:0:17171:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085891840 00000100:00100000:1.0:1788684437.148118:0:17171:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085891840 00000100:00100000:1.0:1788684437.148147:0:17171:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085891968 00000100:00100000:1.0:1788684437.148150:0:17171:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085891968 00000100:00100000:1.0:1788684437.148168:0:17171:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1788684437.148175:0:17171:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d674698e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3622:x1875571085891840:12345-0@lo:38:ptlrpcd_00_03.0 00010000:00020000:1.0:1788684437.148201:0:17171:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1788684437.148241:0:17171:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d674698e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3622:x1875571085891840:12345-0@lo:38:ptlrpcd_00_03.0 Request processed in 65us (227us total) trans 0 rc -19/-19 00000100:00100000:1.0:1788684437.148248:0:17171:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1788684437.148264:0:17171:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1788684437.148268:0:17171:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d674698f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3622:x1875571085891968:12345-0@lo:38:ptlrpcd_00_03.0 00010000:00020000:1.0:1788684437.149423:0:17171:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1788684437.149603:0:17171:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d674698f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3622:x1875571085891968:12345-0@lo:38:ptlrpcd_00_03.0 Request processed in 1331us (1534us total) trans 0 rc -19/-19 00000100:00100000:1.0:1788684437.149613:0:17171:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00080000:1.0:1788684437.149717:0:3622:0:(import.c:65:import_set_state_nolock()) ffff8d6646494000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788684437.149722:0:3622:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1788684437.149726:0:3622:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d674698fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3622:1875571085891840:0@lo:38:ptlrpcd_00_03.0 00000100:00080000:1.0:1788684437.149735:0:3622:0:(import.c:65:import_set_state_nolock()) ffff8d6646cc0800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788684437.149738:0:3622:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1788684437.149741:0:3622:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d674698d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3622:1875571085891968:0@lo:38:ptlrpcd_00_03.0 00000100:00080000:3.0:1788684437.179025:0:3624:0:(import.c:65:import_set_state_nolock()) ffff8d6646588800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788684437.179039:0:3624:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 470 00000100:00080000:3.0:1788684437.179049:0:3624:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8d6646588800 using connection 192.168.206.144@tcp/0@lo 00000100:00100000:1.0:1788684437.208519:0:3624:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8d674698d880 x1875571085892096/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788684437.208553:0:3624:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d674698df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3624:1875571085891456:0@lo:400:kworker.0 00000100:00100000:1.0:1788684437.208599:0:3622:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d674698d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3622:1875571085892096:0@lo:38:ptlrpcd_00_01.0 00000100:00100000:1.0:1788684437.208672:0:3622:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788684437.208727:0:17171:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085892096 00000100:00100000:1.0:1788684437.208734:0:17171:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085892096 00000100:00100000:1.0:1788684437.208785:0:17171:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:1.0:1788684437.208791:0:17171:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d674698df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3622:x1875571085892096:12345-0@lo:38:ptlrpcd_00_01.0 00010000:00020000:1.0:1788684437.208819:0:17171:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0000: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1788684437.208865:0:17171:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d674698df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3622:x1875571085892096:12345-0@lo:38:ptlrpcd_00_01.0 Request processed in 73us (193us total) trans 0 rc -19/-19 00000100:00100000:1.0:1788684437.208871:0:17171:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00080000:1.0:1788684437.208917:0:3622:0:(import.c:65:import_set_state_nolock()) ffff8d6646588800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788684437.208921:0:3622:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1788684437.208925:0:3622:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d674698d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3622:1875571085892096:0@lo:38:ptlrpcd_00_01.0 00000100:00100000:1.0:1788684437.208952:0:3624:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d677fab5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3624:1875571085890816:0@lo:400:kworker.0 00010000:00010000:0.0:1788684437.246539:0:17159:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1788684437.272052:0:20742:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788684437.272064:0:20742:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00000020:00000080:2.0:1788684437.272069:0:20742:0:(genops.c:885:class_export_put()) final put ffff8d66484c8800/lustre-MDT0000-osd_UUID 00000020:00000080:2.0:1788684437.272073:0:20742:0:(genops.c:844:class_export_destroy()) destroying export ffff8d66484c8800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:2.0:1788684437.272085:0:20742:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-osd (lustre-MDT0000-osd_UUID) 00000020:01000004:2.0:1788684437.272199:0:20742:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff8d66484cd000 00000020:02000400:2.0:1788684437.272257:0:20742:0:(tgt_mount.c:2184:server_put_super()) server umount lustre-MDT0000 complete 00010000:00010000:1.0:1788684438.270517:0:17160:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788684439.294821:0:17159:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1788684440.064293:0:17922:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:3.0:1788684440.189546:0:3624:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788684440.193084:0:3624:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6647908700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3624:1875571085892224:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788684440.193162:0:3624:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788684440.193335:0:18682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085892224 00000100:00100000:0.0:1788684440.193344:0:18682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085892224 00000100:00100000:0.0:1788684440.193443:0:18682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1788684440.193454:0:18682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6780033100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3624:x1875571085892224:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1788684440.193482:0:18682:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923513344 avail 3691991040 00000100:00100000:0.0:1788684440.193527:0:18682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6780033100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3624:x1875571085892224:12345-0@lo:13:osp-pre-0-1.0 Request processed in 75us (365us total) trans 0 rc 0/0 00000100:00100000:0.0:1788684440.193534:0:18682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00080000:3.0:1788684440.193840:0:17166:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788684440.193945:0:3624:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6647908700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3624:1875571085892224:0@lo:13:osp-pre-0-1.0 00010000:00010000:1.0:1788684440.318180:0:17160:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1788684441.216957:0:18674:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1788684441.216967:0:18674:0:(genops.c:885:class_export_put()) final put ffff8d6646589000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1788684441.218179:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff8d6646589000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000 00000020:00000080:2.0:1788684441.218236:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8d664658f800 for lustre-OST0000 00010000:00010000:0.0:1788684441.345256:0:17159:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1788684441.448703:0:20943:0:(tgt_mount.c:2195:server_umount_begin()) umount -f 00000020:01000004:3.0:1788684441.463657:0:20943:0:(tgt_mount.c:2065:server_put_super()) server put_super lustre-MDT0001 00010000:00010000:3.0:1788684441.463731:0:20943:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.144@tcp lock: ffff8d677711d400/0x44bac02bd54ad5e4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x44bac02bd54ad5eb expref: -99 pid: 17902 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684441.463749:0:20943:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.144@tcp lock: ffff8d677711d400/0x44bac02bd54ad5e4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x44bac02bd54ad5eb expref: -99 pid: 17902 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684441.463758:0:20943:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.144@tcp lock: ffff8d677711d400/0x44bac02bd54ad5e4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0x44bac02bd54ad5eb expref: -99 pid: 17902 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684441.463766:0:20943:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.144@tcp lock: ffff8d677711d400/0x44bac02bd54ad5e4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0x44bac02bd54ad5eb expref: -99 pid: 17902 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684441.463813:0:20943:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:3.0:1788684441.463821:0:20943:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:3.0:1788684441.463862:0:20943:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1788684441.463867:0:20943:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 3 00000100:00080000:3.0:1788684441.463876:0:20943:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID 00000100:00080000:3.0:1788684441.463883:0:20943:0:(import.c:65:import_set_state_nolock()) ffff8d6646494000 lustre-MDT0000_UUID: changing import state from DISCONN to CLOSED 00000100:00080000:3.0:1788684441.463890:0:20943:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1788684441.463892:0:20943:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 4 00000100:00100000:3.0:1788684441.463896:0:20943:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:3.0:1788684441.464937:0:20943:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.144@tcp lock: ffff8d66476d5000/0x44bac02bd54ad543 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x44bac02bd54ad54a expref: -99 pid: 17902 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684441.464956:0:20943:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.144@tcp lock: ffff8d66476d5000/0x44bac02bd54ad543 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x44bac02bd54ad54a expref: -99 pid: 17902 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684441.464964:0:20943:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.144@tcp lock: ffff8d66476d5000/0x44bac02bd54ad543 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0x44bac02bd54ad54a expref: -99 pid: 17902 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684441.464971:0:20943:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.144@tcp lock: ffff8d66476d5000/0x44bac02bd54ad543 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0x44bac02bd54ad54a expref: -99 pid: 17902 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684441.464997:0:20943:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1788684441.465004:0:20943:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.144@tcp lock: ffff8d66477b1c00/0x44bac02bd54ad79d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x44bac02bd54ad7a4 expref: -99 pid: 17168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684441.465011:0:20943:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.144@tcp lock: ffff8d66477b1c00/0x44bac02bd54ad79d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x44bac02bd54ad7a4 expref: -99 pid: 17168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684441.465035:0:20943:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.144@tcp lock: ffff8d66477b1c00/0x44bac02bd54ad79d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x44bac02bd54ad7a4 expref: -99 pid: 17168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684441.465041:0:20943:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.144@tcp lock: ffff8d66477b1c00/0x44bac02bd54ad79d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x44bac02bd54ad7a4 expref: -99 pid: 17168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684441.465049:0:20943:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:3.0:1788684441.465055:0:20943:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.144@tcp lock: ffff8d66476d4200/0x44bac02bd54ad9db lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x44bac02bd54ad9e2 expref: -99 pid: 17168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684441.465062:0:20943:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.144@tcp lock: ffff8d66476d4200/0x44bac02bd54ad9db lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x44bac02bd54ad9e2 expref: -99 pid: 17168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684441.465068:0:20943:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.144@tcp lock: ffff8d66476d4200/0x44bac02bd54ad9db lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x44bac02bd54ad9e2 expref: -99 pid: 17168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684441.465074:0:20943:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.144@tcp lock: ffff8d66476d4200/0x44bac02bd54ad9db lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x44bac02bd54ad9e2 expref: -99 pid: 17168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684441.465080:0:20943:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00010000:00010000:3.0:1788684441.465086:0:20943:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.144@tcp lock: ffff8d677711cc00/0x44bac02bd54ad535 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x44bac02bd54ad53c expref: -99 pid: 17902 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684441.465092:0:20943:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.144@tcp lock: ffff8d677711cc00/0x44bac02bd54ad535 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x44bac02bd54ad53c expref: -99 pid: 17902 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684441.465098:0:20943:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.144@tcp lock: ffff8d677711cc00/0x44bac02bd54ad535 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x44bac02bd54ad53c expref: -99 pid: 17902 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684441.465116:0:20943:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.144@tcp lock: ffff8d677711cc00/0x44bac02bd54ad535 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x44bac02bd54ad53c expref: -99 pid: 17902 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684441.465123:0:20943:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to regular blp list, 5 blwis in pool 10000000:01000000:3.0:1788684441.465127:0:20943:0:(mgc_request.c:547:config_log_end()) end config log lustre-MDT0001 (0) 00000020:01000004:3.0:1788684441.465157:0:20943:0:(tgt_mount.c:2115:server_put_super()) stopping lustre-MDT0001 00000020:01000000:3.0:1788684441.465161:0:20943:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001 (flags='F') 00000020:00000080:3.0:1788684441.465167:0:20943:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788684441.465173:0:20943:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001: forcing exports to disconnect: 2/5 00000020:00080000:3.0:1788684441.465182:0:20943:0:(genops.c:1819:print_export_data()) lustre-MDT0001: ACTIVE ffff8d67749df800 lustre-MDT0001-lwp-OST0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1788684441.465188:0:20943:0:(genops.c:1819:print_export_data()) lustre-MDT0001: ACTIVE ffff8d66459ac800 lustre-MDT0001-lwp-OST0000_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1788684441.465193:0:20943:0:(genops.c:1553:class_disconnect_exports()) OBD device 14 (ffff8d677721cd40) has exports, disconnecting them 00000020:00080000:3.0:1788684441.465198:0:20943:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0001: disconnecting export at 0@lo (ffff8d67749df800), last request at 1788684437 00000020:00000080:3.0:1788684441.465207:0:20943:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x44bac02bd54ad75e 00000100:00080000:3.0:1788684441.465234:0:20943:0:(import.c:65:import_set_state_nolock()) ffff8d67749da800 : changing import state from FULL to CLOSED 00000020:00080000:3.0:1788684441.465295:0:20943:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff8d67749df800): rc 0 00000020:00000080:3.0:1788684441.465298:0:20943:0:(genops.c:885:class_export_put()) final put ffff8d67749df800/lustre-MDT0001-lwp-OST0001_UUID 00000020:00080000:3.0:1788684441.465310:0:20943:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0001: disconnecting export at 0@lo (ffff8d66459ac800), last request at 1788684437 00000020:00000080:3.0:1788684441.465314:0:20943:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x44bac02bd54ad6c4 00000100:00080000:3.0:1788684441.465320:0:20943:0:(import.c:65:import_set_state_nolock()) ffff8d66459ab800 : changing import state from FULL to CLOSED 00000020:00000080:3.0:1788684441.465332:0:14645:0:(genops.c:844:class_export_destroy()) destroying export ffff8d67749df800/lustre-MDT0001-lwp-OST0001_UUID for lustre-MDT0001 00000020:00000080:3.0:1788684441.465419:0:14645:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8d67749da800 for lustre-MDT0001 00000020:00080000:3.0:1788684441.465434:0:20943:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff8d66459ac800): rc 0 00000020:00000080:3.0:1788684441.465436:0:20943:0:(genops.c:885:class_export_put()) final put ffff8d66459ac800/lustre-MDT0001-lwp-OST0000_UUID 00000004:00000080:3.0:1788684441.465447:0:20943:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0001: cmd=400866e7 len=0 karg=ffffb81ec2203ae0 00000020:00000080:3.0:1788684441.465459:0:14645:0:(genops.c:844:class_export_destroy()) destroying export ffff8d66459ac800/lustre-MDT0001-lwp-OST0000_UUID for lustre-MDT0001 00000020:00000080:3.0:1788684441.465491:0:14645:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8d66459ab800 for lustre-MDT0001 00000100:00080000:3.0:1788684441.465522:0:20943:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1788684441.465534:0:20943:0:(client.c:3603:ptlrpc_abort_inflight()) @@@ aborting waiting req req@ffff8d677fb46680 x1875571085890176/t0(0) o41->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 224/224 e 0 to 0 dl 1788684451 ref 1 fl Rpc:RSQU/200/0 rc -107/-107 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788684441.465570:0:20943:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 0 gen 3 00010000:00010000:2.0:1788684441.465828:0:17159:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:2.0:1788684441.465838:0:17159:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.144@tcp lock: ffff8d677711d400/0x44bac02bd54ad5e4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0x44bac02bd54ad5eb expref: -99 pid: 17902 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684441.465847:0:17159:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d677711d400 already unused, calling callback (ffffffffc1297c20) 10000000:00010000:2.0:1788684441.465852:0:17159:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.144@tcp lock: ffff8d677711d400/0x44bac02bd54ad5e4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0x44bac02bd54ad5eb expref: -99 pid: 17902 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684441.465862:0:17159:0:(ldlm_request.c:1390:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.144@tcp lock: ffff8d677711d400/0x44bac02bd54ad5e4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1008400000000 nid: local remote: 0x44bac02bd54ad5eb expref: -99 pid: 17902 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788684441.465871:0:17159:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.144@tcp lock: ffff8d677711d400/0x44bac02bd54ad5e4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1009400000000 nid: local remote: 0x44bac02bd54ad5eb expref: -99 pid: 17902 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788684441.465878:0:17159:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1788684441.465881:0:17159:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:2.0:1788684441.465884:0:17159:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:2.0:1788684441.465933:0:17159:0:(ldlm_request.c:1438:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.144@tcp lock: ffff8d677711d400/0x44bac02bd54ad5e4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x44bac02bd54ad5eb expref: -99 pid: 17902 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684441.465940:0:17159:0:(ldlm_request.c:1497:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788684441.465964:0:17159:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.144@tcp lock: ffff8d677711d400/0x44bac02bd54ad5e4 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x44bac02bd54ad5eb expref: -99 pid: 17902 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684441.465972:0:17159:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.144@tcp lock: ffff8d677711d400/0x44bac02bd54ad5e4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x44bac02bd54ad5eb expref: -99 pid: 17902 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684441.465988:0:17159:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:2.0:1788684441.465992:0:17159:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.144@tcp lock: ffff8d66476d5000/0x44bac02bd54ad543 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0x44bac02bd54ad54a expref: -99 pid: 17902 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684441.465998:0:17159:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d66476d5000 already unused, calling callback (ffffffffc1297c20) 10000000:00010000:2.0:1788684441.466010:0:17159:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.144@tcp lock: ffff8d66476d5000/0x44bac02bd54ad543 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0x44bac02bd54ad54a expref: -99 pid: 17902 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684441.466019:0:17159:0:(ldlm_request.c:1390:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.144@tcp lock: ffff8d66476d5000/0x44bac02bd54ad543 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1008400000000 nid: local remote: 0x44bac02bd54ad54a expref: -99 pid: 17902 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788684441.466024:0:17159:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.144@tcp lock: ffff8d66476d5000/0x44bac02bd54ad543 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1009400000000 nid: local remote: 0x44bac02bd54ad54a expref: -99 pid: 17902 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788684441.466029:0:17159:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1788684441.466031:0:17159:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-MDT0001: stopping, won't requeue 10000000:01000000:2.0:1788684441.466033:0:17159:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-MDT0001 00010000:00010000:2.0:1788684441.466049:0:17159:0:(ldlm_request.c:1438:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.144@tcp lock: ffff8d66476d5000/0x44bac02bd54ad543 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x44bac02bd54ad54a expref: -99 pid: 17902 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684441.466055:0:17159:0:(ldlm_request.c:1497:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788684441.466074:0:17159:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.144@tcp lock: ffff8d66476d5000/0x44bac02bd54ad543 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x44bac02bd54ad54a expref: -99 pid: 17902 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684441.466081:0:17159:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.144@tcp lock: ffff8d66476d5000/0x44bac02bd54ad543 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x44bac02bd54ad54a expref: -99 pid: 17902 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684441.466090:0:17159:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1788684441.466094:0:17159:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.144@tcp lock: ffff8d66477b1c00/0x44bac02bd54ad79d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x44bac02bd54ad7a4 expref: -99 pid: 17168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684441.466099:0:17159:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d66477b1c00 already unused, calling callback (ffffffffc1297c20) 10000000:00010000:2.0:1788684441.466102:0:17159:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.144@tcp lock: ffff8d66477b1c00/0x44bac02bd54ad79d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x44bac02bd54ad7a4 expref: -99 pid: 17168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684441.466110:0:17159:0:(ldlm_request.c:1390:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.144@tcp lock: ffff8d66477b1c00/0x44bac02bd54ad79d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x44bac02bd54ad7a4 expref: -99 pid: 17168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788684441.466122:0:17159:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.144@tcp lock: ffff8d66477b1c00/0x44bac02bd54ad79d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x44bac02bd54ad7a4 expref: -99 pid: 17168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788684441.466128:0:17159:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 10000000:01000000:2.0:1788684441.466130:0:17159:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-mdtir: stopping, won't requeue 10000000:01000000:2.0:1788684441.466132:0:17159:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-mdtir 00010000:00010000:2.0:1788684441.466146:0:17159:0:(ldlm_request.c:1438:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.144@tcp lock: ffff8d66477b1c00/0x44bac02bd54ad79d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x44bac02bd54ad7a4 expref: -99 pid: 17168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684441.466152:0:17159:0:(ldlm_request.c:1497:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788684441.466158:0:17159:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.144@tcp lock: ffff8d66477b1c00/0x44bac02bd54ad79d lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x44bac02bd54ad7a4 expref: -99 pid: 17168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684441.466164:0:17159:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.144@tcp lock: ffff8d66477b1c00/0x44bac02bd54ad79d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x44bac02bd54ad7a4 expref: -99 pid: 17168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684441.466178:0:17159:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788684441.466181:0:17159:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.144@tcp lock: ffff8d66476d4200/0x44bac02bd54ad9db lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x44bac02bd54ad9e2 expref: -99 pid: 17168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684441.466187:0:17159:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d66476d4200 already unused, calling callback (ffffffffc1297c20) 10000000:00010000:2.0:1788684441.466189:0:17159:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.144@tcp lock: ffff8d66476d4200/0x44bac02bd54ad9db lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x44bac02bd54ad9e2 expref: -99 pid: 17168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684441.466196:0:17159:0:(ldlm_request.c:1390:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.144@tcp lock: ffff8d66476d4200/0x44bac02bd54ad9db lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x44bac02bd54ad9e2 expref: -99 pid: 17168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788684441.466202:0:17159:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.144@tcp lock: ffff8d66476d4200/0x44bac02bd54ad9db lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x44bac02bd54ad9e2 expref: -99 pid: 17168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788684441.466217:0:17159:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:2.0:1788684441.466219:0:17159:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:2.0:1788684441.466221:0:17159:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:2.0:1788684441.466235:0:17159:0:(ldlm_request.c:1438:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.144@tcp lock: ffff8d66476d4200/0x44bac02bd54ad9db lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x44bac02bd54ad9e2 expref: -99 pid: 17168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684441.466240:0:17159:0:(ldlm_request.c:1497:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788684441.466246:0:17159:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.144@tcp lock: ffff8d66476d4200/0x44bac02bd54ad9db lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x44bac02bd54ad9e2 expref: -99 pid: 17168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684441.466252:0:17159:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.144@tcp lock: ffff8d66476d4200/0x44bac02bd54ad9db lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x44bac02bd54ad9e2 expref: -99 pid: 17168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684441.466262:0:17159:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788684441.466265:0:17159:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.144@tcp lock: ffff8d677711cc00/0x44bac02bd54ad535 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x44bac02bd54ad53c expref: -99 pid: 17902 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684441.466271:0:17159:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d677711cc00 already unused, calling callback (ffffffffc1297c20) 10000000:00010000:2.0:1788684441.466274:0:17159:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.144@tcp lock: ffff8d677711cc00/0x44bac02bd54ad535 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x44bac02bd54ad53c expref: -99 pid: 17902 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684441.466281:0:17159:0:(ldlm_request.c:1390:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.144@tcp lock: ffff8d677711cc00/0x44bac02bd54ad535 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x44bac02bd54ad53c expref: -99 pid: 17902 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788684441.466288:0:17159:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.144@tcp lock: ffff8d677711cc00/0x44bac02bd54ad535 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x44bac02bd54ad53c expref: -99 pid: 17902 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788684441.466294:0:17159:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 10000000:01000000:2.0:1788684441.466296:0:17159:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-barrier: stopping, won't requeue 10000000:01000000:2.0:1788684441.466298:0:17159:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-barrier 00010000:00010000:2.0:1788684441.466320:0:17159:0:(ldlm_request.c:1438:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.144@tcp lock: ffff8d677711cc00/0x44bac02bd54ad535 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x44bac02bd54ad53c expref: -99 pid: 17902 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684441.466326:0:17159:0:(ldlm_request.c:1497:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788684441.466330:0:17159:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.144@tcp lock: ffff8d677711cc00/0x44bac02bd54ad535 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x44bac02bd54ad53c expref: -99 pid: 17902 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684441.466337:0:17159:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.144@tcp lock: ffff8d677711cc00/0x44bac02bd54ad535 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x44bac02bd54ad53c expref: -99 pid: 17902 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684441.466349:0:17159:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788684441.466351:0:17159:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788684441.466353:0:17159:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788684441.466420:0:3624:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d664790b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c986901f-6089-4802-a23d-1179db951431:3624:1875571085892352:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788684441.466522:0:3624:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788684441.466605:0:3624:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6647908700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c986901f-6089-4802-a23d-1179db951431:3624:1875571085892864:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788684441.466629:0:3624:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788684441.466654:0:3624:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788684441.466659:0:3624:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6647909c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c986901f-6089-4802-a23d-1179db951431:3624:1875571085892736:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788684441.466679:0:3624:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788684441.466795:0:17160:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788684441.466810:0:3625:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d664790a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c986901f-6089-4802-a23d-1179db951431:3625:1875571085892480:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788684441.466844:0:3625:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788684441.466875:0:3625:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788684441.466892:0:3625:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d664790bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c986901f-6089-4802-a23d-1179db951431:3625:1875571085892608:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788684441.466918:0:3625:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788684441.466945:0:17158:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085892352 00000100:00100000:0.0:1788684441.466954:0:17158:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085892352 00000100:00100000:0.0:1788684441.466990:0:17158:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085892864 00000100:00100000:0.0:1788684441.466993:0:17158:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085892864 00000100:00100000:0.0:1788684441.467004:0:17158:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085892736 00000100:00100000:0.0:1788684441.467006:0:17158:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085892736 00000100:00100000:0.0:1788684441.467014:0:17158:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085892480 00000100:00100000:0.0:1788684441.467016:0:17158:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085892480 00000100:00100000:0.0:1788684441.467023:0:17158:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085892608 00000100:00100000:0.0:1788684441.467025:0:17158:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085892608 00000100:00100000:0.0:1788684441.467039:0:17158:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1788684441.467047:0:17158:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67450b0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0+-99:3624:x1875571085892352:12345-0@lo:103:ldlm_bl.0 00010000:00020000:0.0:1788684441.467054:0:17158:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1788684441 with bad export cookie 4952482034741859343 00000100:00100000:2.0:1788684441.470441:0:17157:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1788684441.470460:0:17157:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67450b2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0+-99:3624:x1875571085892864:12345-0@lo:103:ldlm_bl.0 00010000:00020000:2.0:1788684441.470472:0:17157:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1788684441 with bad export cookie 4952482034741859343 00000100:00100000:2.0:1788684441.470753:0:17157:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67450b2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0+-99:3624:x1875571085892864:12345-0@lo:103:ldlm_bl.0 Request processed in 294us (4121us total) trans 0 rc -107/-107 00000100:00100000:2.0:1788684441.470762:0:17157:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1788684441.470798:0:17157:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1788684441.470803:0:17157:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d677fa82680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0+-99:3624:x1875571085892736:12345-0@lo:103:ldlm_bl.0 00010000:00020000:2.0:1788684441.470830:0:17157:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1788684441 with bad export cookie 4952482034741859343 00000100:00100000:2.0:1788684441.470861:0:17157:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d677fa82680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0+-99:3624:x1875571085892736:12345-0@lo:103:ldlm_bl.0 Request processed in 57us (4181us total) trans 0 rc -107/-107 00000100:00100000:2.0:1788684441.470867:0:17157:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1788684441.470880:0:17157:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1788684441.470885:0:17157:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d677fb45180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0+-99:3625:x1875571085892480:12345-0@lo:103:ldlm_bl.0 00010000:00020000:2.0:1788684441.470889:0:17157:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1788684441 with bad export cookie 4952482034741859343 00000100:00100000:2.0:1788684441.470931:0:17157:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d677fb45180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0+-99:3625:x1875571085892480:12345-0@lo:103:ldlm_bl.0 Request processed in 45us (4086us total) trans 0 rc -107/-107 00000100:00100000:2.0:1788684441.470937:0:17157:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1788684441.470948:0:17157:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1788684441.470953:0:17157:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67771e0850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0+-99:3625:x1875571085892608:12345-0@lo:103:ldlm_bl.0 00010000:00020000:2.0:1788684441.470958:0:17157:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1788684441 with bad export cookie 4952482034741859343 00000100:00100000:2.0:1788684441.470981:0:17157:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67771e0850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0+-99:3625:x1875571085892608:12345-0@lo:103:ldlm_bl.0 Request processed in 27us (4062us total) trans 0 rc -107/-107 00000100:00100000:2.0:1788684441.470987:0:17157:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00080000:2.0:1788684441.471058:0:3624:0:(recover.c:205:ptlrpc_request_handle_notconn()) import MGC192.168.206.144@tcp of MGS@0@lo abruptly disconnected: reconnecting 00000100:00080000:2.0:1788684441.471064:0:3624:0:(import.c:65:import_set_state_nolock()) ffff8d677fc82000 MGS: changing import state from FULL to DISCONN 00000100:02020000:2.0:1788684441.471067:0:3624:0:(import.c:186:ptlrpc_set_import_discon()) MGC192.168.206.144@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail 00000100:00080000:3.0:1788684441.471282:0:20943:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID 00000100:00080000:3.0:1788684441.471291:0:20943:0:(import.c:65:import_set_state_nolock()) ffff8d677cc88800 lustre-MDT0000_UUID: changing import state from DISCONN to CLOSED 00000100:00080000:3.0:1788684441.471494:0:3625:0:(recover.c:205:ptlrpc_request_handle_notconn()) import MGC192.168.206.144@tcp of MGS@0@lo abruptly disconnected: reconnecting 00000100:00100000:1.0:1788684441.471603:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d677fb46680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3623:1875571085890176:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788684441.480664:0:17158:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67450b0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0+-99:3624:x1875571085892352:12345-0@lo:103:ldlm_bl.0 Request processed in 13602us (14127us total) trans 0 rc -107/-107 00000100:00100000:0.0:1788684441.480683:0:17158:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00080000:2.0:1788684441.488177:0:3624:0:(import.c:192:ptlrpc_set_import_discon()) import MGS@0@lo for MGC192.168.206.144@tcp not replayable, auto-deactivating 00000100:00080000:2.0:1788684441.488186:0:3624:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:2.0:1788684441.488199:0:3624:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff8d677fab4700 x1875571085890560/t0(0) o400->MGC192.168.206.144@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1788684453 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788684441.488303:0:3624:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff8d664790b800 x1875571085892352/t0(0) o103->MGC192.168.206.144@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1788684457 ref 1 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788684441.488316:0:3624:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff8d6647908700 x1875571085892864/t0(0) o103->MGC192.168.206.144@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1788684457 ref 1 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788684441.488353:0:3624:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff8d6647909c00 x1875571085892736/t0(0) o103->MGC192.168.206.144@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1788684457 ref 1 fl Rpc:RQU/200/0 rc 0/-107 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788684441.488362:0:3624:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff8d664790a300 x1875571085892480/t0(0) o103->MGC192.168.206.144@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1788684457 ref 1 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788684441.488419:0:3624:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff8d664790bb80 x1875571085892608/t0(0) o103->MGC192.168.206.144@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1788684457 ref 1 fl Rpc:RQU/200/0 rc 0/-107 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1788684441.488537:0:3625:0:(import.c:214:ptlrpc_set_import_discon()) mgc: import ffff8d677fc82000 already not connected (conn 1, was 1): DISCONN 00000100:00100000:3.0:1788684441.488583:0:3625:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d664790a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c986901f-6089-4802-a23d-1179db951431:3625:1875571085892480:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788684441.488623:0:3625:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d664790bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:c986901f-6089-4802-a23d-1179db951431:3625:1875571085892608:0@lo:103:ldlm_bl.0 00000100:00080000:3.0:1788684441.488738:0:20943:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:3.0:1788684441.488744:0:20943:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 8589934593 gen 3 00000004:00080000:3.0:1788684441.488772:0:20943:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:3.0:1788684441.488854:0:20943:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID 00000100:00080000:3.0:1788684441.488890:0:20943:0:(import.c:65:import_set_state_nolock()) ffff8d664773f000 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 00000100:00080000:3.0:1788684441.488921:0:20943:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:3.0:1788684441.488923:0:20943:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 8589934594 gen 3 00000004:00080000:3.0:1788684441.488932:0:20943:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:3.0:1788684441.488992:0:20943:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID 00000100:00080000:3.0:1788684441.489001:0:20943:0:(import.c:65:import_set_state_nolock()) ffff8d6775fa6000 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00000020:00080000:3.0:1788684441.489047:0:20943:0:(genops.c:1558:class_disconnect_exports()) OBD device 14 (ffff8d677721cd40) has no exports 10000000:01000000:2.0:1788684441.489337:0:3624:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:2.0:1788684441.489342:0:3624:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:2.0:1788684441.489343:0:3624:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:2.0:1788684441.489347:0:3624:0:(import.c:65:import_set_state_nolock()) ffff8d677fc82000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788684441.489352:0:3624:0:(import.c:545:import_select_connection()) MGC192.168.206.144@tcp: connect to NID 0@lo last attempt 425 00000100:00080000:2.0:1788684441.489362:0:3624:0:(import.c:665:import_select_connection()) MGC192.168.206.144@tcp: import ffff8d677fc82000 using connection 192.168.206.144@tcp/0@lo 00000100:00100000:2.0:1788684441.489426:0:3624:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8d677fa82300 x1875571085893248/t0(0) o250->MGC192.168.206.144@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788684441.489453:0:3624:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d664790b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c986901f-6089-4802-a23d-1179db951431:3624:1875571085892352:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788684441.489462:0:3624:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6647908700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c986901f-6089-4802-a23d-1179db951431:3624:1875571085892864:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788684441.489482:0:3624:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6647909c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:c986901f-6089-4802-a23d-1179db951431:3624:1875571085892736:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788684441.489999:0:3626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d677fab4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:c986901f-6089-4802-a23d-1179db951431:3626:1875571085890560:0@lo:400:kworker.0 00000100:00100000:1.0:1788684441.490032:0:3622:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d664790bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3622:1875571085892992:0@lo:9:umount.0 00000100:00100000:1.0:1788684441.490133:0:3622:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788684441.490185:0:3622:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d664790a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3622:1875571085893120:0@lo:9:umount.0 00000100:00100000:1.0:1788684441.490211:0:3622:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788684441.490240:0:3622:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d677fa82300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c986901f-6089-4802-a23d-1179db951431:3622:1875571085893248:0@lo:250:ptlrpcd_00_01.0 00000400:00000100:1.0:1788684441.490261:0:3622:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1875571085893248 offset 0 length 520: 4 00000100:00100000:3.0:1788684441.490336:0:18679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085892992 00000100:00100000:3.0:1788684441.490348:0:18679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085892992 00000100:00100000:3.0:1788684441.490438:0:18679:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085893120 00000100:00100000:3.0:1788684441.490441:0:18679:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085893120 00000100:00100000:3.0:1788684441.490477:0:18679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1788684441.490487:0:18679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d674698d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3622:x1875571085892992:12345-0@lo:9:umount.0 00000020:00000080:3.0:1788684441.490532:0:18679:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x44bac02bd54ad6ee 00000100:00080000:3.0:1788684441.490554:0:18679:0:(import.c:65:import_set_state_nolock()) ffff8d664740c800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1788684441.490602:0:18679:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 8589934594 00000100:00100000:3.0:1788684441.490789:0:18679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d674698d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+2:3622:x1875571085892992:12345-0@lo:9:umount.0 Request processed in 302us (656us total) trans 0 rc 0/0 00000100:00100000:3.0:1788684441.490798:0:18679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1788684441.490815:0:18679:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1788684441.490822:0:18679:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d674698d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3622:x1875571085893120:12345-0@lo:9:umount.0 00000020:00000080:3.0:1788684441.490836:0:18679:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x44bac02bd54ad77a 00000100:00080000:3.0:1788684441.490843:0:18679:0:(import.c:65:import_set_state_nolock()) ffff8d6646cc2000 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1788684441.490877:0:18679:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 8589934600 00000100:00100000:3.0:1788684441.490962:0:18679:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d674698d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+2:3622:x1875571085893120:12345-0@lo:9:umount.0 Request processed in 141us (750us total) trans 0 rc 0/0 00000100:00100000:3.0:1788684441.490970:0:18679:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00080000:3.0:1788684441.490992:0:17166:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:3.0:1788684441.491020:0:17160:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1788684441.491178:0:3622:0:(import.c:65:import_set_state_nolock()) ffff8d664773f000 lustre-OST0000_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:1.0:1788684441.491197:0:3622:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:1.0:1788684441.491208:0:3622:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1788684441.491212:0:3622:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d664790bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3622:1875571085892992:0@lo:9:umount.0 00000100:00080000:1.0:1788684441.491227:0:3622:0:(import.c:65:import_set_state_nolock()) ffff8d6775fa6000 lustre-OST0001_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:1.0:1788684441.491237:0:3622:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:1.0:1788684441.491239:0:3622:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1788684441.491241:0:3622:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d664790a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3622:1875571085893120:0@lo:9:umount.0 00010000:00010000:2.0:1788684441.491338:0:17159:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:1.0:1788684441.499005:0:20943:0:(genops.c:1558:class_disconnect_exports()) OBD device 14 (ffff8d677721cd40) has no exports 00000020:01000000:0.0:1788684441.572942:0:20943:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8d6647a15a80 - data ffff8d6645ce2870/ffff8d6746cac400 00000020:01000000:2.0:1788684441.573351:0:20943:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8d6746e813c0 - data ffff8d6645c851b0/ffff8d6746db7c00 00000001:00000004:2.0:1788684441.604644:0:20943:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 2, last_transno is 8589934595 00000100:00080000:3.0:1788684441.697683:0:20943:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1788684441.697694:0:20943:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 0 gen 4 00000100:00100000:3.0:1788684441.697703:0:20943:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00080000:1.0:1788684441.719765:0:20943:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:1.0:1788684441.719778:0:20943:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 8589934593 gen 4 00000004:00080000:1.0:1788684441.719812:0:20943:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1788684441.719816:0:20943:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:0.0:1788684441.720822:0:17911:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:0.0:1788684441.720830:0:17911:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 1 count 1 00000040:00080000:0.0:1788684441.720844:0:17911:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x2:0x0] index 2 count 2 00000100:00080000:1.0:1788684441.721577:0:20943:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:1.0:1788684441.721583:0:20943:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 8589934594 gen 4 00000004:00080000:1.0:1788684441.721610:0:20943:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1788684441.721613:0:20943:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:3.0:1788684441.722745:0:17914:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:3.0:1788684441.722753:0:17914:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xa:0x0] index 1 count 1 00000040:00080000:3.0:1788684441.722769:0:17914:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x5:0x0] index 2 count 2 00000020:00000080:1.0:1788684441.724254:0:20943:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x44bac02bd54ad558 00000020:00000080:1.0:1788684441.724269:0:20943:0:(genops.c:885:class_export_put()) final put ffff8d677cf27000/lustre-MDT0001-osd_UUID 00000020:00000080:1.0:1788684441.725050:0:20943:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x44bac02bd54ad56d 00000020:00000080:1.0:1788684441.725060:0:20943:0:(genops.c:885:class_export_put()) final put ffff8d664773e800/lustre-MDT0001-mdtlov_UUID 00000020:01000000:1.0:1788684441.725067:0:20943:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-mdtlov (flags='') 00000020:00000080:1.0:1788684441.725073:0:20943:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788684441.725083:0:20943:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-mdtlov: forcing exports to disconnect: 0/2 00000020:00080000:1.0:1788684441.725089:0:20943:0:(genops.c:1558:class_disconnect_exports()) OBD device 13 (ffff8d6777218000) has no exports 00000004:01000000:1.0:1788684441.725279:0:20943:0:(lod_lov.c:59:lod_putref()) destroying 2 ltd desc 00000020:00000080:1.0:1788684441.725289:0:20943:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x44bac02bd54ad5c1 00000020:00000080:1.0:1788684441.725294:0:20943:0:(genops.c:885:class_export_put()) final put ffff8d6775fa1000/lustre-MDT0001-mdtlov_UUID 00000020:01000000:1.0:1788684441.725298:0:20943:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osc-MDT0001 (flags='') 00000020:00000080:1.0:1788684441.725302:0:20943:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788684441.725307:0:20943:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osc-MDT0001: forcing exports to disconnect: 0/3 00000020:00080000:1.0:1788684441.725310:0:20943:0:(genops.c:1558:class_disconnect_exports()) OBD device 18 (ffff8d6746c00000) has no exports 00000020:00000080:1.0:1788684441.725316:0:20943:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x44bac02bd54ad5ba 00000020:00000080:1.0:1788684441.725319:0:20943:0:(genops.c:885:class_export_put()) final put ffff8d6775fa3800/lustre-MDT0001-osd_UUID 00010000:01000000:1.0:1788684441.725741:0:20943:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0001-osc-MDT0001: client import never connected 00000100:00080000:1.0:1788684441.725747:0:20943:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:1.0:1788684441.725752:0:20943:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 8589934594 gen 5 00000004:00080000:1.0:1788684441.725759:0:20943:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1788684441.725762:0:20943:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1788684441.725794:0:20943:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788684441.725802:0:20943:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:1.0:1788684441.725808:0:20943:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x44bac02bd54ad5ac 00000020:00000080:1.0:1788684441.725814:0:20943:0:(genops.c:885:class_export_put()) final put ffff8d664773a000/lustre-MDT0001-mdtlov_UUID 00000020:01000000:1.0:1788684441.725818:0:20943:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osc-MDT0001 (flags='') 00000020:00000080:1.0:1788684441.725822:0:20943:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788684441.725825:0:20943:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osc-MDT0001: forcing exports to disconnect: 0/3 00000020:00080000:1.0:1788684441.725828:0:20943:0:(genops.c:1558:class_disconnect_exports()) OBD device 17 (ffff8d6746c019c0) has no exports 00000020:00000080:1.0:1788684441.725832:0:20943:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x44bac02bd54ad59e 00000020:00000080:1.0:1788684441.725835:0:20943:0:(genops.c:885:class_export_put()) final put ffff8d664773c000/lustre-MDT0001-osd_UUID 00010000:01000000:1.0:1788684441.726183:0:20943:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0000-osc-MDT0001: client import never connected 00000100:00080000:1.0:1788684441.726188:0:20943:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:1.0:1788684441.726190:0:20943:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 8589934593 gen 5 00000004:00080000:1.0:1788684441.726194:0:20943:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1788684441.726196:0:20943:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1788684441.726220:0:20943:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788684441.726224:0:20943:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000004:01000000:1.0:1788684441.726234:0:20943:0:(lod_lov.c:59:lod_putref()) destroying 1 ltd desc 00000020:00000080:1.0:1788684441.726240:0:20943:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x44bac02bd54ad590 00000020:00000080:1.0:1788684441.726245:0:20943:0:(genops.c:885:class_export_put()) final put ffff8d664773d000/lustre-MDT0001-mdtlov_UUID 00000020:01000000:1.0:1788684441.726249:0:20943:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-osp-MDT0001 (flags='F') 00000020:00000080:1.0:1788684441.726253:0:20943:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788684441.726256:0:20943:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-osp-MDT0001: forcing exports to disconnect: 0/3 00000020:00080000:1.0:1788684441.726259:0:20943:0:(genops.c:1558:class_disconnect_exports()) OBD device 16 (ffff8d677e3ecd40) has no exports 00000020:00000080:1.0:1788684441.726263:0:20943:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x44bac02bd54ad589 00000020:00000080:1.0:1788684441.726265:0:20943:0:(genops.c:885:class_export_put()) final put ffff8d677cf27800/lustre-MDT0001-osd_UUID 00000020:00000080:3.0:1788684441.727408:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff8d677cf27000/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:3.0:1788684441.727429:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff8d664773e800/lustre-MDT0001-mdtlov_UUID for lustre-MDT0001-mdtlov 00000020:00000080:3.0:1788684441.727436:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff8d6775fa1000/lustre-MDT0001-mdtlov_UUID for lustre-OST0001-osc-MDT0001 00000020:00000080:3.0:1788684441.727442:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff8d6775fa3800/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:3.0:1788684441.727449:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8d6775fa6000 for lustre-OST0001-osc-MDT0001 00000020:00000080:3.0:1788684441.727478:0:38:0:(genops.c:885:class_export_put()) final put ffff8d664773b000/lustre-MDT0001-mdtlov_UUID 00000020:00000080:3.0:1788684441.727481:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff8d664773b000/lustre-MDT0001-mdtlov_UUID for lustre-OST0001-osc-MDT0001 00000020:01000000:3.0:1788684441.727487:0:38:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osc-MDT0001 (lustre-MDT0001-mdtlov_UUID) 00000020:00000080:3.0:1788684441.727608:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff8d664773a000/lustre-MDT0001-mdtlov_UUID for lustre-OST0000-osc-MDT0001 00000020:00000080:3.0:1788684441.727614:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff8d664773c000/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:3.0:1788684441.727618:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8d664773f000 for lustre-OST0000-osc-MDT0001 00000020:00000080:3.0:1788684441.727622:0:38:0:(genops.c:885:class_export_put()) final put ffff8d664773d800/lustre-MDT0001-mdtlov_UUID 00000020:00000080:3.0:1788684441.727624:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff8d664773d800/lustre-MDT0001-mdtlov_UUID for lustre-OST0000-osc-MDT0001 00000020:01000000:3.0:1788684441.727628:0:38:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osc-MDT0001 (lustre-MDT0001-mdtlov_UUID) 00000020:00000080:3.0:1788684441.727657:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff8d664773d000/lustre-MDT0001-mdtlov_UUID for lustre-MDT0000-osp-MDT0001 00000020:00000080:3.0:1788684441.727663:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff8d677cf27800/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00010000:01000000:1.0:1788684441.802517:0:20943:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-osp-MDT0001: client import never connected 00000100:00080000:1.0:1788684441.802556:0:20943:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1788684441.802562:0:20943:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 0 gen 5 00000100:00100000:1.0:1788684441.802572:0:20943:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1788684441.802754:0:20943:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788684441.802769:0:20943:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-osp-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:1.0:1788684441.802876:0:20943:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788684441.802881:0:20943:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-mdtlov (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:1.0:1788684441.802889:0:20943:0:(genops.c:885:class_export_put()) final put ffff8d674831f000/lustre-MDT0001-mdtlov_UUID 00000020:00000080:1.0:1788684441.802895:0:20943:0:(genops.c:844:class_export_destroy()) destroying export ffff8d674831f000/lustre-MDT0001-mdtlov_UUID for lustre-MDT0001-mdtlov 00000020:01000000:1.0:1788684441.802908:0:20943:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-mdtlov (lustre-MDT0001-mdtlov_UUID) 00000020:00000080:1.0:1788684441.803171:0:20943:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x44bac02bd54ad574 00000020:00000080:1.0:1788684441.803181:0:20943:0:(genops.c:885:class_export_put()) final put ffff8d6647738000/lustre-MDD0001_UUID 00000020:00000080:3.0:1788684441.803606:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8d677cc88800 for lustre-MDT0000-osp-MDT0001 00000020:00000080:3.0:1788684441.803615:0:38:0:(genops.c:885:class_export_put()) final put ffff8d6758ee3000/lustre-MDT0001-mdtlov_UUID 00000020:00000080:3.0:1788684441.803618:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff8d6758ee3000/lustre-MDT0001-mdtlov_UUID for lustre-MDT0000-osp-MDT0001 00000020:01000000:3.0:1788684441.803627:0:38:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-osp-MDT0001 (lustre-MDT0001-mdtlov_UUID) 00000020:01000000:1.0:1788684441.803922:0:20943:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDD0001 (flags='') 00000020:00000080:3.0:1788684441.804007:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff8d6647738000/lustre-MDD0001_UUID for lustre-MDD0001 00000020:00000080:0.0:1788684441.804573:0:20943:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788684441.804586:0:20943:0:(obd_config.c:956:class_cleanup()) lustre-MDD0001: forcing exports to disconnect: 0/1 00000020:00080000:0.0:1788684441.804592:0:20943:0:(genops.c:1558:class_disconnect_exports()) OBD device 15 (ffff8d67772199c0) has no exports 00000020:00000080:0.0:1788684441.804688:0:20943:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788684441.804695:0:20943:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDD0001 (uuid lustre-MDD0001_UUID) 00000020:00000080:0.0:1788684441.804699:0:20943:0:(genops.c:885:class_export_put()) final put ffff8d6748318800/lustre-MDD0001_UUID 00000020:00000080:0.0:1788684441.804702:0:20943:0:(genops.c:844:class_export_destroy()) destroying export ffff8d6748318800/lustre-MDD0001_UUID for lustre-MDD0001 00000020:01000000:0.0:1788684441.804712:0:20943:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDD0001 (lustre-MDD0001_UUID) 00000020:00000080:0.0:1788684441.804968:0:20943:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x44bac02bd54ad57b 00000020:00000080:0.0:1788684441.804987:0:20943:0:(genops.c:885:class_export_put()) final put ffff8d664773f800/lustre-MDT0001-osd_UUID 00000020:01000004:0.0:1788684441.805050:0:20943:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8d678003e800 from lustre-MDT0001, refs=2 00000020:01000004:0.0:1788684441.805054:0:20943:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8d678003e800 2 00000020:01000004:0.0:1788684441.805065:0:20943:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff8d678003e800 from lustre-MDT0001 00000020:00000080:0.0:1788684441.805090:0:20943:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788684441.805095:0:20943:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001 (uuid lustre-MDT0001_UUID) 00000020:00000080:0.0:1788684441.805098:0:20943:0:(genops.c:885:class_export_put()) final put ffff8d677cf23000/lustre-MDT0001_UUID 00000020:00000080:0.0:1788684441.805101:0:20943:0:(genops.c:844:class_export_destroy()) destroying export ffff8d677cf23000/lustre-MDT0001_UUID for lustre-MDT0001 00000020:01000000:0.0:1788684441.805109:0:20943:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001 (lustre-MDT0001_UUID) 00000020:01000004:0.0:1788684441.805138:0:20943:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 2 references. 00000020:01000000:0.0:1788684441.805144:0:20943:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-MDT0001 (flags='F') 00000020:00000080:0.0:1788684441.805147:0:20943:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788684441.805152:0:20943:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-MDT0001: forcing exports to disconnect: 1/3 00000020:00080000:0.0:1788684441.805160:0:20943:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-MDT0001: ACTIVE ffff8d677cc6e000 lustre-MDT0000-lwp-MDT0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1788684441.805165:0:20943:0:(genops.c:1553:class_disconnect_exports()) OBD device 19 (ffff8d677e1419c0) has exports, disconnecting them 00000020:00080000:0.0:1788684441.805171:0:20943:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-MDT0001: disconnecting export at 0@lo (ffff8d677cc6e000), last request at 1788684358 00000020:00000080:0.0:1788684441.805175:0:20943:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x44bac02bd54ad5f9 00000020:00080000:0.0:1788684441.805189:0:20943:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff8d677cc6e000): rc 0 00000020:00000080:0.0:1788684441.805193:0:20943:0:(genops.c:885:class_export_put()) final put ffff8d677cc6e000/lustre-MDT0000-lwp-MDT0001 00000020:00000080:3.0:1788684441.805795:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff8d664773f800/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:3.0:1788684441.807188:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff8d677cc6e000/lustre-MDT0000-lwp-MDT0001 for lustre-MDT0000-lwp-MDT0001 00010000:01000000:1.0:1788684441.810715:0:20943:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-MDT0001: client import never connected 00000100:00080000:1.0:1788684441.810726:0:20943:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1788684441.810733:0:20943:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 5 00000100:00100000:1.0:1788684441.810742:0:20943:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1788684441.810993:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8d6646494000 for lustre-MDT0000-lwp-MDT0001 00000020:00000080:3.0:1788684441.811261:0:20943:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788684441.811274:0:20943:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-MDT0001 (uuid lustre-MDT0000-lwp-MDT0001_UUID) 00000020:00000080:3.0:1788684441.811280:0:20943:0:(genops.c:885:class_export_put()) final put ffff8d67488ec800/lustre-MDT0000-lwp-MDT0001_UUID 00000020:00000080:3.0:1788684441.811289:0:20943:0:(genops.c:844:class_export_destroy()) destroying export ffff8d67488ec800/lustre-MDT0000-lwp-MDT0001_UUID for lustre-MDT0000-lwp-MDT0001 00000020:01000000:3.0:1788684441.811296:0:20943:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-MDT0001 (lustre-MDT0000-lwp-MDT0001_UUID) 00000020:01000004:3.0:1788684441.811429:0:20943:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8d678003e800 1 00000020:00000080:3.0:1788684441.811440:0:20943:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x44bac02bd54ad520 00000020:00000080:3.0:1788684441.811448:0:20943:0:(genops.c:885:class_export_put()) final put ffff8d6775ee7800/lustre-MDT0001-osd_UUID 00000020:01000000:3.0:1788684441.811504:0:20943:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-osd (flags='') 00000020:00000080:3.0:1788684441.811510:0:20943:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788684441.811515:0:20943:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-osd: forcing exports to disconnect: 0/2 00000020:00080000:3.0:1788684441.811520:0:20943:0:(genops.c:1558:class_disconnect_exports()) OBD device 12 (ffff8d677e143380) has no exports 00000020:00000080:1.0:1788684441.811616:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff8d6775ee7800/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:0.0:1788684441.944615:0:20943:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788684441.944633:0:20943:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-osd (uuid lustre-MDT0001-osd_UUID) 00000020:00000080:0.0:1788684441.944639:0:20943:0:(genops.c:885:class_export_put()) final put ffff8d678003a800/lustre-MDT0001-osd_UUID 00000020:00000080:0.0:1788684441.944644:0:20943:0:(genops.c:844:class_export_destroy()) destroying export ffff8d678003a800/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:01000000:0.0:1788684441.944656:0:20943:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-osd (lustre-MDT0001-osd_UUID) 00000020:01000004:0.0:1788684441.944790:0:20943:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff8d678003e000 00000020:01000000:0.0:1788684441.944812:0:20943:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MDS (flags='F') 00000020:00000080:0.0:1788684441.944816:0:20943:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788684441.944821:0:20943:0:(obd_config.c:956:class_cleanup()) MDS: forcing exports to disconnect: 0/1 00000020:00080000:0.0:1788684441.944825:0:20943:0:(genops.c:1558:class_disconnect_exports()) OBD device 3 (ffff8d66474319c0) has no exports 00000100:00100000:2.0:1788684441.945925:0:18403:0:(service.c:3183:ptlrpc_main()) mdt00_003: service thread [ffff8d675ebca200:18403] 3 exiting: rc = 0 00000100:00100000:0.0:1788684441.952894:0:17171:0:(service.c:3183:ptlrpc_main()) mdt00_000: service thread [ffff8d677e10ee00:17171] 0 exiting: rc = 1 00000100:00100000:0.0:1788684441.952984:0:17172:0:(service.c:3183:ptlrpc_main()) mdt00_001: service thread [ffff8d677e10e800:17172] 1 exiting: rc = 0 00000100:00100000:1.0:1788684441.957036:0:17173:0:(service.c:3183:ptlrpc_main()) mdt00_002: service thread [ffff8d677e10f400:17173] 2 exiting: rc = 0 00000100:00100000:2.0:1788684441.961835:0:20943:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788684441.961845:0:20943:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788684441.961850:0:20943:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788684441.961855:0:20943:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788684441.961860:0:20943:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788684441.961883:0:20943:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788684441.961889:0:20943:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788684441.961895:0:20943:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788684441.961901:0:20943:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788684441.961906:0:20943:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788684441.961912:0:20943:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788684441.961917:0:20943:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788684441.961922:0:20943:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788684441.961927:0:20943:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788684441.961933:0:20943:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788684441.961938:0:20943:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788684441.961944:0:20943:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788684441.961949:0:20943:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788684441.961955:0:20943:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788684441.961960:0:20943:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788684441.961965:0:20943:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788684441.961971:0:20943:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788684441.961976:0:20943:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788684441.961983:0:20943:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788684441.961990:0:20943:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788684441.961997:0:20943:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788684441.962003:0:20943:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788684441.962008:0:20943:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788684441.962014:0:20943:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788684441.962020:0:20943:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788684441.962025:0:20943:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788684441.962031:0:20943:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788684441.962037:0:20943:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788684441.962043:0:20943:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788684441.962049:0:20943:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788684441.962055:0:20943:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788684441.962061:0:20943:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788684441.962067:0:20943:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788684441.962073:0:20943:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788684441.962079:0:20943:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788684441.962092:0:20943:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788684441.962098:0:20943:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788684441.962104:0:20943:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788684441.962110:0:20943:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788684441.962115:0:20943:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788684441.962121:0:20943:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788684441.962126:0:20943:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788684441.962132:0:20943:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788684441.962137:0:20943:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788684441.962142:0:20943:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788684441.962148:0:20943:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788684441.962153:0:20943:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788684441.962158:0:20943:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788684441.962163:0:20943:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788684441.962169:0:20943:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788684441.962175:0:20943:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788684441.962181:0:20943:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788684441.962186:0:20943:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788684441.962192:0:20943:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788684441.962198:0:20943:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788684441.962204:0:20943:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788684441.962211:0:20943:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788684441.962216:0:20943:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788684441.962222:0:20943:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788684441.971975:0:17174:0:(service.c:3183:ptlrpc_main()) mdt_rdpg00_000: service thread [ffff8d677e10f600:17174] 0 exiting: rc = 1 00000100:00100000:1.0:1788684441.972221:0:17175:0:(service.c:3183:ptlrpc_main()) mdt_rdpg00_001: service thread [ffff8d677e10ea00:17175] 1 exiting: rc = 0 00000100:00100000:2.0:1788684441.972328:0:20943:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788684441.972337:0:20943:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788684441.972343:0:20943:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788684441.972348:0:20943:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788684441.972355:0:20943:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788684441.972360:0:20943:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788684441.972397:0:20943:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788684441.972404:0:20943:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788684441.972410:0:20943:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788684441.972416:0:20943:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788684441.972436:0:20943:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788684441.972442:0:20943:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788684441.972448:0:20943:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788684441.972453:0:20943:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788684441.972458:0:20943:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788684441.972463:0:20943:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788684441.972470:0:20943:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788684441.972476:0:20943:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788684441.972481:0:20943:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788684441.972485:0:20943:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788684441.972490:0:20943:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788684441.972495:0:20943:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788684441.972500:0:20943:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788684441.972505:0:20943:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788684441.972511:0:20943:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788684441.972515:0:20943:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788684441.972520:0:20943:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788684441.972524:0:20943:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788684441.972531:0:20943:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788684441.972537:0:20943:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788684441.972554:0:20943:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788684441.972559:0:20943:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788684441.972564:0:20943:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788684441.972570:0:20943:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788684441.972576:0:20943:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788684441.972580:0:20943:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788684441.972586:0:20943:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788684441.972592:0:20943:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788684441.972597:0:20943:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788684441.972601:0:20943:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788684441.972606:0:20943:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788684441.972611:0:20943:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788684441.972617:0:20943:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788684441.972622:0:20943:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788684441.972627:0:20943:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788684441.972640:0:20943:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788684441.972645:0:20943:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788684441.972650:0:20943:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788684441.972655:0:20943:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788684441.972661:0:20943:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788684441.972666:0:20943:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788684441.972671:0:20943:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788684441.972676:0:20943:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788684441.972682:0:20943:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788684441.972687:0:20943:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788684441.972693:0:20943:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788684441.972698:0:20943:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788684441.972703:0:20943:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788684441.972708:0:20943:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788684441.972714:0:20943:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788684441.972720:0:20943:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788684441.972726:0:20943:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788684441.972731:0:20943:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788684441.972736:0:20943:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788684441.973181:0:17912:0:(service.c:3183:ptlrpc_main()) mdt_out00_002: service thread [ffff8d6750b60200:17912] 2 exiting: rc = 0 00000100:00100000:0.0:1788684441.973579:0:17177:0:(service.c:3183:ptlrpc_main()) mdt_out00_001: service thread [ffff8d67801a7e00:17177] 1 exiting: rc = 0 00000100:00100000:1.0:1788684441.974282:0:17176:0:(service.c:3183:ptlrpc_main()) mdt_out00_000: service thread [ffff8d67801a6e00:17176] 0 exiting: rc = 1 00000100:00100000:2.0:1788684441.974487:0:20943:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788684441.974497:0:20943:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788684441.974503:0:20943:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788684441.974510:0:20943:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788684441.974516:0:20943:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788684441.974522:0:20943:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788684441.974528:0:20943:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788684441.974533:0:20943:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788684441.974553:0:20943:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788684441.974559:0:20943:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788684441.974565:0:20943:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788684441.974570:0:20943:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788684441.974592:0:20943:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788684441.974599:0:20943:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788684441.974606:0:20943:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788684441.974625:0:20943:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788684441.974631:0:20943:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788684441.974638:0:20943:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788684441.974643:0:20943:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788684441.974649:0:20943:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788684441.974655:0:20943:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788684441.974663:0:20943:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788684441.974670:0:20943:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788684441.974677:0:20943:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788684441.974696:0:20943:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788684441.974703:0:20943:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788684441.974709:0:20943:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788684441.974715:0:20943:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788684441.974722:0:20943:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788684441.974728:0:20943:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788684441.974734:0:20943:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788684441.974740:0:20943:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788684441.974745:0:20943:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788684441.974751:0:20943:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788684441.974758:0:20943:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788684441.974764:0:20943:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788684441.974782:0:20943:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788684441.974789:0:20943:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788684441.974795:0:20943:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788684441.974802:0:20943:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788684441.974809:0:20943:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788684441.974816:0:20943:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788684441.974825:0:20943:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788684441.974831:0:20943:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788684441.974837:0:20943:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788684441.974842:0:20943:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788684441.974847:0:20943:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788684441.974853:0:20943:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788684441.974873:0:20943:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788684441.974881:0:20943:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788684441.974893:0:20943:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788684441.974900:0:20943:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788684441.974906:0:20943:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788684441.974912:0:20943:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788684441.974918:0:20943:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788684441.974924:0:20943:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788684441.974930:0:20943:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788684441.974937:0:20943:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788684441.974943:0:20943:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788684441.974949:0:20943:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788684441.974968:0:20943:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788684441.974976:0:20943:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788684441.974982:0:20943:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788684441.974988:0:20943:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788684441.993285:0:17178:0:(service.c:3183:ptlrpc_main()) mdt_seqs_0000: service thread [ffff8d67801a7000:17178] 0 exiting: rc = 1 00000100:00100000:2.0:1788684441.997953:0:17179:0:(service.c:3183:ptlrpc_main()) mdt_seqs_0001: service thread [ffff8d67801a7800:17179] 1 exiting: rc = 0 00000100:00100000:3.0:1788684441.998081:0:20943:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788684441.998089:0:20943:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788684441.998094:0:20943:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788684441.998100:0:20943:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788684441.998106:0:20943:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788684441.998111:0:20943:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788684441.998116:0:20943:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788684441.998122:0:20943:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788684441.998127:0:20943:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788684441.998133:0:20943:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788684441.998138:0:20943:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788684441.998144:0:20943:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788684441.998150:0:20943:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788684441.998155:0:20943:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788684441.998161:0:20943:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788684441.998166:0:20943:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788684441.998171:0:20943:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788684441.998177:0:20943:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788684441.998182:0:20943:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788684441.998187:0:20943:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788684441.998193:0:20943:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788684441.998199:0:20943:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788684441.998204:0:20943:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788684441.998209:0:20943:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788684441.998215:0:20943:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788684441.998220:0:20943:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788684441.998225:0:20943:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788684441.998230:0:20943:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788684441.998235:0:20943:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788684441.998240:0:20943:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788684441.998246:0:20943:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788684441.998266:0:20943:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788684441.998271:0:20943:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788684441.998276:0:20943:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788684441.998281:0:20943:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788684441.998286:0:20943:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788684441.998291:0:20943:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788684441.998295:0:20943:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788684441.998299:0:20943:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788684441.998303:0:20943:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788684441.998308:0:20943:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788684441.998326:0:20943:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788684441.998333:0:20943:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788684441.998338:0:20943:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788684441.998343:0:20943:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788684441.998347:0:20943:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788684441.998353:0:20943:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788684441.998357:0:20943:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788684441.998361:0:20943:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788684441.998409:0:20943:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788684441.998415:0:20943:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788684441.998420:0:20943:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788684441.998425:0:20943:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788684441.998430:0:20943:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788684441.998435:0:20943:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788684441.998440:0:20943:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788684441.998444:0:20943:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788684441.998449:0:20943:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788684441.998454:0:20943:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788684441.998459:0:20943:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788684441.998464:0:20943:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788684441.998469:0:20943:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788684441.998474:0:20943:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788684441.998480:0:20943:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788684441.998862:0:17181:0:(service.c:3183:ptlrpc_main()) mdt_seqm_0001: service thread [ffff8d675288b800:17181] 1 exiting: rc = 0 00000100:00100000:1.0:1788684441.999122:0:17180:0:(service.c:3183:ptlrpc_main()) mdt_seqm_0000: service thread [ffff8d67450e5000:17180] 0 exiting: rc = 1 00000100:00100000:3.0:1788684441.999234:0:20943:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788684441.999241:0:20943:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788684441.999253:0:20943:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788684441.999259:0:20943:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788684441.999264:0:20943:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788684441.999270:0:20943:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788684441.999275:0:20943:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788684441.999280:0:20943:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788684441.999287:0:20943:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788684441.999292:0:20943:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788684441.999298:0:20943:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788684441.999304:0:20943:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788684441.999309:0:20943:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788684441.999314:0:20943:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788684441.999319:0:20943:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788684441.999325:0:20943:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788684441.999330:0:20943:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788684441.999336:0:20943:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788684441.999341:0:20943:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788684441.999346:0:20943:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788684441.999351:0:20943:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788684441.999357:0:20943:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788684441.999362:0:20943:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788684441.999392:0:20943:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788684441.999398:0:20943:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788684441.999404:0:20943:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788684441.999408:0:20943:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788684441.999413:0:20943:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788684441.999419:0:20943:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788684441.999424:0:20943:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788684441.999429:0:20943:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788684441.999434:0:20943:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788684441.999439:0:20943:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788684441.999444:0:20943:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788684441.999449:0:20943:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788684441.999453:0:20943:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788684441.999459:0:20943:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788684441.999471:0:20943:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788684441.999477:0:20943:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788684441.999482:0:20943:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788684441.999487:0:20943:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788684441.999492:0:20943:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788684441.999497:0:20943:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788684441.999501:0:20943:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788684441.999506:0:20943:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788684441.999511:0:20943:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788684441.999516:0:20943:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788684441.999522:0:20943:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788684441.999526:0:20943:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788684441.999531:0:20943:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788684441.999537:0:20943:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788684441.999553:0:20943:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788684441.999558:0:20943:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788684441.999564:0:20943:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788684441.999570:0:20943:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788684441.999575:0:20943:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788684441.999580:0:20943:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788684441.999585:0:20943:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788684441.999590:0:20943:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788684441.999595:0:20943:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788684441.999601:0:20943:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788684441.999607:0:20943:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788684441.999612:0:20943:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788684441.999617:0:20943:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788684442.000014:0:17183:0:(service.c:3183:ptlrpc_main()) mdt_fld_0001: service thread [ffff8d675288ba00:17183] 1 exiting: rc = 0 00000100:00100000:0.0:1788684442.000512:0:17182:0:(service.c:3183:ptlrpc_main()) mdt_fld_0000: service thread [ffff8d675288a200:17182] 0 exiting: rc = 1 00000100:00100000:3.0:1788684442.000609:0:20943:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788684442.000615:0:20943:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788684442.000619:0:20943:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788684442.000625:0:20943:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788684442.000630:0:20943:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788684442.000635:0:20943:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788684442.000640:0:20943:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788684442.000645:0:20943:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788684442.000664:0:20943:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788684442.000669:0:20943:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788684442.000674:0:20943:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788684442.000680:0:20943:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788684442.000686:0:20943:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788684442.000691:0:20943:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788684442.000696:0:20943:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788684442.000702:0:20943:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788684442.000707:0:20943:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788684442.000712:0:20943:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788684442.000717:0:20943:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788684442.000721:0:20943:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788684442.000726:0:20943:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788684442.000732:0:20943:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788684442.000736:0:20943:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788684442.000741:0:20943:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788684442.000747:0:20943:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788684442.000752:0:20943:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788684442.000756:0:20943:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788684442.000761:0:20943:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788684442.000766:0:20943:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788684442.000771:0:20943:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788684442.000777:0:20943:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788684442.000783:0:20943:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788684442.000788:0:20943:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788684442.000794:0:20943:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788684442.000798:0:20943:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788684442.000803:0:20943:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788684442.000808:0:20943:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788684442.000812:0:20943:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788684442.000817:0:20943:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788684442.000822:0:20943:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788684442.000828:0:20943:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788684442.000834:0:20943:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788684442.000839:0:20943:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788684442.000850:0:20943:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788684442.000856:0:20943:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788684442.000861:0:20943:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788684442.000866:0:20943:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788684442.000871:0:20943:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788684442.000876:0:20943:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788684442.000882:0:20943:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788684442.000886:0:20943:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788684442.000891:0:20943:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788684442.000897:0:20943:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788684442.000902:0:20943:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788684442.000907:0:20943:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788684442.000913:0:20943:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788684442.000918:0:20943:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788684442.000923:0:20943:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788684442.000928:0:20943:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788684442.000933:0:20943:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788684442.000939:0:20943:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788684442.000943:0:20943:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788684442.000948:0:20943:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788684442.000953:0:20943:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788684442.001476:0:17185:0:(service.c:3183:ptlrpc_main()) mdt_io00_001: service thread [ffff8d677e329800:17185] 1 exiting: rc = 0 00000100:00100000:0.0:1788684442.001851:0:17184:0:(service.c:3183:ptlrpc_main()) mdt_io00_000: service thread [ffff8d677e10e400:17184] 0 exiting: rc = 1 00000100:00100000:1.0:1788684442.002128:0:17186:0:(service.c:3183:ptlrpc_main()) mdt_io00_002: service thread [ffff8d6774825200:17186] 2 exiting: rc = 0 00000100:00100000:3.0:1788684442.002220:0:20943:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788684442.002226:0:20943:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788684442.002232:0:20943:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788684442.002237:0:20943:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788684442.002242:0:20943:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788684442.002247:0:20943:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788684442.002260:0:20943:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788684442.002267:0:20943:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788684442.002273:0:20943:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788684442.002278:0:20943:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788684442.002283:0:20943:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788684442.002288:0:20943:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788684442.002294:0:20943:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788684442.002299:0:20943:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788684442.002332:0:20943:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788684442.002338:0:20943:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788684442.002343:0:20943:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788684442.002348:0:20943:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788684442.002354:0:20943:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788684442.002359:0:20943:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788684442.002390:0:20943:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788684442.002397:0:20943:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788684442.002402:0:20943:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788684442.002423:0:20943:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788684442.002430:0:20943:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788684442.002436:0:20943:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788684442.002441:0:20943:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788684442.002446:0:20943:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788684442.002451:0:20943:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788684442.002457:0:20943:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788684442.002463:0:20943:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788684442.002469:0:20943:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788684442.002474:0:20943:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788684442.002479:0:20943:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788684442.002484:0:20943:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788684442.002489:0:20943:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788684442.002495:0:20943:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788684442.002501:0:20943:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788684442.002507:0:20943:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788684442.002513:0:20943:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788684442.002519:0:20943:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788684442.002524:0:20943:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788684442.002529:0:20943:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788684442.002534:0:20943:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788684442.002554:0:20943:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788684442.002560:0:20943:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788684442.002566:0:20943:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788684442.002585:0:20943:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788684442.002592:0:20943:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788684442.002604:0:20943:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788684442.002610:0:20943:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788684442.002616:0:20943:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788684442.002621:0:20943:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788684442.002627:0:20943:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788684442.002633:0:20943:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788684442.002639:0:20943:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788684442.002644:0:20943:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788684442.002650:0:20943:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788684442.002655:0:20943:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788684442.002661:0:20943:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788684442.002667:0:20943:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788684442.002672:0:20943:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788684442.002678:0:20943:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788684442.002683:0:20943:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:0.0:1788684442.037864:0:20943:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788684442.037877:0:20943:0:(obd_config.c:883:class_detach()) detach on obd MDS (uuid MDS_uuid) 00000020:00000080:0.0:1788684442.037884:0:20943:0:(genops.c:885:class_export_put()) final put ffff8d6648401000/MDS_uuid 00000020:00000080:0.0:1788684442.037888:0:20943:0:(genops.c:844:class_export_destroy()) destroying export ffff8d6648401000/MDS_uuid for MDS 00000020:01000000:0.0:1788684442.037899:0:20943:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MDS (MDS_uuid) 00000020:02000400:0.0:1788684442.038080:0:20943:0:(tgt_mount.c:2184:server_put_super()) server umount lustre-MDT0001 complete 00000100:00080000:0.0:1788684442.245958:0:14645:0:(pinger.c:229:ptlrpc_pinger_process_import()) c986901f-6089-4802-a23d-1179db951431->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788684442.245968:0:14645:0:(pinger.c:247:ptlrpc_pinger_process_import()) c986901f-6089-4802-a23d-1179db951431->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1788684442.245971:0:14645:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788684442.245974:0:14645:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1788684442.245979:0:14645:0:(import.c:65:import_set_state_nolock()) ffff8d6646cc0800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788684442.245987:0:14645:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 518 00000100:00080000:0.0:1788684442.245993:0:14645:0:(import.c:630:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1788684442.246001:0:14645:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8d6646cc0800 using connection 192.168.206.144@tcp/0@lo 00000100:00100000:0.0:1788684442.246039:0:14645:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8d677fb45180 x1875571085893376/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788684442.246086:0:14645:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788684442.246090:0:14645:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1788684442.246091:0:14645:0:(import.c:65:import_set_state_nolock()) ffff8d6646588800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788684442.246095:0:14645:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 518 00000100:00080000:0.0:1788684442.246097:0:14645:0:(import.c:630:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1788684442.246100:0:14645:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8d6646588800 using connection 192.168.206.144@tcp/0@lo 00000100:00100000:0.0:1788684442.246111:0:14645:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8d677fb47800 x1875571085893632/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788684442.246165:0:3625:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d677fb47100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3625:1875571085893504:0@lo:400:kworker.0 00000400:00000100:0.0:1788684442.246217:0:3625:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875571085893504 offset 0 length 224: 4 00000100:00100000:0.0:1788684442.246253:0:3625:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788684442.246273:0:3625:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d677fb46300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3625:1875571085893760:0@lo:400:kworker.0 00000400:00000100:0.0:1788684442.246292:0:3625:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875571085893760 offset 0 length 224: 4 00000100:00100000:0.0:1788684442.249960:0:3622:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d677fb45180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3622:1875571085893376:0@lo:38:kworker.0 00000400:00000100:0.0:1788684442.250017:0:3622:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875571085893376 offset 0 length 520: 4 00000100:00100000:0.0:1788684442.250044:0:3622:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d677fb47800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3622:1875571085893632:0@lo:38:kworker.0 00000400:00000100:0.0:1788684442.250061:0:3622:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875571085893632 offset 0 length 520: 4 00010000:00010000:3.0:1788684442.366594:0:17160:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788684443.390119:0:17159:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788684444.413659:0:17160:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788684445.438730:0:17159:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:1.0:1788684446.168285:0:21144:0:(tgt_mount.c:2195:server_umount_begin()) umount -f 00000020:01000004:0.0:1788684446.182646:0:21144:0:(tgt_mount.c:2065:server_put_super()) server put_super lustre-OST0000 00010000:00010000:0.0:1788684446.182706:0:21144:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.144@tcp lock: ffff8d66477b1a00/0x44bac02bd54ad693 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x44bac02bd54ad69a expref: -99 pid: 18673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684446.182720:0:21144:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.144@tcp lock: ffff8d66477b1a00/0x44bac02bd54ad693 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x44bac02bd54ad69a expref: -99 pid: 18673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684446.182728:0:21144:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.144@tcp lock: ffff8d66477b1a00/0x44bac02bd54ad693 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0x44bac02bd54ad69a expref: -99 pid: 18673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684446.182744:0:21144:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.144@tcp lock: ffff8d66477b1a00/0x44bac02bd54ad693 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0x44bac02bd54ad69a expref: -99 pid: 18673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684446.182765:0:21144:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:0.0:1788684446.182770:0:21144:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:0.0:1788684446.182808:0:21144:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1788684446.182819:0:21144:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff8d677fb45180 x1875571085893376/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 1788684457 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00010000:00010000:3.0:1788684446.182828:0:17160:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788684446.182837:0:17160:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.144@tcp lock: ffff8d66477b1a00/0x44bac02bd54ad693 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0x44bac02bd54ad69a expref: -99 pid: 18673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788684446.182840:0:21144:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 3 00000100:00080000:0.0:1788684446.182849:0:21144:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00010000:00010000:3.0:1788684446.182850:0:17160:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d66477b1a00 already unused, calling callback (ffffffffc1297c20) 10000000:00010000:3.0:1788684446.182856:0:17160:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.144@tcp lock: ffff8d66477b1a00/0x44bac02bd54ad693 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0x44bac02bd54ad69a expref: -99 pid: 18673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1788684446.182857:0:21144:0:(import.c:65:import_set_state_nolock()) ffff8d6646cc0800 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00080000:0.0:1788684446.182865:0:21144:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00010000:00010000:3.0:1788684446.182869:0:17160:0:(ldlm_request.c:1390:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.144@tcp lock: ffff8d66477b1a00/0x44bac02bd54ad693 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1008400000000 nid: local remote: 0x44bac02bd54ad69a expref: -99 pid: 18673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788684446.182872:0:21144:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff8d677fb45180 x1875571085893376/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 1788684457 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 10000000:00010000:3.0:1788684446.182890:0:17160:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.144@tcp lock: ffff8d66477b1a00/0x44bac02bd54ad693 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1009400000000 nid: local remote: 0x44bac02bd54ad69a expref: -99 pid: 18673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788684446.182891:0:21144:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 4 00000100:00100000:0.0:1788684446.182896:0:21144:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 14s for inflight to error out 10000000:01000000:3.0:1788684446.182902:0:17160:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1788684446.182906:0:17160:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:3.0:1788684446.182909:0:17160:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:3.0:1788684446.182931:0:17160:0:(ldlm_request.c:1546:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff8d677fc82000 00010000:00010000:3.0:1788684446.182935:0:17160:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.144@tcp lock: ffff8d66477b1a00/0x44bac02bd54ad693 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000000 nid: local remote: 0x44bac02bd54ad69a expref: -99 pid: 18673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684446.182942:0:17160:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.144@tcp lock: ffff8d66477b1a00/0x44bac02bd54ad693 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000000 nid: local remote: 0x44bac02bd54ad69a expref: -99 pid: 18673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684446.182952:0:17160:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788684446.182954:0:17160:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788684446.182956:0:17160:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788684446.183334:0:3622:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d677fb45180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3622:1875571085893376:0@lo:38:kworker.0 00000100:00080000:0.0:1788684446.186969:0:21144:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:0.0:1788684446.186984:0:21144:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff8d677fb47100 x1875571085893504/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788684458 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788684446.187011:0:21144:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 3 00000100:00080000:0.0:1788684446.187016:0:21144:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-lwp-OST0000_UUID->lustre-MDT0001_UUID 00000100:00080000:0.0:1788684446.187037:0:21144:0:(import.c:65:import_set_state_nolock()) ffff8d6646cce800 lustre-MDT0001_UUID: changing import state from FULL to CONNECTING 00000100:00100000:2.0:1788684446.187157:0:3622:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d677fb45500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3622:1875571085893888:0@lo:39:umount.0 00000400:00000100:2.0:1788684446.187202:0:3622:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875571085893888 offset 0 length 224: 4 00000100:00100000:3.0:1788684446.188348:0:3625:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d677fb47100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3625:1875571085893504:0@lo:400:kworker.0 00000100:00080000:2.0:1788684446.269586:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) c986901f-6089-4802-a23d-1179db951431->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1788684446.269597:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) c986901f-6089-4802-a23d-1179db951431->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1788684446.269600:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1788684446.269603:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1788684446.269850:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d677fa81500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3623:1875571085894016:0@lo:400:kworker.0 00000400:00000100:1.0:1788684446.269902:0:3623:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875571085894016 offset 0 length 224: 4 00010000:00010000:2.0:1788684446.465097:0:17159:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1788684446.849281:0:19491:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000020:00000080:0.0:1788684446.849294:0:19491:0:(genops.c:885:class_export_put()) final put ffff8d6646cc7000/lustre-MDT0001-mdtlov_UUID 00000001:00100000:1.0:1788684446.850339:0:18674:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000020:00000080:1.0:1788684446.850347:0:18674:0:(genops.c:885:class_export_put()) final put ffff8d664740e000/lustre-MDT0001-mdtlov_UUID 00000020:00000080:2.0:1788684446.851933:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff8d6646cc7000/lustre-MDT0001-mdtlov_UUID for lustre-OST0001 00000020:00000080:2.0:1788684446.852019:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8d6646cc2000 for lustre-OST0001 00000020:00000080:0.0:1788684446.860688:0:14645:0:(genops.c:844:class_export_destroy()) destroying export ffff8d664740e000/lustre-MDT0001-mdtlov_UUID for lustre-OST0000 00000020:00000080:0.0:1788684446.860773:0:14645:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8d664740c800 for lustre-OST0000 00000100:00080000:3.0:1788684447.294202:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) c986901f-6089-4802-a23d-1179db951431->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788684447.294217:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) c986901f-6089-4802-a23d-1179db951431->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788684447.294221:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788684447.294225:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1788684447.294402:0:3623:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788684447.294432:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6647909180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3623:1875571085894144:0@lo:400:kworker.0 00000400:00000100:1.0:1788684447.294505:0:3623:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875571085894144 offset 0 length 224: 4 00010000:00010000:3.0:1788684447.485758:0:17160:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788684448.515594:0:17159:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788684449.533602:0:17160:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788684450.557749:0:17159:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788684451.325667:0:3622:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788684441/real 1788684441] req@ffff8d677fa82300 x1875571085893248/t0(0) o250->MGC192.168.206.144@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1788684451 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'ptlrpcd_00_01.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788684451.325716:0:3622:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8d677fa82300 x1875571085893248/t0(0) o250->MGC192.168.206.144@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1788684451 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'ptlrpcd_00_01.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788684451.325744:0:3622:0:(import.c:65:import_set_state_nolock()) ffff8d677fc82000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788684451.325851:0:3622:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of MGS on 0@lo failed (-110) 00000100:00100000:2.0:1788684451.325856:0:3622:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d677fa82300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c986901f-6089-4802-a23d-1179db951431:3622:1875571085893248:0@lo:250:ptlrpcd_00_01.0 00000100:00080000:0.0:1788684451.326006:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) c986901f-6089-4802-a23d-1179db951431->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788684451.326023:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:0.0:1788684451.326026:0:38:0:(import.c:65:import_set_state_nolock()) ffff8d677fc82000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788684451.326032:0:38:0:(import.c:545:import_select_connection()) MGC192.168.206.144@tcp: connect to NID 0@lo last attempt 522 00000100:00080000:0.0:1788684451.326045:0:38:0:(import.c:630:import_select_connection()) MGC192.168.206.144@tcp: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1788684451.326053:0:38:0:(import.c:665:import_select_connection()) MGC192.168.206.144@tcp: import ffff8d677fc82000 using connection 192.168.206.144@tcp/0@lo 00000100:00100000:0.0:1788684451.326134:0:38:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8d677fb44e00 x1875571085894272/t0(0) o250->MGC192.168.206.144@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788684451.326167:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788684451.326172:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1788684451.326317:0:3626:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788684451.326340:0:3626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d677fb47100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3626:1875571085894400:0@lo:400:kworker.0 00000100:00100000:2.0:1788684451.326439:0:3622:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d677fb44e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c986901f-6089-4802-a23d-1179db951431:3622:1875571085894272:0@lo:250:kworker.0 00000400:00000100:1.0:1788684451.326472:0:3626:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875571085894400 offset 0 length 224: 4 00000400:00000100:2.0:1788684451.334191:0:3622:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1875571085894272 offset 0 length 520: 4 00010000:00010000:0.0:1788684451.581633:0:17160:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788684452.606573:0:17159:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788684453.629635:0:17160:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788684454.653607:0:17159:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788684455.677712:0:17160:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788684456.445560:0:3622:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788684446/real 1788684446] req@ffff8d677fb45500 x1875571085893888/t0(0) o39->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 1 dl 1788684456 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788684456.445604:0:3622:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8d677fb45500 x1875571085893888/t0(0) o39->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 1 dl 1788684456 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788684456.445628:0:3622:0:(import.c:65:import_set_state_nolock()) ffff8d6646cce800 lustre-MDT0001_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:2.0:1788684456.445652:0:3622:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d677fb45500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3622:1875571085893888:0@lo:39:umount.0 00000100:00080000:0.0:1788684456.445856:0:21144:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:0.0:1788684456.445862:0:21144:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 4 00000100:00100000:0.0:1788684456.445868:0:21144:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:0.0:1788684456.449018:0:21144:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.144@tcp lock: ffff8d677711dc00/0x44bac02bd54ad669 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x44bac02bd54ad670 expref: -99 pid: 18673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684456.449042:0:21144:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.144@tcp lock: ffff8d677711dc00/0x44bac02bd54ad669 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x44bac02bd54ad670 expref: -99 pid: 18673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684456.449050:0:21144:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.144@tcp lock: ffff8d677711dc00/0x44bac02bd54ad669 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x44bac02bd54ad670 expref: -99 pid: 18673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684456.449059:0:21144:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.144@tcp lock: ffff8d677711dc00/0x44bac02bd54ad669 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x44bac02bd54ad670 expref: -99 pid: 18673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684456.449093:0:21144:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788684456.449101:0:21144:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.144@tcp lock: ffff8d66477b1200/0x44bac02bd54ad9cd lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x44bac02bd54ad9d4 expref: -99 pid: 17168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684456.449108:0:21144:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.144@tcp lock: ffff8d66477b1200/0x44bac02bd54ad9cd lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x44bac02bd54ad9d4 expref: -99 pid: 17168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684456.449135:0:21144:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.144@tcp lock: ffff8d66477b1200/0x44bac02bd54ad9cd lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x44bac02bd54ad9d4 expref: -99 pid: 17168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684456.449141:0:21144:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.144@tcp lock: ffff8d66477b1200/0x44bac02bd54ad9cd lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x44bac02bd54ad9d4 expref: -99 pid: 17168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684456.449165:0:21144:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 10000000:01000000:0.0:1788684456.449170:0:21144:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0000 (0) 00000020:01000004:0.0:1788684456.449202:0:21144:0:(tgt_mount.c:2115:server_put_super()) stopping lustre-OST0000 00000020:01000000:0.0:1788684456.449206:0:21144:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000 (flags='F') 00000020:00000080:0.0:1788684456.449211:0:21144:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788684456.449217:0:21144:0:(obd_config.c:956:class_cleanup()) lustre-OST0000: forcing exports to disconnect: 0/1 00000020:00080000:0.0:1788684456.449222:0:21144:0:(genops.c:1558:class_disconnect_exports()) OBD device 22 (ffff8d677e3e8000) has no exports 00000020:00080000:0.0:1788684456.449249:0:21144:0:(genops.c:1558:class_disconnect_exports()) OBD device 22 (ffff8d677e3e8000) has no exports 00010000:00010000:3.0:1788684456.455041:0:17160:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788684456.455061:0:17160:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.144@tcp lock: ffff8d677711dc00/0x44bac02bd54ad669 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x44bac02bd54ad670 expref: -99 pid: 18673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684456.455075:0:17160:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d677711dc00 already unused, calling callback (ffffffffc1297c20) 10000000:00010000:3.0:1788684456.455080:0:17160:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.144@tcp lock: ffff8d677711dc00/0x44bac02bd54ad669 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x44bac02bd54ad670 expref: -99 pid: 18673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684456.455091:0:17160:0:(ldlm_request.c:1390:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.144@tcp lock: ffff8d677711dc00/0x44bac02bd54ad669 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0x44bac02bd54ad670 expref: -99 pid: 18673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788684456.455099:0:17160:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.144@tcp lock: ffff8d677711dc00/0x44bac02bd54ad669 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0x44bac02bd54ad670 expref: -99 pid: 18673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788684456.455130:0:17160:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1788684456.455133:0:17160:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0000: stopping, won't requeue 10000000:01000000:3.0:1788684456.455136:0:17160:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0000 00010000:00010000:3.0:1788684456.455162:0:17160:0:(ldlm_request.c:1546:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff8d677fc82000 00010000:00010000:3.0:1788684456.455166:0:17160:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.144@tcp lock: ffff8d677711dc00/0x44bac02bd54ad669 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000000 nid: local remote: 0x44bac02bd54ad670 expref: -99 pid: 18673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684456.455173:0:17160:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.144@tcp lock: ffff8d677711dc00/0x44bac02bd54ad669 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000000 nid: local remote: 0x44bac02bd54ad670 expref: -99 pid: 18673 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684456.455191:0:17160:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788684456.455194:0:17160:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.144@tcp lock: ffff8d66477b1200/0x44bac02bd54ad9cd lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x44bac02bd54ad9d4 expref: -99 pid: 17168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684456.455200:0:17160:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d66477b1200 already unused, calling callback (ffffffffc1297c20) 10000000:00010000:3.0:1788684456.455203:0:17160:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.144@tcp lock: ffff8d66477b1200/0x44bac02bd54ad9cd lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x44bac02bd54ad9d4 expref: -99 pid: 17168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684456.455210:0:17160:0:(ldlm_request.c:1390:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.144@tcp lock: ffff8d66477b1200/0x44bac02bd54ad9cd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x44bac02bd54ad9d4 expref: -99 pid: 17168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788684456.455215:0:17160:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.144@tcp lock: ffff8d66477b1200/0x44bac02bd54ad9cd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x44bac02bd54ad9d4 expref: -99 pid: 17168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788684456.455220:0:17160:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:3.0:1788684456.455222:0:17160:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:3.0:1788684456.455224:0:17160:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:3.0:1788684456.455229:0:17160:0:(ldlm_request.c:1546:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff8d677fc82000 00010000:00010000:3.0:1788684456.455232:0:17160:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.144@tcp lock: ffff8d66477b1200/0x44bac02bd54ad9cd lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x44bac02bd54ad9d4 expref: -99 pid: 17168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684456.455245:0:17160:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.144@tcp lock: ffff8d66477b1200/0x44bac02bd54ad9cd lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x44bac02bd54ad9d4 expref: -99 pid: 17168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684456.455254:0:17160:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788684456.455256:0:17160:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788684456.455258:0:17160:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788684456.457406:0:17159:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:0.0:1788684456.458086:0:21144:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8d677e261000 - data ffff8d675155b000/ffff8d677cb97400 00000020:01000000:0.0:1788684456.458228:0:21144:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8d66466f3f60 - data ffff8d6751739510/ffff8d6746cac000 00100000:10000000:0.0:1788684456.472174:0:21144:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0000-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:1.0:1788684456.489295:0:21144:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x44bac02bd54ad67e 00000020:00000080:1.0:1788684456.489309:0:21144:0:(genops.c:885:class_export_put()) final put ffff8d67466b2800/lustre-OST0000-osd_UUID 00000020:01000004:1.0:1788684456.489437:0:21144:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8d677fabb800 from lustre-OST0000, refs=2 00000020:01000004:1.0:1788684456.489441:0:21144:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8d677fabb800 2 00000020:01000004:1.0:1788684456.489444:0:21144:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff8d677fabb800 from lustre-OST0000 00000020:00000080:1.0:1788684456.489479:0:21144:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788684456.489488:0:21144:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:00000080:1.0:1788684456.489492:0:21144:0:(genops.c:885:class_export_put()) final put ffff8d67466b1800/lustre-OST0000_UUID 00000020:00000080:1.0:1788684456.489495:0:21144:0:(genops.c:844:class_export_destroy()) destroying export ffff8d67466b1800/lustre-OST0000_UUID for lustre-OST0000 00000020:01000000:1.0:1788684456.489502:0:21144:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000 (lustre-OST0000_UUID) 00000020:01000004:1.0:1788684456.489577:0:21144:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 1 references. 00000020:01000000:1.0:1788684456.489581:0:21144:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0000 (flags='F') 00000020:00000080:1.0:1788684456.489585:0:21144:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788684456.489590:0:21144:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-OST0000: forcing exports to disconnect: 1/3 00000020:00080000:1.0:1788684456.489596:0:21144:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-OST0000: ACTIVE ffff8d6646ccc800 lustre-MDT0000-lwp-OST0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1788684456.489603:0:21144:0:(genops.c:1553:class_disconnect_exports()) OBD device 23 (ffff8d67482e4d40) has exports, disconnecting them 00000020:00080000:1.0:1788684456.489607:0:21144:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0000: disconnecting export at 0@lo (ffff8d6646ccc800), last request at 1788684374 00000020:00000080:1.0:1788684456.489611:0:21144:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x44bac02bd54ad6a8 00000020:00080000:1.0:1788684456.489621:0:21144:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff8d6646ccc800): rc 0 00000020:00000080:1.0:1788684456.489626:0:21144:0:(genops.c:885:class_export_put()) final put ffff8d6646ccc800/lustre-MDT0000-lwp-OST0000 00000020:00000080:3.0:1788684456.490623:0:14645:0:(genops.c:844:class_export_destroy()) destroying export ffff8d67466b2800/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:3.0:1788684456.492484:0:14645:0:(genops.c:844:class_export_destroy()) destroying export ffff8d6646ccc800/lustre-MDT0000-lwp-OST0000 for lustre-MDT0000-lwp-OST0000 00010000:01000000:2.0:1788684456.501217:0:21144:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0000: client import never connected 00000100:00080000:2.0:1788684456.501229:0:21144:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1788684456.501235:0:21144:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 5 00000100:00100000:2.0:1788684456.501245:0:21144:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1788684456.501453:0:14645:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8d6646cc0800 for lustre-MDT0000-lwp-OST0000 00000020:00000080:3.0:1788684456.501593:0:21144:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788684456.501605:0:21144:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000020:00000080:3.0:1788684456.501610:0:21144:0:(genops.c:885:class_export_put()) final put ffff8d6646cc3000/lustre-MDT0000-lwp-OST0000_UUID 00000020:00000080:3.0:1788684456.501614:0:21144:0:(genops.c:844:class_export_destroy()) destroying export ffff8d6646cc3000/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000-lwp-OST0000 00000020:01000000:3.0:1788684456.501622:0:21144:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0000 (lustre-MDT0000-lwp-OST0000_UUID) 00000020:01000000:3.0:1788684456.501697:0:21144:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-lwp-OST0000 (flags='F') 00000020:00000080:3.0:1788684456.501701:0:21144:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788684456.501707:0:21144:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-lwp-OST0000: forcing exports to disconnect: 1/3 00000020:00080000:3.0:1788684456.501714:0:21144:0:(genops.c:1819:print_export_data()) lustre-MDT0001-lwp-OST0000: ACTIVE ffff8d6646cc8000 lustre-MDT0001-lwp-OST0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1788684456.501720:0:21144:0:(genops.c:1553:class_disconnect_exports()) OBD device 24 (ffff8d6746c04d40) has exports, disconnecting them 00000020:00080000:3.0:1788684456.501724:0:21144:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0001-lwp-OST0000: disconnecting export at 0@lo (ffff8d6646cc8000), last request at 1788684374 00000020:00000080:3.0:1788684456.501728:0:21144:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x44bac02bd54ad6bd 00000020:00080000:3.0:1788684456.501744:0:21144:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff8d6646cc8000): rc 0 00000020:00000080:3.0:1788684456.501749:0:21144:0:(genops.c:885:class_export_put()) final put ffff8d6646cc8000/lustre-MDT0001-lwp-OST0000 00000020:00000080:2.0:1788684456.502753:0:14645:0:(genops.c:844:class_export_destroy()) destroying export ffff8d6646cc8000/lustre-MDT0001-lwp-OST0000 for lustre-MDT0001-lwp-OST0000 00010000:01000000:2.0:1788684456.502788:0:21144:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0001-lwp-OST0000: client import never connected 00000100:00080000:2.0:1788684456.502804:0:21144:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:2.0:1788684456.502819:0:21144:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 5 00000100:00100000:2.0:1788684456.502824:0:21144:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1788684456.502842:0:14645:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8d6646cce800 for lustre-MDT0001-lwp-OST0000 00000020:00000080:2.0:1788684456.502972:0:21144:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788684456.502979:0:21144:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-lwp-OST0000 (uuid lustre-MDT0001-lwp-OST0000_UUID) 00000020:00000080:2.0:1788684456.502983:0:21144:0:(genops.c:885:class_export_put()) final put ffff8d6646ccc000/lustre-MDT0001-lwp-OST0000_UUID 00000020:00000080:2.0:1788684456.502986:0:21144:0:(genops.c:844:class_export_destroy()) destroying export ffff8d6646ccc000/lustre-MDT0001-lwp-OST0000_UUID for lustre-MDT0001-lwp-OST0000 00000020:01000000:2.0:1788684456.502992:0:21144:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-lwp-OST0000 (lustre-MDT0001-lwp-OST0000_UUID) 00000020:01000004:2.0:1788684456.503039:0:21144:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8d677fabb800 1 00000020:00000080:2.0:1788684456.503045:0:21144:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x44bac02bd54ad65b 00000020:00000080:2.0:1788684456.503050:0:21144:0:(genops.c:885:class_export_put()) final put ffff8d677fabd800/lustre-OST0000-osd_UUID 00000020:01000000:2.0:1788684456.503057:0:21144:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osd (flags='') 00000020:00000080:2.0:1788684456.503065:0:14645:0:(genops.c:844:class_export_destroy()) destroying export ffff8d677fabd800/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:2.0:1788684456.503073:0:21144:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788684456.503077:0:21144:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osd: forcing exports to disconnect: 0/1 00000020:00080000:2.0:1788684456.503080:0:21144:0:(genops.c:1558:class_disconnect_exports()) OBD device 20 (ffff8d677e144d40) has no exports 00000100:00080000:2.0:1788684456.580265:0:14645:0:(pinger.c:229:ptlrpc_pinger_process_import()) c986901f-6089-4802-a23d-1179db951431->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1788684456.580274:0:14645:0:(pinger.c:247:ptlrpc_pinger_process_import()) c986901f-6089-4802-a23d-1179db951431->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1788684456.580278:0:14645:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1788684456.580282:0:14645:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1788684456.591349:0:3626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d677fa82300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3626:1875571085894528:0@lo:400:kworker.0 00000400:00000100:1.0:1788684456.591425:0:3626:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875571085894528 offset 0 length 224: 4 00000020:00000080:2.0:1788684456.637485:0:21144:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788684456.637503:0:21144:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00000020:00000080:2.0:1788684456.637511:0:21144:0:(genops.c:885:class_export_put()) final put ffff8d677fabc000/lustre-OST0000-osd_UUID 00000020:00000080:2.0:1788684456.637515:0:21144:0:(genops.c:844:class_export_destroy()) destroying export ffff8d677fabc000/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:01000000:2.0:1788684456.637532:0:21144:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osd (lustre-OST0000-osd_UUID) 00000020:01000004:2.0:1788684456.637671:0:21144:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff8d677fabe800 00000020:02000400:2.0:1788684456.637721:0:21144:0:(tgt_mount.c:2184:server_put_super()) server umount lustre-OST0000 complete 00010000:00010000:1.0:1788684456.701609:0:17160:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788684457.474752:0:3622:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788684442/real 1788684442] req@ffff8d677fb47800 x1875571085893632/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 1 dl 1788684457 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788684457.474786:0:3622:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8d677fb47800 x1875571085893632/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 1 dl 1788684457 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1788684457.474804:0:3622:0:(import.c:65:import_set_state_nolock()) ffff8d6646588800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788684457.474837:0:3622:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-110) 00000100:00100000:1.0:1788684457.474841:0:3622:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d677fb47800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3622:1875571085893632:0@lo:38:kworker.0 00000100:00080000:3.0:1788684457.475036:0:14645:0:(pinger.c:229:ptlrpc_pinger_process_import()) c986901f-6089-4802-a23d-1179db951431->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788684457.475041:0:14645:0:(pinger.c:247:ptlrpc_pinger_process_import()) c986901f-6089-4802-a23d-1179db951431->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788684457.475044:0:14645:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788684457.475061:0:14645:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1788684457.475063:0:14645:0:(import.c:65:import_set_state_nolock()) ffff8d6646588800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788684457.475067:0:14645:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 523 00000100:00080000:3.0:1788684457.475072:0:14645:0:(import.c:630:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 10s 00000100:00080000:3.0:1788684457.475077:0:14645:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8d6646588800 using connection 192.168.206.144@tcp/0@lo 00000100:00100000:3.0:1788684457.475109:0:14645:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8d6647908e00 x1875571085894656/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788684457.475157:0:3624:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788684457.475168:0:3624:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6647908380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3624:1875571085894784:0@lo:400:kworker.0 00000400:00000100:3.0:1788684457.475213:0:3624:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875571085894784 offset 0 length 224: 4 00000100:00100000:1.0:1788684457.480703:0:3622:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6647908e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3622:1875571085894656:0@lo:38:kworker.0 00000400:00000100:1.0:1788684457.480763:0:3622:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875571085894656 offset 0 length 520: 4 00010000:00010000:2.0:1788684457.726549:0:17159:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00000400:2.0:1788684458.430778:0:3625:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788684442/real 1788684442] req@ffff8d677fb46300 x1875571085893760/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1788684458 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788684458.468064:0:3625:0:(client.c:2548:ptlrpc_expire_one_request()) @@@ TIMEOUT-NORESEND: req@ffff8d677fb46300 x1875571085893760/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1788684458 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788684458.468081:0:3625:0:(import.c:65:import_set_state_nolock()) ffff8d6758ee1800 lustre-MDT0001_UUID: changing import state from FULL to DISCONN 00000100:02000400:2.0:1788684458.468086:0:3625:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0001-lwp-OST0001: Connection to lustre-MDT0001 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:2.0:1788684458.482947:0:3625:0:(import.c:418:ptlrpc_pinger_force()) lustre-MDT0001_UUID: waking up pinger s:DISCONN 00000100:00100000:2.0:1788684458.483033:0:3625:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d677fb46300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3625:1875571085893760:0@lo:400:kworker.0 00000100:00080000:1.0:1788684458.483101:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) c986901f-6089-4802-a23d-1179db951431->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788684458.483106:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) c986901f-6089-4802-a23d-1179db951431->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788684458.483109:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788684458.483112:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788684458.483114:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788684458.483117:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:1.0:1788684458.483121:0:38:0:(import.c:65:import_set_state_nolock()) ffff8d6758ee1800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788684458.483125:0:38:0:(import.c:545:import_select_connection()) lustre-MDT0001-lwp-OST0001: connect to NID 0@lo last attempt 470 00000100:00080000:1.0:1788684458.483132:0:38:0:(import.c:665:import_select_connection()) lustre-MDT0001-lwp-OST0001: import ffff8d6758ee1800 using connection 192.168.206.144@tcp/0@lo 00000100:00100000:1.0:1788684458.483167:0:38:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8d674698fb80 x1875571085894912/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788684458.484778:0:3622:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d674698fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3622:1875571085894912:0@lo:38:kworker.0 00000400:00000100:0.0:1788684458.484838:0:3622:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875571085894912 offset 0 length 520: 4 00010000:00010000:1.0:1788684458.750460:0:17160:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788684459.800804:0:17159:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788684460.799953:0:17160:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:0.0:1788684460.989988:0:21347:0:(tgt_mount.c:2195:server_umount_begin()) umount -f 00000020:01000004:0.0:1788684461.023775:0:21347:0:(tgt_mount.c:2065:server_put_super()) server put_super lustre-OST0001 00010000:00010000:0.0:1788684461.023859:0:21347:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.144@tcp lock: ffff8d6647890e00/0x44bac02bd54ad72d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x44bac02bd54ad734 expref: -99 pid: 19490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684461.023877:0:21347:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.144@tcp lock: ffff8d6647890e00/0x44bac02bd54ad72d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x44bac02bd54ad734 expref: -99 pid: 19490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684461.023886:0:21347:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.144@tcp lock: ffff8d6647890e00/0x44bac02bd54ad72d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x44bac02bd54ad734 expref: -99 pid: 19490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684461.023911:0:21347:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.144@tcp lock: ffff8d6647890e00/0x44bac02bd54ad72d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x44bac02bd54ad734 expref: -99 pid: 19490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684461.023972:0:21347:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:0.0:1788684461.023979:0:21347:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:0.0:1788684461.024008:0:21347:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1788684461.024021:0:21347:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff8d6647908e00 x1875571085894656/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1788684477 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788684461.024047:0:21347:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 3 00000100:00080000:0.0:1788684461.024054:0:21347:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00080000:0.0:1788684461.024062:0:21347:0:(import.c:65:import_set_state_nolock()) ffff8d6646588800 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00080000:0.0:1788684461.024068:0:21347:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1788684461.024071:0:21347:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff8d6647908e00 x1875571085894656/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1788684477 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788684461.024078:0:21347:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 4 00000100:00100000:0.0:1788684461.024081:0:21347:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 21s for inflight to error out 00000100:00100000:1.0:1788684461.025391:0:3622:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6647908e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3622:1875571085894656:0@lo:38:kworker.0 00010000:00010000:3.0:1788684461.031459:0:17159:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788684461.031477:0:17159:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.144@tcp lock: ffff8d6647890e00/0x44bac02bd54ad72d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x44bac02bd54ad734 expref: -99 pid: 19490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684461.031493:0:17159:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d6647890e00 already unused, calling callback (ffffffffc1297c20) 10000000:00010000:3.0:1788684461.031498:0:17159:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.144@tcp lock: ffff8d6647890e00/0x44bac02bd54ad72d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x44bac02bd54ad734 expref: -99 pid: 19490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684461.031510:0:17159:0:(ldlm_request.c:1390:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.144@tcp lock: ffff8d6647890e00/0x44bac02bd54ad72d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x44bac02bd54ad734 expref: -99 pid: 19490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788684461.031518:0:17159:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.144@tcp lock: ffff8d6647890e00/0x44bac02bd54ad72d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x44bac02bd54ad734 expref: -99 pid: 19490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788684461.031524:0:17159:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1788684461.031528:0:17159:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:3.0:1788684461.031532:0:17159:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:3.0:1788684461.031554:0:17159:0:(ldlm_request.c:1546:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff8d677fc82000 00010000:00010000:3.0:1788684461.031582:0:17159:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.144@tcp lock: ffff8d6647890e00/0x44bac02bd54ad72d lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x44bac02bd54ad734 expref: -99 pid: 19490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684461.031590:0:17159:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.144@tcp lock: ffff8d6647890e00/0x44bac02bd54ad72d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x44bac02bd54ad734 expref: -99 pid: 19490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684461.031608:0:17159:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788684461.031610:0:17159:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788684461.031612:0:17159:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1788684461.031933:0:21347:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:1.0:1788684461.031949:0:21347:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff8d677fa81500 x1875571085894016/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788684462 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788684461.032069:0:21347:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff8d6647909180 x1875571085894144/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788684463 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788684461.032087:0:21347:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff8d677fb47100 x1875571085894400/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788684467 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788684461.032105:0:21347:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff8d677fa82300 x1875571085894528/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788684472 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788684461.032114:0:21347:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff8d6647908380 x1875571085894784/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788684473 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788684461.032131:0:21347:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff8d674698fb80 x1875571085894912/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1788684468 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788684461.032152:0:21347:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 3 00000100:00080000:1.0:1788684461.032160:0:21347:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID 00000100:00080000:1.0:1788684461.032167:0:21347:0:(import.c:65:import_set_state_nolock()) ffff8d6758ee1800 lustre-MDT0001_UUID: changing import state from CONNECTING to CLOSED 00000100:00080000:1.0:1788684461.032173:0:21347:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:1.0:1788684461.032177:0:21347:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff8d677fa81500 x1875571085894016/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788684462 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788684461.032236:0:3624:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6647908380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3624:1875571085894784:0@lo:400:kworker.0 00000100:00100000:2.0:1788684461.032283:0:3626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d677fa82300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3626:1875571085894528:0@lo:400:kworker.0 00000100:00100000:0.0:1788684461.032789:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d677fa81500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3623:1875571085894016:0@lo:400:kworker.0 00000100:00100000:1.0:1788684461.032828:0:21347:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff8d6647909180 x1875571085894144/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788684463 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788684461.032837:0:21347:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff8d677fb47100 x1875571085894400/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788684467 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788684461.032857:0:21347:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff8d677fa82300 x1875571085894528/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788684472 ref 1 fl Complete:ENQU/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788684461.032865:0:21347:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff8d6647908380 x1875571085894784/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788684473 ref 1 fl Complete:ENQU/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788684461.032873:0:21347:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff8d674698fb80 x1875571085894912/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1788684468 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788684461.032880:0:21347:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 4 00000100:00100000:3.0:1788684461.034491:0:3626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d677fb47100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3626:1875571085894400:0@lo:400:kworker.0 00000100:00100000:0.0:1788684461.036936:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6647909180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3623:1875571085894144:0@lo:400:kworker.0 00000100:00100000:0.0:1788684461.037028:0:3622:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d674698fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3622:1875571085894912:0@lo:38:kworker.0 00000100:00100000:1.0:1788684461.037664:0:21347:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:1.0:1788684461.038825:0:21347:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.144@tcp lock: ffff8d66477b0200/0x44bac02bd54ad703 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x44bac02bd54ad70a expref: -99 pid: 19490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684461.038844:0:21347:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.144@tcp lock: ffff8d66477b0200/0x44bac02bd54ad703 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x44bac02bd54ad70a expref: -99 pid: 19490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684461.038852:0:21347:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.144@tcp lock: ffff8d66477b0200/0x44bac02bd54ad703 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x44bac02bd54ad70a expref: -99 pid: 19490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684461.038859:0:21347:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.144@tcp lock: ffff8d66477b0200/0x44bac02bd54ad703 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x44bac02bd54ad70a expref: -99 pid: 19490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684461.038882:0:21347:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788684461.038889:0:21347:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.144@tcp lock: ffff8d66476d4a00/0x44bac02bd54ad9bf lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x44bac02bd54ad9c6 expref: -99 pid: 17168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684461.038897:0:21347:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.144@tcp lock: ffff8d66476d4a00/0x44bac02bd54ad9bf lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x44bac02bd54ad9c6 expref: -99 pid: 17168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684461.038903:0:21347:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.144@tcp lock: ffff8d66476d4a00/0x44bac02bd54ad9bf lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x44bac02bd54ad9c6 expref: -99 pid: 17168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684461.038925:0:21347:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.206.144@tcp lock: ffff8d66476d4a00/0x44bac02bd54ad9bf lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x44bac02bd54ad9c6 expref: -99 pid: 17168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684461.038943:0:21347:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 10000000:01000000:1.0:1788684461.038949:0:21347:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0001 (0) 00000020:01000004:1.0:1788684461.038983:0:21347:0:(tgt_mount.c:2115:server_put_super()) stopping lustre-OST0001 00000020:01000000:1.0:1788684461.038988:0:21347:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001 (flags='F') 00000020:00000080:1.0:1788684461.038994:0:21347:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788684461.039001:0:21347:0:(obd_config.c:956:class_cleanup()) lustre-OST0001: forcing exports to disconnect: 0/1 00000020:00080000:1.0:1788684461.039007:0:21347:0:(genops.c:1558:class_disconnect_exports()) OBD device 26 (ffff8d6645b1b380) has no exports 00000020:00080000:1.0:1788684461.039039:0:21347:0:(genops.c:1558:class_disconnect_exports()) OBD device 26 (ffff8d6645b1b380) has no exports 00010000:00010000:3.0:1788684461.040738:0:17160:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788684461.040755:0:17160:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.144@tcp lock: ffff8d66477b0200/0x44bac02bd54ad703 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x44bac02bd54ad70a expref: -99 pid: 19490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684461.040768:0:17160:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d66477b0200 already unused, calling callback (ffffffffc1297c20) 10000000:00010000:3.0:1788684461.040773:0:17160:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.144@tcp lock: ffff8d66477b0200/0x44bac02bd54ad703 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x44bac02bd54ad70a expref: -99 pid: 19490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684461.040786:0:17160:0:(ldlm_request.c:1390:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.144@tcp lock: ffff8d66477b0200/0x44bac02bd54ad703 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x44bac02bd54ad70a expref: -99 pid: 19490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788684461.040794:0:17160:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.144@tcp lock: ffff8d66477b0200/0x44bac02bd54ad703 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x44bac02bd54ad70a expref: -99 pid: 19490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788684461.040800:0:17160:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1788684461.040803:0:17160:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0001: stopping, won't requeue 10000000:01000000:3.0:1788684461.040806:0:17160:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0001 00010000:00010000:3.0:1788684461.040856:0:17160:0:(ldlm_request.c:1546:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff8d677fc82000 00010000:00010000:3.0:1788684461.040876:0:17160:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.144@tcp lock: ffff8d66477b0200/0x44bac02bd54ad703 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x44bac02bd54ad70a expref: -99 pid: 19490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684461.040884:0:17160:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.144@tcp lock: ffff8d66477b0200/0x44bac02bd54ad703 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x44bac02bd54ad70a expref: -99 pid: 19490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684461.040901:0:17160:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788684461.040905:0:17160:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.144@tcp lock: ffff8d66476d4a00/0x44bac02bd54ad9bf lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x44bac02bd54ad9c6 expref: -99 pid: 17168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684461.040910:0:17160:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d66476d4a00 already unused, calling callback (ffffffffc1297c20) 10000000:00010000:3.0:1788684461.040913:0:17160:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.144@tcp lock: ffff8d66476d4a00/0x44bac02bd54ad9bf lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x44bac02bd54ad9c6 expref: -99 pid: 17168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684461.040919:0:17160:0:(ldlm_request.c:1390:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.144@tcp lock: ffff8d66476d4a00/0x44bac02bd54ad9bf lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x44bac02bd54ad9c6 expref: -99 pid: 17168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788684461.040925:0:17160:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.144@tcp lock: ffff8d66476d4a00/0x44bac02bd54ad9bf lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x44bac02bd54ad9c6 expref: -99 pid: 17168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788684461.040930:0:17160:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:3.0:1788684461.040932:0:17160:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:3.0:1788684461.040934:0:17160:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:3.0:1788684461.040940:0:17160:0:(ldlm_request.c:1546:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff8d677fc82000 00010000:00010000:3.0:1788684461.040942:0:17160:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.144@tcp lock: ffff8d66476d4a00/0x44bac02bd54ad9bf lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0x44bac02bd54ad9c6 expref: -99 pid: 17168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684461.040948:0:17160:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.144@tcp lock: ffff8d66476d4a00/0x44bac02bd54ad9bf lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0x44bac02bd54ad9c6 expref: -99 pid: 17168 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684461.040961:0:17160:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788684461.040969:0:17160:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788684461.040971:0:17160:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788684461.041279:0:17159:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:1.0:1788684461.047675:0:21347:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8d6774804840 - data ffff8d676743c000/ffff8d677cb9f000 00000020:01000000:1.0:1788684461.047896:0:21347:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff8d67748044e0 - data ffff8d6767579ca8/ffff8d6746c80c00 00100000:10000000:1.0:1788684461.059534:0:21347:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0001-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:3.0:1788684461.081689:0:21347:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x44bac02bd54ad718 00000020:00000080:3.0:1788684461.081704:0:21347:0:(genops.c:885:class_export_put()) final put ffff8d664844b800/lustre-OST0001-osd_UUID 00000020:01000004:3.0:1788684461.081728:0:21347:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8d6646ccf000 from lustre-OST0001, refs=2 00000020:01000004:3.0:1788684461.081739:0:21347:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8d6646ccf000 2 00000020:01000004:3.0:1788684461.081743:0:21347:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff8d6646ccf000 from lustre-OST0001 00000020:00000080:3.0:1788684461.081773:0:21347:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788684461.081786:0:21347:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:00000080:3.0:1788684461.081789:0:21347:0:(genops.c:885:class_export_put()) final put ffff8d664844c000/lustre-OST0001_UUID 00000020:00000080:3.0:1788684461.081792:0:21347:0:(genops.c:844:class_export_destroy()) destroying export ffff8d664844c000/lustre-OST0001_UUID for lustre-OST0001 00000020:01000000:3.0:1788684461.081799:0:21347:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001 (lustre-OST0001_UUID) 00000020:00000080:1.0:1788684461.081936:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff8d664844b800/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000100:00080000:3.0:1788684461.082394:0:21347:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import c986901f-6089-4802-a23d-1179db951431->MGS 00010000:00010000:3.0:1788684461.082416:0:21347:0:(ldlm_request.c:1390:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.144@tcp lock: ffff8d677711d800/0x44bac02bd54ad527 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x44bac02bd54ad52e expref: -99 pid: 17902 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788684461.082431:0:21347:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.144@tcp lock: ffff8d677711d800/0x44bac02bd54ad527 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x44bac02bd54ad52e expref: -99 pid: 17902 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788684461.082449:0:21347:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 10000000:01000000:3.0:1788684461.082452:0:21347:0:(mgc_request.c:954:mgc_blocking_ast()) log nodemap: disconnecting, won't requeue 10000000:01000000:3.0:1788684461.082456:0:21347:0:(mgc_request.c:130:config_log_put()) dropping config log nodemap 00010000:00010000:3.0:1788684461.082474:0:21347:0:(ldlm_request.c:1546:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff8d677fc82000 00010000:00010000:3.0:1788684461.082478:0:21347:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.144@tcp lock: ffff8d677711d800/0x44bac02bd54ad527 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x44bac02bd54ad52e expref: -99 pid: 17902 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684461.082496:0:21347:0:(ldlm_request.c:1390:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.144@tcp lock: ffff8d677711c600/0x44bac02bd54ad416 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x44bac02bd54ad41d expref: -99 pid: 17150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788684461.082503:0:21347:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.144@tcp lock: ffff8d677711c600/0x44bac02bd54ad416 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x44bac02bd54ad41d expref: -99 pid: 17150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788684461.082525:0:21347:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1788684461.082528:0:21347:0:(mgc_request.c:954:mgc_blocking_ast()) log lustre-s: disconnecting, won't requeue 10000000:01000000:3.0:1788684461.082529:0:21347:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-sptlrpc 00010000:00010000:3.0:1788684461.082542:0:21347:0:(ldlm_request.c:1546:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff8d677fc82000 00010000:00010000:3.0:1788684461.082545:0:21347:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.144@tcp lock: ffff8d677711c600/0x44bac02bd54ad416 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x44bac02bd54ad41d expref: -99 pid: 17150 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:3.0:1788684461.082569:0:21347:0:(import.c:65:import_set_state_nolock()) ffff8d677fc82000 MGS: changing import state from CONNECTING to CLOSED 10000000:01000000:3.0:1788684461.082574:0:21347:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:3.0:1788684461.082576:0:21347:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:3.0:1788684461.082578:0:21347:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:3.0:1788684461.082584:0:21347:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:3.0:1788684461.082598:0:21347:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff8d677fb44e00 x1875571085894272/t0(0) o250->MGC192.168.206.144@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 1788684466 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 10000000:01000000:3.0:1788684461.082618:0:21347:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:3.0:1788684461.082620:0:21347:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 6s for inflight to error out 00000100:00100000:3.0:1788684461.085342:0:3622:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d677fb44e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:c986901f-6089-4802-a23d-1179db951431:3622:1875571085894272:0@lo:250:kworker.0 10000000:01000000:1.0:1788684461.085552:0:21347:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:1.0:1788684461.085567:0:21347:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x44bac02bd54ad401 00000020:00000080:1.0:1788684461.085579:0:21347:0:(genops.c:885:class_export_put()) final put ffff8d6648401800/c986901f-6089-4802-a23d-1179db951431 00000020:01000000:1.0:1788684461.085608:0:21347:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGC192.168.206.144@tcp (flags='') 00000020:00000080:1.0:1788684461.085617:0:21347:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788684461.085626:0:21347:0:(obd_config.c:956:class_cleanup()) MGC192.168.206.144@tcp: forcing exports to disconnect: 0/3 00000020:00080000:1.0:1788684461.085631:0:21347:0:(genops.c:1558:class_disconnect_exports()) OBD device 2 (ffff8d677e3eb380) has no exports 00000020:00000080:0.0:1788684461.085806:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff8d6648401800/c986901f-6089-4802-a23d-1179db951431 for MGC192.168.206.144@tcp 10000000:01000000:3.0:1788684461.087306:0:17168:0:(mgc_request.c:708:mgc_requeue_thread()) Ending requeue thread 10000000:01000000:1.0:1788684461.087421:0:21347:0:(obd_class.h:670:obd_cleanup_client_import()) MGC192.168.206.144@tcp: client import never connected 00000100:00080000:1.0:1788684461.087428:0:21347:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 10000000:01000000:1.0:1788684461.087433:0:21347:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:1.0:1788684461.087447:0:21347:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 10000000:01000000:1.0:1788684461.087450:0:21347:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:0.0:1788684461.087507:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8d677fc82000 for MGC192.168.206.144@tcp 00000020:00000080:1.0:1788684461.087524:0:21347:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788684461.087537:0:21347:0:(obd_config.c:883:class_detach()) detach on obd MGC192.168.206.144@tcp (uuid c986901f-6089-4802-a23d-1179db951431) 00000020:00000080:1.0:1788684461.087542:0:21347:0:(genops.c:885:class_export_put()) final put ffff8d677fc86000/c986901f-6089-4802-a23d-1179db951431 00000020:00000080:1.0:1788684461.087557:0:21347:0:(genops.c:844:class_export_destroy()) destroying export ffff8d677fc86000/c986901f-6089-4802-a23d-1179db951431 for MGC192.168.206.144@tcp 00000020:01000000:1.0:1788684461.087564:0:21347:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGC192.168.206.144@tcp (c986901f-6089-4802-a23d-1179db951431) 00000020:01000000:1.0:1788684461.087911:0:21347:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0001 (flags='F') 00000020:00000080:1.0:1788684461.087916:0:21347:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788684461.087923:0:21347:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-OST0001: forcing exports to disconnect: 1/3 00000020:00080000:1.0:1788684461.087932:0:21347:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-OST0001: ACTIVE ffff8d664658a800 lustre-MDT0000-lwp-OST0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1788684461.087940:0:21347:0:(genops.c:1553:class_disconnect_exports()) OBD device 27 (ffff8d677cf28000) has exports, disconnecting them 00000020:00080000:1.0:1788684461.087946:0:21347:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0001: disconnecting export at 0@lo (ffff8d664658a800), last request at 1788684389 00000020:00000080:1.0:1788684461.088031:0:21347:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x44bac02bd54ad742 00000020:00080000:1.0:1788684461.088049:0:21347:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff8d664658a800): rc 0 00000020:00000080:1.0:1788684461.088055:0:21347:0:(genops.c:885:class_export_put()) final put ffff8d664658a800/lustre-MDT0000-lwp-OST0001 00000020:00000080:0.0:1788684461.088110:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff8d664658a800/lustre-MDT0000-lwp-OST0001 for lustre-MDT0000-lwp-OST0001 00010000:01000000:0.0:1788684461.090424:0:21347:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0001: client import never connected 00000100:00080000:0.0:1788684461.090435:0:21347:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1788684461.090463:0:21347:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 5 00000100:00100000:0.0:1788684461.090473:0:21347:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1788684461.090559:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8d6646588800 for lustre-MDT0000-lwp-OST0001 00000020:00000080:0.0:1788684461.090761:0:21347:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788684461.090771:0:21347:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000020:00000080:0.0:1788684461.090777:0:21347:0:(genops.c:885:class_export_put()) final put ffff8d664658b000/lustre-MDT0000-lwp-OST0001_UUID 00000020:00000080:0.0:1788684461.090781:0:21347:0:(genops.c:844:class_export_destroy()) destroying export ffff8d664658b000/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000-lwp-OST0001 00000020:01000000:0.0:1788684461.090787:0:21347:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0001 (lustre-MDT0000-lwp-OST0001_UUID) 00000020:01000000:0.0:1788684461.090861:0:21347:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-lwp-OST0001 (flags='F') 00000020:00000080:0.0:1788684461.090865:0:21347:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788684461.090870:0:21347:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-lwp-OST0001: forcing exports to disconnect: 1/3 00000020:00080000:0.0:1788684461.090877:0:21347:0:(genops.c:1819:print_export_data()) lustre-MDT0001-lwp-OST0001: ACTIVE ffff8d6646cc1800 lustre-MDT0001-lwp-OST0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1788684461.090882:0:21347:0:(genops.c:1553:class_disconnect_exports()) OBD device 28 (ffff8d67482e0000) has exports, disconnecting them 00000020:00080000:0.0:1788684461.090887:0:21347:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0001-lwp-OST0001: disconnecting export at 0@lo (ffff8d6646cc1800), last request at 1788684389 00000020:00000080:0.0:1788684461.090891:0:21347:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x44bac02bd54ad757 00000020:00080000:0.0:1788684461.090907:0:21347:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff8d6646cc1800): rc 0 00000020:00000080:0.0:1788684461.090912:0:21347:0:(genops.c:885:class_export_put()) final put ffff8d6646cc1800/lustre-MDT0001-lwp-OST0001 00000020:00000080:3.0:1788684461.091416:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff8d6646cc1800/lustre-MDT0001-lwp-OST0001 for lustre-MDT0001-lwp-OST0001 00010000:01000000:1.0:1788684461.110449:0:21347:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0001-lwp-OST0001: client import never connected 00000100:00080000:1.0:1788684461.110460:0:21347:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:1.0:1788684461.110466:0:21347:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 5 00000100:00100000:1.0:1788684461.110475:0:21347:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:3.0:1788684461.110643:0:17160:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-1 blwis in pool) 00000020:00000080:3.0:1788684461.110782:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff8d6758ee1800 for lustre-MDT0001-lwp-OST0001 00010000:00010000:3.0:1788684461.110850:0:17159:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-2 blwis in pool) 00000100:00100000:3.0:1788684461.112671:0:17154:0:(service.c:3183:ptlrpc_main()) ldlm_cb00_000: service thread [ffff8d66459bac00:17154] 0 exiting: rc = 1 00000100:00100000:1.0:1788684461.112675:0:17155:0:(service.c:3183:ptlrpc_main()) ldlm_cb00_001: service thread [ffff8d66459bb600:17155] 1 exiting: rc = 0 00000100:00100000:1.0:1788684461.112876:0:21347:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788684461.113248:0:20196:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_003: service thread [ffff8d6645b76200:20196] 3 exiting: rc = 0 00000100:00100000:3.0:1788684461.113256:0:17156:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_000: service thread [ffff8d664799a200:17156] 0 exiting: rc = 1 00000100:00100000:1.0:1788684461.113466:0:17158:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_002: service thread [ffff8d66459b8c00:17158] 2 exiting: rc = 0 00000100:00100000:2.0:1788684461.114150:0:17157:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_001: service thread [ffff8d6647406800:17157] 1 exiting: rc = 0 00000100:00100000:3.0:1788684461.114254:0:21347:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788684461.114262:0:21347:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788684461.114269:0:21347:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788684461.114276:0:21347:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788684461.114295:0:21347:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788684461.114303:0:21347:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788684461.114310:0:21347:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788684461.114316:0:21347:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788684461.114323:0:21347:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788684461.114329:0:21347:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788684461.114335:0:21347:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788684461.114340:0:21347:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788684461.114345:0:21347:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788684461.114351:0:21347:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788684461.114357:0:21347:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788684461.114362:0:21347:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788684461.114389:0:21347:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788684461.114395:0:21347:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788684461.114401:0:21347:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788684461.114408:0:21347:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788684461.114415:0:21347:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788684461.114421:0:21347:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788684461.114427:0:21347:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788684461.114432:0:21347:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788684461.114450:0:21347:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788684461.114457:0:21347:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788684461.114463:0:21347:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788684461.114471:0:21347:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788684461.114477:0:21347:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788684461.114483:0:21347:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788684461.114489:0:21347:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788684461.114495:0:21347:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788684461.114502:0:21347:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788684461.114508:0:21347:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788684461.114514:0:21347:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788684461.114519:0:21347:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788684461.114525:0:21347:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788684461.114531:0:21347:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788684461.114537:0:21347:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788684461.114551:0:21347:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788684461.114558:0:21347:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788684461.114564:0:21347:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788684461.114570:0:21347:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788684461.114576:0:21347:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788684461.114583:0:21347:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788684461.114588:0:21347:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788684461.114594:0:21347:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788684461.114599:0:21347:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788684461.114604:0:21347:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788684461.114609:0:21347:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788684461.114615:0:21347:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788684461.114621:0:21347:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788684461.114628:0:21347:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788684461.114634:0:21347:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788684461.114640:0:21347:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788684461.114645:0:21347:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788684461.114652:0:21347:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788684461.114658:0:21347:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788684461.114664:0:21347:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788684461.114670:0:21347:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788684461.114675:0:21347:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788684461.114681:0:21347:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788684461.114686:0:21347:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788684461.114692:0:21347:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:3.0:1788684461.115394:0:21347:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788684461.115406:0:21347:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-lwp-OST0001 (uuid lustre-MDT0001-lwp-OST0001_UUID) 00000020:00000080:3.0:1788684461.115413:0:21347:0:(genops.c:885:class_export_put()) final put ffff8d6646cc0000/lustre-MDT0001-lwp-OST0001_UUID 00000020:00000080:3.0:1788684461.115418:0:21347:0:(genops.c:844:class_export_destroy()) destroying export ffff8d6646cc0000/lustre-MDT0001-lwp-OST0001_UUID for lustre-MDT0001-lwp-OST0001 00000020:01000000:3.0:1788684461.115423:0:21347:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-lwp-OST0001 (lustre-MDT0001-lwp-OST0001_UUID) 00000020:01000004:3.0:1788684461.115490:0:21347:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8d6646ccf000 1 00000020:00000080:3.0:1788684461.115498:0:21347:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x44bac02bd54ad6fc 00000020:00000080:3.0:1788684461.115505:0:21347:0:(genops.c:885:class_export_put()) final put ffff8d6647739800/lustre-OST0001-osd_UUID 00000020:01000000:3.0:1788684461.115520:0:21347:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osd (flags='') 00000020:00000080:3.0:1788684461.115531:0:21347:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788684461.115537:0:21347:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osd: forcing exports to disconnect: 0/2 00000020:00080000:3.0:1788684461.115542:0:21347:0:(genops.c:1558:class_disconnect_exports()) OBD device 25 (ffff8d6746c03380) has no exports 00000020:00000080:1.0:1788684461.115549:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff8d6647739800/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:00000080:2.0:1788684461.181037:0:21347:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788684461.181057:0:21347:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00000020:00000080:2.0:1788684461.181064:0:21347:0:(genops.c:885:class_export_put()) final put ffff8d6646cc9000/lustre-OST0001-osd_UUID 00000020:00000080:2.0:1788684461.181070:0:21347:0:(genops.c:844:class_export_destroy()) destroying export ffff8d6646cc9000/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:01000000:2.0:1788684461.181084:0:21347:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osd (lustre-OST0001-osd_UUID) 00000020:01000004:2.0:1788684461.181584:0:21347:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff8d6646cc8800 00000020:01000000:2.0:1788684461.181611:0:21347:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of OSS (flags='F') 00000020:00000080:2.0:1788684461.181616:0:21347:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788684461.181621:0:21347:0:(obd_config.c:956:class_cleanup()) OSS: forcing exports to disconnect: 0/1 00000020:00080000:2.0:1788684461.181627:0:21347:0:(genops.c:1558:class_disconnect_exports()) OBD device 21 (ffff8d677e140000) has no exports 00000020:00000080:2.0:1788684461.181668:0:21347:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788684461.181673:0:21347:0:(obd_config.c:883:class_detach()) detach on obd OSS (uuid OSS_uuid) 00000020:00000080:2.0:1788684461.181676:0:21347:0:(genops.c:885:class_export_put()) final put ffff8d677cc6f800/OSS_uuid 00000020:00000080:2.0:1788684461.181679:0:21347:0:(genops.c:844:class_export_destroy()) destroying export ffff8d677cc6f800/OSS_uuid for OSS 00000020:01000000:2.0:1788684461.181683:0:21347:0:(genops.c:441:class_free_dev()) finishing cleanup of obd OSS (OSS_uuid) 00000100:00100000:2.0:1788684461.181813:0:19204:0:(service.c:3183:ptlrpc_main()) ll_ost00_003: service thread [ffff8d6646ecae00:19204] 3 exiting: rc = 0 00000100:00080000:0.0:1788684461.181823:0:17166:0:(pinger.c:548:ping_evictor_main()) Exiting Ping Evictor 00000100:00100000:2.0:1788684461.185085:0:19567:0:(service.c:3183:ptlrpc_main()) ll_ost00_004: service thread [ffff8d674890ce00:19567] 4 exiting: rc = 0 00000100:00100000:1.0:1788684461.185449:0:18677:0:(service.c:3183:ptlrpc_main()) ll_ost00_000: service thread [ffff8d664642c800:18677] 0 exiting: rc = 1 00000100:00100000:3.0:1788684461.186257:0:18679:0:(service.c:3183:ptlrpc_main()) ll_ost00_001: service thread [ffff8d6746d66a00:18679] 1 exiting: rc = 0 00000100:00100000:0.0:1788684461.193606:0:18680:0:(service.c:3183:ptlrpc_main()) ll_ost00_002: service thread [ffff8d664794d400:18680] 2 exiting: rc = 0 00000100:00100000:2.0:1788684461.194232:0:21347:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788684461.194245:0:21347:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788684461.194250:0:21347:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788684461.194256:0:21347:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788684461.194262:0:21347:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788684461.194267:0:21347:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788684461.194272:0:21347:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788684461.194277:0:21347:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788684461.194283:0:21347:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788684461.194287:0:21347:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788684461.194292:0:21347:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788684461.194297:0:21347:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788684461.194303:0:21347:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788684461.194308:0:21347:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788684461.194314:0:21347:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788684461.194319:0:21347:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788684461.194325:0:21347:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788684461.194330:0:21347:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788684461.194335:0:21347:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788684461.194340:0:21347:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788684461.194346:0:21347:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788684461.194351:0:21347:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788684461.194355:0:21347:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788684461.194361:0:21347:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788684461.194389:0:21347:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788684461.194396:0:21347:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788684461.194402:0:21347:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788684461.194408:0:21347:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788684461.194414:0:21347:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788684461.194419:0:21347:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788684461.194426:0:21347:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788684461.194432:0:21347:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788684461.194448:0:21347:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788684461.194481:0:21347:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788684461.194486:0:21347:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788684461.194491:0:21347:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788684461.194497:0:21347:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788684461.194503:0:21347:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788684461.194509:0:21347:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788684461.194517:0:21347:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788684461.194522:0:21347:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788684461.194527:0:21347:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788684461.194533:0:21347:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788684461.194539:0:21347:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788684461.194544:0:21347:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788684461.194550:0:21347:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788684461.194555:0:21347:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788684461.194561:0:21347:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788684461.194567:0:21347:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788684461.194573:0:21347:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788684461.194579:0:21347:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788684461.194590:0:21347:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788684461.194595:0:21347:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788684461.194600:0:21347:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788684461.194606:0:21347:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788684461.194611:0:21347:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788684461.194616:0:21347:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788684461.194622:0:21347:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788684461.194627:0:21347:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788684461.194633:0:21347:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788684461.194638:0:21347:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788684461.194644:0:21347:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788684461.194649:0:21347:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788684461.194654:0:21347:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788684461.204788:0:18682:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_001: service thread [ffff8d664599b800:18682] 1 exiting: rc = 0 00000100:00100000:2.0:1788684461.206827:0:20360:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_002: service thread [ffff8d664750ee00:20360] 2 exiting: rc = 0 00000100:00100000:0.0:1788684461.215846:0:18681:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_000: service thread [ffff8d664794c000:18681] 0 exiting: rc = 1 00000100:00100000:0.0:1788684461.217705:0:21347:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788684461.217719:0:21347:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788684461.217725:0:21347:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788684461.217730:0:21347:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788684461.217749:0:21347:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788684461.217756:0:21347:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788684461.217761:0:21347:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788684461.217767:0:21347:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788684461.217772:0:21347:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788684461.217778:0:21347:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788684461.217806:0:21347:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788684461.217813:0:21347:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788684461.217818:0:21347:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788684461.217823:0:21347:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788684461.217829:0:21347:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788684461.217834:0:21347:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788684461.217839:0:21347:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788684461.217844:0:21347:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788684461.217849:0:21347:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788684461.217854:0:21347:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788684461.217859:0:21347:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788684461.217865:0:21347:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788684461.217870:0:21347:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788684461.217875:0:21347:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788684461.217881:0:21347:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788684461.217886:0:21347:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788684461.217891:0:21347:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788684461.217897:0:21347:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788684461.217902:0:21347:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788684461.217908:0:21347:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788684461.217914:0:21347:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788684461.217919:0:21347:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788684461.217924:0:21347:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788684461.217930:0:21347:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788684461.217935:0:21347:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788684461.217940:0:21347:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788684461.217946:0:21347:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788684461.217951:0:21347:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788684461.217957:0:21347:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788684461.217962:0:21347:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788684461.217968:0:21347:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788684461.217975:0:21347:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788684461.217980:0:21347:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788684461.217986:0:21347:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788684461.217991:0:21347:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788684461.218005:0:21347:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788684461.218011:0:21347:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788684461.218016:0:21347:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788684461.218022:0:21347:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788684461.218027:0:21347:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788684461.218032:0:21347:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788684461.218037:0:21347:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788684461.218042:0:21347:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788684461.218048:0:21347:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788684461.218054:0:21347:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788684461.218061:0:21347:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788684461.218066:0:21347:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788684461.218072:0:21347:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788684461.218077:0:21347:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788684461.218082:0:21347:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788684461.218102:0:21347:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788684461.218109:0:21347:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788684461.218114:0:21347:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788684461.218120:0:21347:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788684461.229915:0:18684:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_001: service thread [ffff8d675ebcac00:18684] 1 exiting: rc = 0 00000100:00100000:2.0:1788684461.230137:0:18683:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_000: service thread [ffff8d6746cef800:18683] 0 exiting: rc = 1 00000100:00100000:2.0:1788684461.230342:0:20310:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_003: service thread [ffff8d6746f2e400:20310] 3 exiting: rc = 0 00000100:00100000:2.0:1788684461.232471:0:18685:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_002: service thread [ffff8d67471f2400:18685] 2 exiting: rc = 0 00000100:00100000:0.0:1788684461.232800:0:21347:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788684461.232810:0:21347:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788684461.232816:0:21347:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788684461.232822:0:21347:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788684461.232828:0:21347:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788684461.232834:0:21347:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788684461.232840:0:21347:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788684461.232846:0:21347:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788684461.232852:0:21347:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788684461.232861:0:21347:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788684461.232866:0:21347:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788684461.232871:0:21347:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788684461.232877:0:21347:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788684461.232898:0:21347:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788684461.232906:0:21347:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788684461.232913:0:21347:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788684461.232938:0:21347:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788684461.232944:0:21347:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788684461.232950:0:21347:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788684461.232955:0:21347:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788684461.232961:0:21347:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788684461.232969:0:21347:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788684461.232974:0:21347:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788684461.232980:0:21347:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788684461.232986:0:21347:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788684461.232992:0:21347:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788684461.232998:0:21347:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788684461.233005:0:21347:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788684461.233011:0:21347:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788684461.233017:0:21347:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788684461.233024:0:21347:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788684461.233032:0:21347:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788684461.233040:0:21347:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788684461.233047:0:21347:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788684461.233053:0:21347:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788684461.233059:0:21347:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788684461.233065:0:21347:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788684461.233097:0:21347:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788684461.233105:0:21347:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788684461.233111:0:21347:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788684461.233116:0:21347:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788684461.233122:0:21347:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788684461.233128:0:21347:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788684461.233134:0:21347:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788684461.233141:0:21347:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788684461.233147:0:21347:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788684461.233988:0:21347:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788684461.234000:0:21347:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788684461.234006:0:21347:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788684461.234012:0:21347:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788684461.234018:0:21347:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788684461.234033:0:21347:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788684461.234039:0:21347:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788684461.234046:0:21347:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788684461.234052:0:21347:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788684461.234058:0:21347:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788684461.234064:0:21347:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788684461.234070:0:21347:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788684461.234934:0:21347:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788684461.234946:0:21347:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788684461.234952:0:21347:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788684461.234960:0:21347:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788684461.234967:0:21347:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788684461.234987:0:21347:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788684461.266796:0:18686:0:(service.c:3183:ptlrpc_main()) ll_ost_seq00_000: service thread [ffff8d674890da00:18686] 0 exiting: rc = 1 00000100:00100000:0.0:1788684461.267085:0:18687:0:(service.c:3183:ptlrpc_main()) ll_ost_seq00_001: service thread [ffff8d674890d000:18687] 1 exiting: rc = 0 00000100:00100000:1.0:1788684461.270927:0:21347:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788684461.270938:0:21347:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788684461.270944:0:21347:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788684461.270950:0:21347:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788684461.270956:0:21347:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788684461.270962:0:21347:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788684461.270970:0:21347:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788684461.271003:0:21347:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788684461.271009:0:21347:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788684461.271015:0:21347:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788684461.271020:0:21347:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788684461.271025:0:21347:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788684461.271032:0:21347:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788684461.271037:0:21347:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788684461.271043:0:21347:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788684461.271049:0:21347:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788684461.271055:0:21347:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788684461.271060:0:21347:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788684461.271065:0:21347:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788684461.271071:0:21347:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788684461.271077:0:21347:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788684461.271097:0:21347:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788684461.271103:0:21347:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788684461.271108:0:21347:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788684461.271114:0:21347:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788684461.271120:0:21347:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788684461.271125:0:21347:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788684461.271130:0:21347:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788684461.271135:0:21347:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788684461.271140:0:21347:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788684461.271159:0:21347:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788684461.271167:0:21347:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788684461.271173:0:21347:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788684461.271179:0:21347:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788684461.271184:0:21347:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788684461.271189:0:21347:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788684461.271194:0:21347:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788684461.271210:0:21347:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788684461.271218:0:21347:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788684461.271224:0:21347:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788684461.271230:0:21347:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788684461.271236:0:21347:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788684461.271250:0:21347:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788684461.271255:0:21347:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788684461.271260:0:21347:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788684461.271489:0:21347:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788684461.271497:0:21347:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788684461.271503:0:21347:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788684461.271509:0:21347:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788684461.271515:0:21347:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788684461.271520:0:21347:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788684461.271529:0:21347:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788684461.271535:0:21347:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788684461.271541:0:21347:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788684461.271548:0:21347:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788684461.271553:0:21347:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788684461.271558:0:21347:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788684461.271565:0:21347:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788684461.271571:0:21347:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788684461.271576:0:21347:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788684461.271583:0:21347:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788684461.271589:0:21347:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788684461.271595:0:21347:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788684461.271601:0:21347:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788684461.273944:0:18688:0:(service.c:3183:ptlrpc_main()) ll_ost_out00_000: service thread [ffff8d674890c000:18688] 0 exiting: rc = 1 00000100:00100000:1.0:1788684461.276506:0:18689:0:(service.c:3183:ptlrpc_main()) ll_ost_out00_001: service thread [ffff8d674890d400:18689] 1 exiting: rc = 0 00000100:00100000:3.0:1788684461.277034:0:21347:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788684461.277045:0:21347:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788684461.277063:0:21347:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788684461.277111:0:21347:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788684461.277121:0:21347:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788684461.277127:0:21347:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788684461.277136:0:21347:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788684461.277145:0:21347:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788684461.277152:0:21347:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788684461.277171:0:21347:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788684461.277179:0:21347:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788684461.277191:0:21347:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788684461.277200:0:21347:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788684461.277217:0:21347:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788684461.277224:0:21347:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788684461.277247:0:21347:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788684461.277256:0:21347:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788684461.277637:0:21347:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788684461.277649:0:21347:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788684461.277655:0:21347:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788684461.277662:0:21347:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788684461.277668:0:21347:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788684461.277675:0:21347:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788684461.277683:0:21347:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788684461.277689:0:21347:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788684461.277695:0:21347:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788684461.277701:0:21347:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788684461.277723:0:21347:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788684461.277742:0:21347:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788684461.277749:0:21347:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788684461.277756:0:21347:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788684461.277778:0:21347:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788684461.277785:0:21347:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788684461.277791:0:21347:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788684461.277798:0:21347:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788684461.277804:0:21347:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788684461.277810:0:21347:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788684461.277816:0:21347:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788684461.277822:0:21347:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788684461.277844:0:21347:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788684461.277852:0:21347:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788684461.277859:0:21347:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788684461.277865:0:21347:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788684461.277876:0:21347:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788684461.277883:0:21347:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788684461.277891:0:21347:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788684461.277897:0:21347:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788684461.277905:0:21347:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788684461.277912:0:21347:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788684461.277919:0:21347:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788684461.277927:0:21347:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788684461.277948:0:21347:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788684461.277955:0:21347:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788684461.277961:0:21347:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788684461.277968:0:21347:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788684461.277973:0:21347:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788684461.277980:0:21347:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788684461.277987:0:21347:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788684461.277993:0:21347:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788684461.278000:0:21347:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788684461.278006:0:21347:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788684461.278012:0:21347:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788684461.278018:0:21347:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788684461.278033:0:21347:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:02000400:3.0:1788684461.311193:0:21347:0:(tgt_mount.c:2184:server_put_super()) server umount lustre-OST0001 complete 00000001:02000400:1.0:1788684484.757851:0:22111:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg644-server.virtnet: executing load_modules_local 00000020:01000004:2.0:1788684495.391618:0:22710:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1788684495.391623:0:22710:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/mds1_flakey 00000020:01000004:2.0:1788684495.391625:0:22710:0:(obd_mount.c:929:lmd_print()) options: user_xattr,errors=remount-ro 00000080:01200004:2.0:1788684495.391727:0:22710:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff8d677cb59000 00000020:01000004:2.0:1788684495.392006:0:22710:0:(tgt_mount.c:2506:osd_start()) Attempting to start lustre-MDT0000, type=osd-ldiskfs, lsifl=200005, mountfl=0 00000020:01000004:2.0:1788684495.392013:0:22710:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-ldiskfs) 00000020:00000080:2.0:1788684495.392027:0:22710:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (ffff8d677cf299c0) 00000020:00000080:2.0:1788684495.392041:0:22710:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-ldiskfs with refcount 2 00100000:10000000:3.0:1788684495.492960:0:22710:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:2.0:1788684495.495516:0:22710:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x13:0x0] (16/1) registered 00100000:10000000:2.0:1788684495.498731:0:22710:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2:0x0] (8/32) registered 00100000:10000000:2.0:1788684495.503197:0:22710:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x19:0x0] (16/1) registered 00100000:10000000:2.0:1788684495.503618:0:22710:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1c:0x0] (16/1) registered 00100000:10000000:2.0:1788684495.504357:0:22710:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2e:0x0] (24/16) registered 00100000:10000000:2.0:1788684495.504720:0:22710:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x26:0x0] (24/16) registered 00100000:10000000:2.0:1788684495.505109:0:22710:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2a:0x0] (24/16) registered 00100000:10000000:2.0:1788684495.505403:0:22710:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2f:0x0] (24/16) registered 00100000:10000000:2.0:1788684495.505692:0:22710:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x25:0x0] (24/16) registered 00100000:10000000:2.0:1788684495.506064:0:22710:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1b:0x0] (16/1) registered 00100000:10000000:2.0:1788684495.506615:0:22710:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2b:0x0] (24/16) registered 00100000:10000000:2.0:1788684495.507104:0:22710:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x23:0x0] (16/1) registered 00100000:10000000:2.0:1788684495.507424:0:22710:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x34:0x0] (24/16) registered 00100000:10000000:2.0:1788684495.507660:0:22710:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x32:0x0] (24/16) registered 00100000:10000000:2.0:1788684495.508011:0:22710:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x16:0x0] (16/1) registered 00100000:10000000:2.0:1788684495.508266:0:22710:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x18:0x0] (16/1) registered 00100000:10000000:2.0:1788684495.508642:0:22710:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x15:0x0] (16/1) registered 00100000:10000000:2.0:1788684495.509029:0:22710:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2c:0x0] (24/16) registered 00100000:10000000:2.0:1788684495.509274:0:22710:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x14:0x0] (16/1) registered 00100000:10000000:2.0:1788684495.509568:0:22710:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x27:0x0] (24/16) registered 00100000:10000000:2.0:1788684495.509819:0:22710:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x33:0x0] (24/16) registered 00100000:10000000:0.0:1788684495.518753:0:22710:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x21:0x0] (16/1) registered 00100000:10000000:0.0:1788684495.520279:0:22710:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1a:0x0] (16/1) registered 00100000:10000000:0.0:1788684495.521238:0:22710:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x22:0x0] (16/1) registered 00100000:10000000:0.0:1788684495.521625:0:22710:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1d:0x0] (16/1) registered 00100000:10000000:0.0:1788684495.522616:0:22710:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1f:0x0] (16/1) registered 00100000:10000000:0.0:1788684495.523159:0:22710:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x28:0x0] (24/16) registered 00100000:10000000:0.0:1788684495.523561:0:22710:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x31:0x0] (24/16) registered 00100000:10000000:0.0:1788684495.525085:0:22710:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2d:0x0] (24/16) registered 00100000:10000000:0.0:1788684495.525493:0:22710:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x29:0x0] (24/16) registered 00100000:10000000:0.0:1788684495.525782:0:22710:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x20:0x0] (16/1) registered 00100000:10000000:0.0:1788684495.526115:0:22710:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x17:0x0] (16/1) registered 00100000:10000000:0.0:1788684495.526427:0:22710:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1e:0x0] (16/1) registered 00100000:10000000:0.0:1788684495.526707:0:22710:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x30:0x0] (24/16) registered 00100000:10000000:1.0:1788684495.528983:0:22710:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x9:0x0] (8/32) registered 00100000:10000000:1.0:1788684495.529210:0:22710:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:1.0:1788684495.529649:0:22710:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/32) registered 00100000:10000000:1.0:1788684495.530008:0:22710:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/32) registered 00100000:10000000:1.0:1788684495.530190:0:22710:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8) registered 00100000:10000000:1.0:1788684495.531172:0:22710:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:1.0:1788684495.531443:0:22710:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/32) registered 00100000:10000000:1.0:1788684495.531689:0:22710:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:1.0:1788684495.532550:0:22710:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8) registered 00100000:10000000:1.0:1788684495.532946:0:22710:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/32) registered 00100000:10000000:1.0:1788684495.533209:0:22710:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/32) registered 00100000:10000000:1.0:1788684495.533499:0:22710:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8) registered 00100000:10000000:1.0:1788684495.534142:0:22710:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x1020000:0x0] (8/32) registered 00100000:10000000:1.0:1788684495.534689:0:22710:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x20000:0x0] (8/32) registered 00100000:10000000:1.0:1788684495.534994:0:22710:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x2020000:0x0] (8/32) registered 00100000:10000000:1.0:1788684495.535453:0:22710:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x10000:0x0] (8/32) registered 00100000:10000000:1.0:1788684495.535788:0:22710:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x1010000:0x0] (8/32) registered 00100000:10000000:1.0:1788684495.536016:0:22710:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x2010000:0x0] (8/32) registered 00080000:01000000:1.0:1788684495.537111:0:22710:0:(osd_lproc.c:911:osd_procfs_init()) lustre-MDT0000: register osd-ldiskfs tunable parameters 00000020:00000080:1.0:1788684495.537547:0:22710:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:1.0:1788684495.537555:0:22710:0:(osd_handler.c:8924:osd_obd_connect()) connect #0 00000020:00000080:1.0:1788684495.537565:0:22710:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x44bac02bd54adc74 00000020:01000004:1.0:1788684495.537572:0:22710:0:(tgt_mount.c:2591:server_fill_super()) Found service lustre-MDT0000 on device /dev/mapper/mds1_flakey 00000020:01000000:1.0:1788684495.537577:0:22710:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:1.0:1788684495.537581:0:22710:0:(tgt_mount.c:101:server_register_mount()) register mount ffff8d677cb59000 from MGS 00000020:01000004:1.0:1788684495.537585:0:22710:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:1.0:1788684495.537593:0:22710:0:(genops.c:413:class_newdev()) Allocate new device MGS (ffff8d677e3eb380) 00000020:00000080:1.0:1788684495.537602:0:22710:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:1.0:1788684495.537658:0:22710:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8d677cb59000 from MGS, refs=2 00080000:01000000:1.0:1788684495.537662:0:22710:0:(osd_handler.c:8924:osd_obd_connect()) connect #1 00000020:00000080:1.0:1788684495.537667:0:22710:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x44bac02bd54adc82 00000100:00100000:1.0:1788684495.537768:0:22710:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:1.0:1788684495.538022:0:22710:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:1.0:1788684495.538028:0:22710:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:1.0:1788684495.539296:0:22710:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:1.0:1788684495.539305:0:22710:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:1.0:1788684495.540235:0:22710:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788684495.540565:0:22710:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:1.0:1788684495.540572:0:22710:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:1.0:1788684495.541288:0:22710:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:1.0:1788684495.541295:0:22710:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:1.0:1788684495.542430:0:22710:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:1.0:1788684495.542440:0:22710:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:0.0:1788684495.543275:0:22720:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788684495.543278:0:22720:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788684495.543280:0:22720:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788684495.543678:0:22721:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788684495.543681:0:22721:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788684495.543683:0:22721:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788684495.544840:0:22710:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00010000:00010000:0.0:1788684495.551310:0:22720:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:01000000:3.0:1788684495.553115:0:22710:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 10000000:01000000:3.0:1788684495.558750:0:22724:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:2.0:1788684495.558812:0:22710:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:2.0:1788684495.558854:0:22710:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:2.0:1788684495.561393:0:22710:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:2.0:1788684495.562248:0:22710:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788684495.564086:0:22710:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:2.0:1788684495.564097:0:22710:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:3.0:1788684495.564890:0:22710:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:3.0:1788684495.564898:0:22710:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:1.0:1788684495.565667:0:22710:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:1.0:1788684495.565675:0:22710:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:1.0:1788684495.571241:0:22710:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:1.0:1788684495.571276:0:22710:0:(obd_mount.c:411:lustre_start_mgc()) Start MGC 'MGC192.168.206.144@tcp' 00000020:01000004:1.0:1788684495.571278:0:22710:0:(obd_mount.c:420:lustre_start_mgc()) mgs NIDs (null). 00000020:01000004:1.0:1788684495.571306:0:22710:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGC192.168.206.144@tcp (typ=mgc) 00000020:00000080:1.0:1788684495.571318:0:22710:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.206.144@tcp (ffff8d677e3e8000) 00000020:00000080:1.0:1788684495.571331:0:22710:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00010000:00080000:1.0:1788684495.571443:0:22710:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8d677c479800@MGC192.168.206.144@tcp: add connection 192.168.206.144@tcp at head 00010000:00010000:1.0:1788684495.571772:0:22710:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.206.144@tcp-0 is initialized 00000040:01000000:1.0:1788684495.571779:0:22710:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.206.144@tcp ctxt 1 is initialized 10000000:01000000:1.0:1788684495.574671:0:22729:0:(mgc_request.c:631:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:0.0:1788684495.575108:0:22710:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.206.144@tcp (uuid cebd1789-51a4-46ff-b167-6b1633e930a1) 00000020:00000080:0.0:1788684495.575142:0:22710:0:(genops.c:1385:class_connect()) connect: client cebd1789-51a4-46ff-b167-6b1633e930a1, cookie 0x44bac02bd54adc90 00000100:00080000:0.0:1788684495.575155:0:22710:0:(import.c:545:import_select_connection()) MGC192.168.206.144@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1788684495.575161:0:22710:0:(import.c:665:import_select_connection()) MGC192.168.206.144@tcp: import ffff8d677c479800 using connection 192.168.206.144@tcp/0@lo 00000100:00100000:0.0:1788684495.575196:0:22710:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8d677fb47480 x1875571085895040/t0(0) o250->MGC192.168.206.144@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788684495.575226:0:22710:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import cebd1789-51a4-46ff-b167-6b1633e930a1->MGS 00000020:01000004:0.0:1788684495.575246:0:22710:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:0.0:1788684495.575250:0:22710:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:0.0:1788684495.575272:0:22710:0:(genops.c:413:class_newdev()) Allocate new device MDS (ffff8d67482e19c0) 00000020:00000080:0.0:1788684495.575283:0:22710:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00100000:1.0:1788684495.578017:0:3622:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d677fb47480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:cebd1789-51a4-46ff-b167-6b1633e930a1:3622:1875571085895040:0@lo:250:mount.lustre.0 00000100:00100000:1.0:1788684495.578086:0:3622:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788684495.578187:0:22725:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085895040 00000100:00100000:1.0:1788684495.578195:0:22725:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085895040 00000100:00100000:1.0:1788684495.578235:0:22725:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788684495.578242:0:22725:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6746d87450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3622:x1875571085895040:12345-0@lo:250:mount.lustre.0 00010000:00080000:1.0:1788684495.578280:0:22725:0:(ldlm_lib.c:1444:target_handle_connect()) MGS: connection from cebd1789-51a4-46ff-b167-6b1633e930a1@0@lo t0 exp 0000000000000000 cur 576 last 0 00000020:00000080:1.0:1788684495.578309:0:22725:0:(genops.c:1385:class_connect()) connect: client cebd1789-51a4-46ff-b167-6b1633e930a1, cookie 0x44bac02bd54adc9e 00000100:00080000:1.0:1788684495.578449:0:22725:0:(import.c:65:import_set_state_nolock()) ffff8d6747a5c800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788684495.578512:0:22725:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6746d87450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cebd1789-51a4-46ff-b167-6b1633e930a1+5:3622:x1875571085895040:12345-0@lo:250:mount.lustre.0 Request processed in 269us (425us total) trans 0 rc 0/0 00000100:00100000:1.0:1788684495.578526:0:22725:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788684495.579951:0:3622:0:(client.c:3126:ptlrpc_free_committed()) MGC192.168.206.144@tcp: committing for last_committed 0 gen 1 00000100:00080000:1.0:1788684495.580030:0:3622:0:(import.c:1176:ptlrpc_connect_interpret()) MGC192.168.206.144@tcp: connect to target with instance 0 00000100:00080000:1.0:1788684495.580040:0:3622:0:(import.c:1000:ptlrpc_connect_set_flags()) MGC192.168.206.144@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:1.0:1788684495.580045:0:3622:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:1.0:1788684495.580050:0:3622:0:(import.c:65:import_set_state_nolock()) ffff8d677c479800 MGS: changing import state from CONNECTING to FULL 10000000:01000000:1.0:1788684495.580053:0:3622:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:1.0:1788684495.580066:0:3622:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:1.0:1788684495.580073:0:3622:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d677fb47480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:cebd1789-51a4-46ff-b167-6b1633e930a1:3622:1875571085895040:0@lo:250:mount.lustre.0 00000100:00080000:3.0:1788684495.584444:0:22728:0:(pinger.c:466:ping_evictor_main()) Starting Ping Evictor 00000100:00100000:0.0:1788684495.608411:0:22710:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788684495.610249:0:22710:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:0.0:1788684495.610268:0:22710:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:0.0:1788684495.612189:0:22710:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:0.0:1788684495.612201:0:22710:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:0.0:1788684495.613208:0:22710:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:0.0:1788684495.613216:0:22710:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:0.0:1788684495.614927:0:22710:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788684495.615296:0:22710:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:0.0:1788684495.615303:0:22710:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:1.0:1788684495.615951:0:22710:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:1.0:1788684495.615958:0:22710:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:2.0:1788684495.708279:0:22710:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788684495.708663:0:22710:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:2.0:1788684495.708671:0:22710:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:1.0:1788684495.710127:0:22710:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:1.0:1788684495.710138:0:22710:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:1.0:1788684495.711813:0:22710:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788684495.712071:0:22710:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:1.0:1788684495.712078:0:22710:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:1.0:1788684495.713059:0:22710:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:1.0:1788684495.713068:0:22710:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:1.0:1788684495.714320:0:22710:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788684495.714658:0:22710:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:1.0:1788684495.714665:0:22710:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:1.0:1788684495.715476:0:22710:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:1.0:1788684495.715498:0:22710:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:1.0:1788684495.716297:0:22710:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788684495.716641:0:22710:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:1.0:1788684495.716647:0:22710:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:1.0:1788684495.724908:0:22710:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:1.0:1788684495.724930:0:22710:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:1.0:1788684495.756215:0:22710:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788684495.757285:0:22710:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:1.0:1788684495.757296:0:22710:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:1.0:1788684495.762225:0:22710:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:1.0:1788684495.762240:0:22710:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:3.0:1788684495.764724:0:22710:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:3.0:1788684495.764737:0:22710:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:1.0:1788684495.772859:0:22710:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:0.0:1788684495.773067:0:22710:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/mds1_flakey 10000000:01000000:0.0:1788684495.773074:0:22710:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.206.144@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:0.0:1788684495.776907:0:22710:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.206.144@tcp ctxt 0 is initialized 00000020:01000004:0.0:1788684495.776951:0:22710:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.206.144@tcp, index=0000, flags=0x20005 00000020:01000004:0.0:1788684495.776955:0:22710:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:0.0:1788684495.776957:0:22710:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1788684495.776958:0:22710:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788684495.776960:0:22710:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788684495.776961:0:22710:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788684495.776974:0:22710:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788684495.776981:0:22710:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1788684495.776982:0:22710:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1788684495.776984:0:22710:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788684495.776985:0:22710:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1788684495.776989:0:22710:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020005 00000020:01000004:0.0:1788684495.776991:0:22710:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1788684495.776992:0:22710:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1788684495.776993:0:22710:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788684495.776994:0:22710:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788684495.776995:0:22710:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788684495.776996:0:22710:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788684495.776997:0:22710:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1788684495.776998:0:22710:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1788684495.776999:0:22710:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788684495.777000:0:22710:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1788684495.777025:0:22710:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:0.0:1788684495.777042:0:22710:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d677fb44000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cebd1789-51a4-46ff-b167-6b1633e930a1:22710:1875571085895168:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1788684495.777109:0:22710:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788684495.777280:0:22710:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d6744e11180 going to sleep for 11 seconds 00000100:00100000:1.0:1788684495.780479:0:22727:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085895168 00000100:00100000:1.0:1788684495.780506:0:22727:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085895168 00000100:00100000:1.0:1788684495.780576:0:22727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788684495.780585:0:22727:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6746d86850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cebd1789-51a4-46ff-b167-6b1633e930a1+5:22710:x1875571085895168:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1788684495.780648:0:22727:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:1.0:1788684495.780651:0:22727:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:1.0:1788684495.780654:0:22727:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-MDT0000 is running on 0@lo 10000000:01000000:2.0:1788684495.787249:0:22748:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:1.0:1788684495.788080:0:22727:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 10 20000000:01000000:2.0:1788684495.796024:0:22749:0:(mgs_llog.c:340:mgs_fsdb_handler()) MDT index is 0 20000000:01000000:2.0:1788684495.796032:0:22749:0:(mgs_llog.c:340:mgs_fsdb_handler()) MDT index is 1 20000000:01000000:2.0:1788684495.796035:0:22749:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0000_UUID is 0 (0) 20000000:01000000:2.0:1788684495.796038:0:22749:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0001_UUID is 1 (1) 00000040:00080000:2.0:1788684495.796348:0:22749:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 20000000:01000000:1.0:1788684495.798508:0:22727:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:1.0:1788684495.798519:0:22727:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:1.0:1788684495.820025:0:22727:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6746d86850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cebd1789-51a4-46ff-b167-6b1633e930a1+5:22710:x1875571085895168:12345-0@lo:253:mount.lustre.0 Request processed in 39432us (42906us total) trans 0 rc 0/0 00000100:00100000:1.0:1788684495.820039:0:22727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788684495.820269:0:22710:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d677fb44000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cebd1789-51a4-46ff-b167-6b1633e930a1:22710:1875571085895168:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1788684495.820286:0:22710:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:0.0:1788684495.820289:0:22710:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1788684495.820291:0:22710:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1788684495.820292:0:22710:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788684495.820293:0:22710:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788684495.820294:0:22710:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788684495.820295:0:22710:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788684495.820296:0:22710:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1788684495.820298:0:22710:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1788684495.820300:0:22710:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788684495.820301:0:22710:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:0.0:1788684495.820322:0:22710:0:(tgt_mount.c:101:server_register_mount()) register mount ffff8d677cb59000 from lustre-MDT0000 10000000:01000000:0.0:1788684495.820349:0:22710:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:0.0:1788684495.820353:0:22710:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:0.0:1788684495.820357:0:22710:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffff8d677e3e8000 10000000:01000000:0.0:1788684495.820361:0:22710:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1788684495.820608:0:22710:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff8d677e3e8000 from 1 10000000:01000000:0.0:1788684495.820612:0:22710:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1788684495.820648:0:22710:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.144@tcp lock: ffff8d6746d3ea00/0x44bac02bd54adca5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684495.820659:0:22710:0:(ldlm_request.c:1106:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.144@tcp lock: ffff8d6746d3ea00/0x44bac02bd54adca5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684495.820669:0:22710:0:(ldlm_request.c:1193:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.144@tcp lock: ffff8d6746d3ea00/0x44bac02bd54adca5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788684495.820758:0:22710:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d677fb44000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cebd1789-51a4-46ff-b167-6b1633e930a1:22710:1875571085895296:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1788684495.820921:0:22710:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788684495.821024:0:22710:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d6744e11d80 going to sleep for 11 seconds 00000100:00100000:3.0:1788684495.821068:0:22726:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085895296 00000100:00100000:3.0:1788684495.821076:0:22726:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085895296 00000100:00100000:3.0:1788684495.821156:0:22726:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788684495.821165:0:22726:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6746d84850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cebd1789-51a4-46ff-b167-6b1633e930a1+5:22710:x1875571085895296:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788684495.821178:0:22726:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788684495.821203:0:22726:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d66479a0c00/0x44bac02bd54adcac lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x44bac02bd54adca5 expref: -99 pid: 22726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684495.821226:0:22726:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d66479a0c00/0x44bac02bd54adcac lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x44bac02bd54adca5 expref: 6 pid: 22726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684495.821237:0:22726:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d66479a0c00/0x44bac02bd54adcac lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x44bac02bd54adca5 expref: 6 pid: 22726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684495.821247:0:22726:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d66479a0c00, rc 0) 00000100:00100000:3.0:1788684495.821333:0:22726:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6746d84850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cebd1789-51a4-46ff-b167-6b1633e930a1+6:22710:x1875571085895296:12345-0@lo:101:mount.lustre.0 Request processed in 169us (411us total) trans 0 rc 0/0 00000100:00100000:3.0:1788684495.821340:0:22726:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788684495.821636:0:22710:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d677fb44000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cebd1789-51a4-46ff-b167-6b1633e930a1:22710:1875571085895296:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788684495.821652:0:22710:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.144@tcp lock: ffff8d6746d3ea00/0x44bac02bd54adca5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x44bac02bd54adcac expref: -99 pid: 22710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684495.821662:0:22710:0:(ldlm_request.c:840:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.144@tcp lock: ffff8d6746d3ea00/0x44bac02bd54adca5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x44bac02bd54adcac expref: -99 pid: 22710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788684495.821746:0:22710:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d677fb44000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cebd1789-51a4-46ff-b167-6b1633e930a1:22710:1875571085895424:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788684495.821783:0:22710:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788684495.823346:0:22710:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d6744e11d80 going to sleep for 11 seconds 00000100:00100000:2.0:1788684495.823670:0:22725:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085895424 00000100:00100000:2.0:1788684495.823680:0:22725:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085895424 00000100:00100000:3.0:1788684495.823969:0:22726:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788684495.823981:0:22726:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6746d85050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cebd1789-51a4-46ff-b167-6b1633e930a1+6:22710:x1875571085895424:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788684495.824089:0:22726:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6746d85050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cebd1789-51a4-46ff-b167-6b1633e930a1+6:22710:x1875571085895424:12345-0@lo:501:mount.lustre.0 Request processed in 111us (2304us total) trans 0 rc -2/-2 00000100:00100000:3.0:1788684495.824096:0:22726:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788684495.827874:0:22710:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d677fb44000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cebd1789-51a4-46ff-b167-6b1633e930a1:22710:1875571085895424:0@lo:501:mount.lustre.0 10000000:01000000:0.0:1788684495.827927:0:22710:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.144@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:0.0:1788684495.827948:0:22710:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.144@tcp lock: ffff8d6746d3ea00/0x44bac02bd54adca5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x44bac02bd54adcac expref: -99 pid: 22710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684495.827978:0:22710:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.144@tcp lock: ffff8d6746d3ea00/0x44bac02bd54adca5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x44bac02bd54adcac expref: -99 pid: 22710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788684495.827988:0:22710:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff8d677cb59000 10000000:01000000:0.0:1788684495.827993:0:22710:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:0.0:1788684495.827998:0:22710:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff8d677cb59000 10000000:01000000:0.0:1788684495.828001:0:22710:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:0.0:1788684495.828004:0:22710:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff8d677cb59000 from 1 10000000:01000000:0.0:1788684495.828007:0:22710:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:0.0:1788684495.828041:0:22710:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.144@tcp lock: ffff8d6746d3e400/0x44bac02bd54adcb3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684495.828050:0:22710:0:(ldlm_request.c:1106:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.144@tcp lock: ffff8d6746d3e400/0x44bac02bd54adcb3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684495.828061:0:22710:0:(ldlm_request.c:1193:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.144@tcp lock: ffff8d6746d3e400/0x44bac02bd54adcb3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788684495.828081:0:22710:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d677fb44000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cebd1789-51a4-46ff-b167-6b1633e930a1:22710:1875571085895552:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1788684495.828148:0:22710:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788684495.836395:0:22710:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d6744e11d80 going to sleep for 11 seconds 00000100:00100000:2.0:1788684495.836495:0:22725:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085895552 00000100:00100000:2.0:1788684495.836505:0:22725:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085895552 00000100:00100000:2.0:1788684495.836556:0:22725:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788684495.836565:0:22725:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6746d84450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cebd1789-51a4-46ff-b167-6b1633e930a1+6:22710:x1875571085895552:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788684495.836582:0:22725:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788684495.836616:0:22725:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d66476d5800/0x44bac02bd54adcba lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x44bac02bd54adcb3 expref: -99 pid: 22725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684495.836644:0:22725:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d66476d5800/0x44bac02bd54adcba lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x44bac02bd54adcb3 expref: 7 pid: 22725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684495.836655:0:22725:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d66476d5800/0x44bac02bd54adcba lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x44bac02bd54adcb3 expref: 7 pid: 22725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684495.836676:0:22725:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d66476d5800, rc 0) 00000100:00100000:2.0:1788684495.836753:0:22725:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6746d84450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cebd1789-51a4-46ff-b167-6b1633e930a1+7:22710:x1875571085895552:12345-0@lo:101:mount.lustre.0 Request processed in 189us (8606us total) trans 0 rc 0/0 00000100:00100000:2.0:1788684495.837075:0:22725:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788684495.837244:0:22710:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d677fb44000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cebd1789-51a4-46ff-b167-6b1633e930a1:22710:1875571085895552:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788684495.837272:0:22710:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.144@tcp lock: ffff8d6746d3e400/0x44bac02bd54adcb3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x44bac02bd54adcba expref: -99 pid: 22710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684495.837283:0:22710:0:(ldlm_request.c:840:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.144@tcp lock: ffff8d6746d3e400/0x44bac02bd54adcb3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x44bac02bd54adcba expref: -99 pid: 22710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788684495.837312:0:22710:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.144@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:0.0:1788684495.837317:0:22710:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.144@tcp lock: ffff8d6746d3e400/0x44bac02bd54adcb3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x44bac02bd54adcba expref: -99 pid: 22710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684495.837325:0:22710:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.144@tcp lock: ffff8d6746d3e400/0x44bac02bd54adcb3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x44bac02bd54adcba expref: -99 pid: 22710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788684495.837334:0:22710:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:0.0:1788684495.837338:0:22710:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1788684495.837343:0:22710:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff8d677cb59000 10000000:01000000:0.0:1788684495.837346:0:22710:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:0.0:1788684495.837350:0:22710:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:0.0:1788684495.837353:0:22710:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:0.0:1788684495.837407:0:22710:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.144@tcp lock: ffff8d6746d3ee00/0x44bac02bd54adcc1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684495.837416:0:22710:0:(ldlm_request.c:1106:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.144@tcp lock: ffff8d6746d3ee00/0x44bac02bd54adcc1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684495.837424:0:22710:0:(ldlm_request.c:1193:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.144@tcp lock: ffff8d6746d3ee00/0x44bac02bd54adcc1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788684495.837443:0:22710:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d677fb44000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cebd1789-51a4-46ff-b167-6b1633e930a1:22710:1875571085895680:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1788684495.837496:0:22710:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788684495.837522:0:22710:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d6744e11d80 going to sleep for 11 seconds 00000100:00100000:2.0:1788684495.837939:0:22725:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085895680 00000100:00100000:2.0:1788684495.837945:0:22725:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085895680 00000100:00100000:2.0:1788684495.837974:0:22725:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788684495.837981:0:22725:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6746d85450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cebd1789-51a4-46ff-b167-6b1633e930a1+7:22710:x1875571085895680:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788684495.837990:0:22725:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788684495.838001:0:22725:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d66476d4c00/0x44bac02bd54adcc8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x44bac02bd54adcc1 expref: -99 pid: 22725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684495.838019:0:22725:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d66476d4c00/0x44bac02bd54adcc8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x44bac02bd54adcc1 expref: 8 pid: 22725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684495.838028:0:22725:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d66476d4c00/0x44bac02bd54adcc8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x44bac02bd54adcc1 expref: 8 pid: 22725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684495.838037:0:22725:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d66476d4c00, rc 0) 00000100:00100000:2.0:1788684495.838082:0:22725:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6746d85450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cebd1789-51a4-46ff-b167-6b1633e930a1+8:22710:x1875571085895680:12345-0@lo:101:mount.lustre.0 Request processed in 101us (600us total) trans 0 rc 0/0 00000100:00100000:2.0:1788684495.838089:0:22725:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788684495.846169:0:22710:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d677fb44000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cebd1789-51a4-46ff-b167-6b1633e930a1:22710:1875571085895680:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788684495.846209:0:22710:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.144@tcp lock: ffff8d6746d3ee00/0x44bac02bd54adcc1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x44bac02bd54adcc8 expref: -99 pid: 22710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684495.846238:0:22710:0:(ldlm_request.c:840:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.144@tcp lock: ffff8d6746d3ee00/0x44bac02bd54adcc1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x44bac02bd54adcc8 expref: -99 pid: 22710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788684495.846333:0:22710:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d677fb44000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cebd1789-51a4-46ff-b167-6b1633e930a1:22710:1875571085895808:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788684495.846413:0:22710:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788684495.846453:0:22710:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d6744e11d80 going to sleep for 11 seconds 00000100:00100000:2.0:1788684495.846524:0:22725:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085895808 00000100:00100000:2.0:1788684495.846531:0:22725:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085895808 00000100:00100000:2.0:1788684495.846565:0:22725:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788684495.846574:0:22725:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6746d86c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cebd1789-51a4-46ff-b167-6b1633e930a1+8:22710:x1875571085895808:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788684495.846732:0:22725:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6746d86c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cebd1789-51a4-46ff-b167-6b1633e930a1+9:22710:x1875571085895808:12345-0@lo:501:mount.lustre.0 Request processed in 158us (318us total) trans 0 rc 0/0 00000100:00100000:2.0:1788684495.846746:0:22725:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788684495.847139:0:22710:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d677fb44000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cebd1789-51a4-46ff-b167-6b1633e930a1:22710:1875571085895808:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788684495.847171:0:22710:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d677fb44000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cebd1789-51a4-46ff-b167-6b1633e930a1:22710:1875571085895936:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788684495.847213:0:22710:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788684495.847242:0:22710:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d6744e11d80 going to sleep for 11 seconds 00000100:00100000:3.0:1788684495.847346:0:22726:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085895936 00000100:00100000:3.0:1788684495.847351:0:22726:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085895936 00000100:00100000:3.0:1788684495.847393:0:22726:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788684495.847400:0:22726:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6746d86450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cebd1789-51a4-46ff-b167-6b1633e930a1+9:22710:x1875571085895936:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788684495.849309:0:22726:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6746d86450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cebd1789-51a4-46ff-b167-6b1633e930a1+9:22710:x1875571085895936:12345-0@lo:503:mount.lustre.0 Request processed in 1902us (2088us total) trans 0 rc 0/0 00000100:00100000:3.0:1788684495.849321:0:22726:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788684495.849547:0:22710:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d677fb44000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cebd1789-51a4-46ff-b167-6b1633e930a1:22710:1875571085895936:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788684495.850472:0:22750:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6647908380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:cebd1789-51a4-46ff-b167-6b1633e930a1:22750:1875571085896064:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788684495.850912:0:22750:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788684495.850955:0:22750:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d664867e0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788684495.851014:0:22725:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085896064 00000100:00100000:2.0:1788684495.851020:0:22725:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085896064 00000100:00100000:2.0:1788684495.851066:0:22725:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1788684495.851075:0:22725:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6746d87050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cebd1789-51a4-46ff-b167-6b1633e930a1+9:22750:x1875571085896064:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788684495.852455:0:22725:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6746d87050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cebd1789-51a4-46ff-b167-6b1633e930a1+9:22750:x1875571085896064:12345-0@lo:502:llog_process_th.0 Request processed in 1376us (1649us total) trans 0 rc 0/0 00000100:00100000:2.0:1788684495.852467:0:22725:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1788684495.855978:0:22750:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6647908380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:cebd1789-51a4-46ff-b167-6b1633e930a1:22750:1875571085896064:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1788684495.856025:0:22750:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788684495.856038:0:22750:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788684495.856040:0:22750:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:3.0:1788684495.856044:0:22750:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:3.0:1788684495.856047:0:22750:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1788684495.856061:0:22750:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (ffff8d6645b1b380) 00000020:00000080:3.0:1788684495.856078:0:22750:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:3.0:1788684495.856083:0:22750:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:3.0:1788684495.856171:0:22750:0:(osd_handler.c:8924:osd_obd_connect()) connect #2 00000020:00000080:3.0:1788684495.856178:0:22750:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x44bac02bd54adcd6 00000020:00000080:3.0:1788684495.856780:0:22750:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:3.0:1788684495.856786:0:22750:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788684495.856791:0:22750:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788684495.856792:0:22750:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:3.0:1788684495.856795:0:22750:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788684495.856908:0:22750:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788684495.856911:0:22750:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:3.0:1788684495.856917:0:22750:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1788684495.856935:0:22750:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (ffff8d6645b199c0) 00000020:00000080:3.0:1788684495.856946:0:22750:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:3.0:1788684495.856951:0:22750:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:3.0:1788684495.856953:0:22750:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:3.0:1788684495.856955:0:22750:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:3.0:1788684495.856961:0:22750:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:3.0:1788684495.857011:0:22750:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8d677cb59000 from lustre-MDT0000, refs=3 00000020:00000080:3.0:1788684495.857023:0:22750:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (ffff8d6645b18000) 00000020:00000080:3.0:1788684495.857031:0:22750:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:3.0:1788684495.857088:0:22750:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:3.0:1788684495.857094:0:22750:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x44bac02bd54adceb 00000020:00000080:3.0:1788684495.858099:0:22750:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:3.0:1788684495.858108:0:22750:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:3.0:1788684495.858116:0:22750:0:(genops.c:1385:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0x44bac02bd54adcf2 00080000:01000000:3.0:1788684495.858199:0:22750:0:(osd_handler.c:8924:osd_obd_connect()) connect #3 00000020:00000080:3.0:1788684495.858205:0:22750:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x44bac02bd54adcf9 00010000:00010000:3.0:1788684495.997326:0:22750:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:00000004:3.0:1788684495.999964:0:22750:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 3, last_transno is 8589934628 00000001:00080000:3.0:1788684496.003424:0:22750:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:3.0:1788684496.004666:0:22750:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (ffff8d6645b1cd40) 00000020:00000080:2.0:1788684496.005021:0:22750:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:2.0:1788684496.005110:0:22750:0:(osd_handler.c:8924:osd_obd_connect()) connect #4 00000020:00000080:2.0:1788684496.005130:0:22750:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x44bac02bd54add07 00000020:00000080:3.0:1788684496.010067:0:22750:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:2.0:1788684496.031262:0:22750:0:(genops.c:1385:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0x44bac02bd54add0e 00000020:00000080:2.0:1788684496.031867:0:22750:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:2.0:1788684496.031878:0:22750:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788684496.031884:0:22750:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788684496.031887:0:22750:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:2.0:1788684496.031889:0:22750:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:2.0:1788684496.031892:0:22750:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #9 00000020:01000000:2.0:1788684496.031894:0:22750:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1788684496.031896:0:22750:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1788684496.031897:0:22750:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:2.0:1788684496.031900:0:22750:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788684496.031901:0:22750:0:(obd_config.c:1563:class_process_config()) marker 9 (0x6) lustre sys.timeout 00000020:01000000:2.0:1788684496.031904:0:22750:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788684496.031909:0:22750:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788684496.031910:0:22750:0:(obd_config.c:1563:class_process_config()) marker 10 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:2.0:1788684496.031915:0:22750:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:2.0:1788684496.031952:0:22750:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:2.0:1788684496.031967:0:22750:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788684496.031970:0:22750:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788684496.031977:0:22750:0:(obd_config.c:1563:class_process_config()) marker 10 (0x2) lustre-MDT0000 mdt.identity_upcall 00000020:01000000:2.0:1788684496.031981:0:22750:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788684496.031984:0:22750:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788684496.031985:0:22750:0:(obd_config.c:1563:class_process_config()) marker 17 (0x1) lustre-MDT0001 add osp 00000020:00000080:2.0:1788684496.031988:0:22750:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1788684496.031993:0:22750:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.206.144@tcp to nid 0x20000c0a8ce90 (192.168.206.144@tcp) 00000020:00000080:2.0:1788684496.032016:0:22750:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1788684496.032029:0:22750:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-osp-MDT0000 (ffff8d677cf2b380) 00000020:00000080:2.0:1788684496.032042:0:22750:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type osp with refcount 2 00000020:00000080:2.0:1788684496.032047:0:22750:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:2.0:1788684496.032098:0:22750:0:(osp_dev.c:1203:osp_init0()) lustre-MDT0001-osp-MDT0000: connect to lustre-MDT0000-osd (lustre-MDT0001-osp-MDT0000) 00080000:01000000:2.0:1788684496.032103:0:22750:0:(osd_handler.c:8924:osd_obd_connect()) connect #5 00000020:00000080:2.0:1788684496.032110:0:22750:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x44bac02bd54add1c 00010000:00080000:2.0:1788684496.032282:0:22750:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8d6775fa3000@lustre-MDT0001-osp-MDT0000: add connection 192.168.206.144@tcp at head 00010000:00010000:2.0:1788684496.044009:0:22750:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-osp-MDT0000-1 is initialized 00000020:00000080:3.0:1788684496.046989:0:22750:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-osp-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1788684496.047004:0:22750:0:(obd_config.c:1472:class_process_config()) processing cmd: cf014 00000004:01000000:3.0:1788684496.047041:0:22750:0:(lod_lov.c:128:lod_add_device()) osp:lustre-MDT0001_UUID idx:1 gen:1 00000020:00000080:3.0:1788684496.047060:0:22750:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x44bac02bd54add23 00000100:00080000:3.0:1788684496.047070:0:22750:0:(import.c:545:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1788684496.047076:0:22750:0:(import.c:665:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff8d6775fa3000 using connection 192.168.206.144@tcp/0@lo 00000100:00100000:3.0:1788684496.047112:0:22750:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8d6647908380 x1875571085896192/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788684496.047195:0:3622:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6647908380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3622:1875571085896192:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1788684496.047273:0:3622:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788684496.047409:0:22737:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085896192 00000100:00100000:2.0:1788684496.047418:0:22737:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085896192 00000100:00100000:2.0:1788684496.047450:0:22737:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788684496.047458:0:22737:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d674698f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3622:x1875571085896192:12345-0@lo:38:llog_process_th.0 00010000:00020000:2.0:1788684496.047473:0:22737:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00080000:3.0:1788684496.051962:0:22750:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID 00000020:01000000:3.0:1788684496.052067:0:22750:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788684496.052085:0:22750:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788684496.052087:0:22750:0:(obd_config.c:1563:class_process_config()) marker 17 (0x2) lustre-MDT0001 add osp 00000020:01000000:3.0:1788684496.052092:0:22750:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:3.0:1788684496.052095:0:22750:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #20 00000020:01000000:3.0:1788684496.052096:0:22750:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1788684496.052098:0:22750:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1788684496.052100:0:22750:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:3.0:1788684496.052102:0:22750:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788684496.052104:0:22750:0:(obd_config.c:1563:class_process_config()) marker 20 (0x6) lustre sys.timeout 00000020:01000000:3.0:1788684496.052106:0:22750:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1788684496.052111:0:22750:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:3.0:1788684496.052115:0:22750:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788684496.052116:0:22750:0:(obd_config.c:1563:class_process_config()) marker 22 (0x1) lustre-OST0000 add osc 00000020:00000080:3.0:1788684496.052119:0:22750:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1788684496.052123:0:22750:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.206.144@tcp to nid 0x20000c0a8ce90 (192.168.206.144@tcp) 00000020:01000000:3.0:1788684496.052145:0:22750:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:3.0:1788684496.052148:0:22750:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1788684496.052175:0:22750:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff8d677e140000) 00000020:00000080:3.0:1788684496.052194:0:22750:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osp with refcount 2 00000020:00000080:3.0:1788684496.052199:0:22750:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1788684496.052294:0:22750:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:3.0:1788684496.052300:0:22750:0:(osd_handler.c:8924:osd_obd_connect()) connect #6 00000020:00000080:3.0:1788684496.052306:0:22750:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x44bac02bd54add31 00010000:00080000:3.0:1788684496.052335:0:22750:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8d677fab9000@lustre-OST0000-osc-MDT0000: add connection 192.168.206.144@tcp at head 00010000:00010000:3.0:1788684496.054114:0:22750:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-2 is initialized 00000100:00100000:0.0:1788684496.054522:0:3624:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d677fb44000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:cebd1789-51a4-46ff-b167-6b1633e930a1:3624:1875571085896320:0@lo:400:kworker.0 00000100:00100000:0.0:1788684496.054586:0:3624:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788684496.054678:0:22726:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085896320 00000100:00100000:0.0:1788684496.054686:0:22726:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085896320 00000100:00100000:0.0:1788684496.054738:0:22726:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1788684496.054746:0:22726:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6746d84050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cebd1789-51a4-46ff-b167-6b1633e930a1+9:3624:x1875571085896320:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788684496.054814:0:22726:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6746d84050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cebd1789-51a4-46ff-b167-6b1633e930a1+9:3624:x1875571085896320:12345-0@lo:400:kworker.0 Request processed in 68us (228us total) trans 0 rc 0/0 00000100:00100000:0.0:1788684496.054822:0:22726:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1788684496.054867:0:3624:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d677fb44000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:cebd1789-51a4-46ff-b167-6b1633e930a1:3624:1875571085896320:0@lo:400:kworker.0 00000040:01000000:3.0:1788684496.058923:0:22750:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:3.0:1788684496.059675:0:22750:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:0.0:1788684496.083998:0:22750:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788684496.085218:0:22750:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].3, 64 off8384 00000040:00080000:0.0:1788684496.085438:0:22750:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x10:0x0].1, 64 off8256 00000040:00080000:0.0:1788684496.086441:0:22756:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:0.0:1788684496.086446:0:22756:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x10:0x0] at index 3 of catalog [0x1:0x2:0x0] 00000020:00000080:0.0:1788684496.090246:0:22750:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1788684496.090285:0:22750:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:0.0:1788684496.090343:0:22750:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:0.0:1788684496.090385:0:22750:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x44bac02bd54add38 00000100:00080000:0.0:1788684496.090396:0:22750:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1788684496.090402:0:22750:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff8d677fab9000 using connection 192.168.206.144@tcp/0@lo 00000100:00100000:0.0:1788684496.090441:0:22750:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8d677fb44000 x1875571085896448/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788684496.090469:0:22750:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000100:00100000:1.0:1788684496.090683:0:3622:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d677fb44000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3622:1875571085896448:0@lo:8:llog_process_th.0 00000400:00000100:1.0:1788684496.090778:0:3622:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875571085896448 offset 0 length 520: 4 00000020:01000000:0.0:1788684496.091081:0:22750:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788684496.091085:0:22750:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788684496.091087:0:22750:0:(obd_config.c:1563:class_process_config()) marker 22 (0x2) lustre-OST0000 add osc 00000020:01000000:0.0:1788684496.091090:0:22750:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:0.0:1788684496.091093:0:22750:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #28 00000020:01000000:0.0:1788684496.091095:0:22750:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1788684496.091096:0:22750:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1788684496.091098:0:22750:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:0.0:1788684496.091100:0:22750:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788684496.091102:0:22750:0:(obd_config.c:1563:class_process_config()) marker 28 (0x6) lustre sys.timeout 00000020:01000000:0.0:1788684496.091104:0:22750:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1788684496.091109:0:22750:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:0.0:1788684496.091112:0:22750:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788684496.091123:0:22750:0:(obd_config.c:1563:class_process_config()) marker 30 (0x1) lustre-OST0001 add osc 00000020:00000080:0.0:1788684496.091128:0:22750:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:0.0:1788684496.091131:0:22750:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.206.144@tcp to nid 0x20000c0a8ce90 (192.168.206.144@tcp) 00000020:01000000:0.0:1788684496.091150:0:22750:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:0.0:1788684496.091152:0:22750:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1788684496.091173:0:22750:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff8d67482e0000) 00000020:00000080:0.0:1788684496.091195:0:22750:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type osp with refcount 2 00000020:00000080:0.0:1788684496.091201:0:22750:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:0.0:1788684496.091289:0:22750:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:0.0:1788684496.091295:0:22750:0:(osd_handler.c:8924:osd_obd_connect()) connect #7 00000020:00000080:0.0:1788684496.091301:0:22750:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x44bac02bd54add46 00010000:00080000:0.0:1788684496.091333:0:22750:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8d6775fa5800@lustre-OST0001-osc-MDT0000: add connection 192.168.206.144@tcp at head 00010000:00010000:0.0:1788684496.091611:0:22750:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-3 is initialized 00000040:01000000:0.0:1788684496.091677:0:22750:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:0.0:1788684496.091703:0:22750:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:1.0:1788684496.100756:0:22750:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788684496.101341:0:22750:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].3, 64 off8384 00000040:00080000:1.0:1788684496.101557:0:22750:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x12:0x0].1, 64 off8256 00000100:00100000:2.0:1788684496.101959:0:22737:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d674698f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3622:x1875571085896192:12345-0@lo:38:llog_process_th.0 Request processed in 54496us (54680us total) trans 0 rc -19/-19 00000100:00100000:2.0:1788684496.101971:0:22737:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00080000:2.0:1788684496.102027:0:3622:0:(import.c:65:import_set_state_nolock()) ffff8d6775fa3000 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788684496.102033:0:3622:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1788684496.102038:0:3622:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6647908380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3622:1875571085896192:0@lo:38:llog_process_th.0 00000040:00080000:1.0:1788684496.106127:0:22758:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:1.0:1788684496.106135:0:22758:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x12:0x0] at index 3 of catalog [0x1:0x5:0x0] 00000020:00000080:3.0:1788684496.107120:0:22750:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1788684496.107133:0:22750:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:3.0:1788684496.107180:0:22750:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:3.0:1788684496.107199:0:22750:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x44bac02bd54add4d 00000100:00080000:3.0:1788684496.107208:0:22750:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1788684496.107235:0:22750:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff8d6775fa5800 using connection 192.168.206.144@tcp/0@lo 00000100:00100000:3.0:1788684496.107280:0:22750:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8d6647908000 x1875571085896576/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788684496.107307:0:22750:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:3.0:1788684496.107355:0:22750:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788684496.107359:0:22750:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788684496.107361:0:22750:0:(obd_config.c:1563:class_process_config()) marker 30 (0x2) lustre-OST0001 add osc 00000020:01000000:3.0:1788684496.107393:0:22750:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788684496.107397:0:22750:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788684496.107399:0:22750:0:(obd_config.c:1563:class_process_config()) marker 36 (0x1) lustre sys.timeout 00000020:00000080:3.0:1788684496.107402:0:22750:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1788684496.107404:0:22750:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:3.0:1788684496.107406:0:22750:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788684496.107408:0:22750:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788684496.107410:0:22750:0:(obd_config.c:1563:class_process_config()) marker 36 (0x2) lustre sys.timeout 00000020:01000000:3.0:1788684496.107412:0:22750:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788684496.107414:0:22750:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788684496.107416:0:22750:0:(obd_config.c:1563:class_process_config()) marker 41 (0x1) lustre sys.jobid_var 00000020:00000080:3.0:1788684496.107419:0:22750:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:3.0:1788684496.107450:0:22750:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d664790b100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:cebd1789-51a4-46ff-b167-6b1633e930a1:22750:1875571085896704:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788684496.107524:0:22750:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788684496.107556:0:22750:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d677cef4840 going to sleep for 11 seconds 00000100:00100000:2.0:1788684496.107712:0:3622:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6647908000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3622:1875571085896576:0@lo:8:llog_process_th.0 00000400:00000100:2.0:1788684496.107740:0:3622:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875571085896576 offset 0 length 520: 4 00000100:00100000:2.0:1788684496.107791:0:22725:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085896704 00000100:00100000:2.0:1788684496.107797:0:22725:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085896704 00000100:00100000:2.0:1788684496.107850:0:22725:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788684496.107860:0:22725:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6746d84c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cebd1789-51a4-46ff-b167-6b1633e930a1+9:22750:x1875571085896704:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788684496.107961:0:22725:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6746d84c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cebd1789-51a4-46ff-b167-6b1633e930a1+9:22750:x1875571085896704:12345-0@lo:502:llog_process_th.0 Request processed in 102us (436us total) trans 0 rc 0/0 00000100:00100000:2.0:1788684496.107969:0:22725:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1788684496.108743:0:22750:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d664790b100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:cebd1789-51a4-46ff-b167-6b1633e930a1:22750:1875571085896704:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1788684496.108928:0:22750:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788684496.108935:0:22750:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788684496.108937:0:22750:0:(obd_config.c:1563:class_process_config()) marker 41 (0x2) lustre sys.jobid_var 00000040:00080000:3.0:1788684496.108941:0:22750:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 46 count 46 00000020:01000000:1.0:1788684496.109091:0:22710:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-45 (rc=0) 10000000:01000000:1.0:1788684496.109112:0:22710:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.144@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:1.0:1788684496.109126:0:22710:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.144@tcp lock: ffff8d6746d3ee00/0x44bac02bd54adcc1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x44bac02bd54adcc8 expref: -99 pid: 22710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684496.109150:0:22710:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.144@tcp lock: ffff8d6746d3ee00/0x44bac02bd54adcc1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x44bac02bd54adcc8 expref: -99 pid: 22710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788684496.109170:0:22710:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8d677cb59000 from 1 10000000:01000000:1.0:1788684496.109173:0:22710:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1788684496.109205:0:22710:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.144@tcp lock: ffff8d6746cb3c00/0x44bac02bd54add54 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684496.109213:0:22710:0:(ldlm_request.c:1106:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.144@tcp lock: ffff8d6746cb3c00/0x44bac02bd54add54 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684496.109222:0:22710:0:(ldlm_request.c:1193:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.144@tcp lock: ffff8d6746cb3c00/0x44bac02bd54add54 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788684496.109239:0:22710:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d674698e680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cebd1789-51a4-46ff-b167-6b1633e930a1:22710:1875571085896832:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1788684496.109290:0:22710:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788684496.109327:0:22710:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d6748205600 going to sleep for 11 seconds 00000100:00100000:3.0:1788684496.110648:0:22727:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085896832 00000100:00100000:3.0:1788684496.110659:0:22727:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085896832 00000100:00100000:3.0:1788684496.110905:0:22727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1788684496.110915:0:22727:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6746d87850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cebd1789-51a4-46ff-b167-6b1633e930a1+9:22710:x1875571085896832:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788684496.110941:0:22727:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788684496.110956:0:22727:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d66479a0800/0x44bac02bd54add5b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x44bac02bd54add54 expref: -99 pid: 22727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684496.110979:0:22727:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d66479a0800/0x44bac02bd54add5b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x44bac02bd54add54 expref: 10 pid: 22727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684496.110990:0:22727:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d66479a0800/0x44bac02bd54add5b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x44bac02bd54add54 expref: 10 pid: 22727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684496.110999:0:22727:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d66479a0800, rc 0) 00000100:00100000:3.0:1788684496.111051:0:22727:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6746d87850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cebd1789-51a4-46ff-b167-6b1633e930a1+10:22710:x1875571085896832:12345-0@lo:101:mount.lustre.0 Request processed in 138us (1760us total) trans 0 rc 0/0 00000100:00100000:3.0:1788684496.111058:0:22727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1788684496.111144:0:22710:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d674698e680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cebd1789-51a4-46ff-b167-6b1633e930a1:22710:1875571085896832:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788684496.111922:0:22710:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.144@tcp lock: ffff8d6746cb3c00/0x44bac02bd54add54 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x44bac02bd54add5b expref: -99 pid: 22710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684496.111936:0:22710:0:(ldlm_request.c:840:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.144@tcp lock: ffff8d6746cb3c00/0x44bac02bd54add54 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x44bac02bd54add5b expref: -99 pid: 22710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788684496.115073:0:22710:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d674698e680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cebd1789-51a4-46ff-b167-6b1633e930a1:22710:1875571085896960:0@lo:256:mount.lustre.0 00000100:00100000:1.0:1788684496.115149:0:22710:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788684496.115646:0:22710:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d6748205600 going to sleep for 11 seconds 00000100:00100000:1.0:1788684496.115735:0:22725:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085896960 00000100:00100000:1.0:1788684496.115743:0:22725:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085896960 00000100:00100000:1.0:1788684496.115980:0:22725:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1788684496.115994:0:22725:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6746d86050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cebd1789-51a4-46ff-b167-6b1633e930a1+10:22710:x1875571085896960:12345-0@lo:256:mount.lustre.0 20000000:01000000:1.0:1788684496.116014:0:22725:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:1.0:1788684496.116020:0:22725:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:1.0:1788684496.116107:0:22725:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6746d86050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cebd1789-51a4-46ff-b167-6b1633e930a1+10:22710:x1875571085896960:12345-0@lo:256:mount.lustre.0 Request processed in 117us (957us total) trans 0 rc 0/0 00000100:00100000:2.0:1788684496.116474:0:22710:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d674698e680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cebd1789-51a4-46ff-b167-6b1633e930a1:22710:1875571085896960:0@lo:256:mount.lustre.0 10000000:01000000:2.0:1788684496.117042:0:22710:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.144@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1788684496.117068:0:22710:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.144@tcp lock: ffff8d6746cb3c00/0x44bac02bd54add54 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x44bac02bd54add5b expref: -99 pid: 22710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684496.117080:0:22710:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.144@tcp lock: ffff8d6746cb3c00/0x44bac02bd54add54 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x44bac02bd54add5b expref: -99 pid: 22710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788684496.117089:0:22710:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8d677cb59000 from 1 10000000:01000000:2.0:1788684496.117091:0:22710:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788684496.117126:0:22710:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.144@tcp lock: ffff8d66476d5400/0x44bac02bd54add62 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684496.117134:0:22710:0:(ldlm_request.c:1106:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.144@tcp lock: ffff8d66476d5400/0x44bac02bd54add62 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684496.117144:0:22710:0:(ldlm_request.c:1193:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.144@tcp lock: ffff8d66476d5400/0x44bac02bd54add62 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788684496.117162:0:22710:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d677fa80700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cebd1789-51a4-46ff-b167-6b1633e930a1:22710:1875571085897088:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1788684496.117215:0:22710:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788684496.117246:0:22710:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d664867e0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788684496.118070:0:22726:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085897088 00000100:00100000:3.0:1788684496.118079:0:22726:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085897088 00000100:00100000:3.0:1788684496.118110:0:22726:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1788684496.118118:0:22726:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d677ccdd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cebd1789-51a4-46ff-b167-6b1633e930a1+11:22710:x1875571085897088:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788684496.118131:0:22726:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788684496.118147:0:22726:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d66479a1400/0x44bac02bd54add69 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x44bac02bd54add62 expref: -99 pid: 22726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684496.118180:0:22726:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d66479a1400/0x44bac02bd54add69 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x44bac02bd54add62 expref: 12 pid: 22726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684496.118198:0:22726:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d66479a1400/0x44bac02bd54add69 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x44bac02bd54add62 expref: 12 pid: 22726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684496.118207:0:22726:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d66479a1400, rc 0) 00000100:00100000:3.0:1788684496.118281:0:22726:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d677ccdd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cebd1789-51a4-46ff-b167-6b1633e930a1+12:22710:x1875571085897088:12345-0@lo:101:mount.lustre.0 Request processed in 163us (1065us total) trans 0 rc 0/0 00000100:00100000:3.0:1788684496.118289:0:22726:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1788684496.118506:0:22710:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d677fa80700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cebd1789-51a4-46ff-b167-6b1633e930a1:22710:1875571085897088:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788684496.118522:0:22710:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.144@tcp lock: ffff8d66476d5400/0x44bac02bd54add62 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x44bac02bd54add69 expref: -99 pid: 22710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684496.118531:0:22710:0:(ldlm_request.c:840:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.144@tcp lock: ffff8d66476d5400/0x44bac02bd54add62 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x44bac02bd54add69 expref: -99 pid: 22710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788684496.118593:0:22710:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d677fa80700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cebd1789-51a4-46ff-b167-6b1633e930a1:22710:1875571085897216:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788684496.118638:0:22710:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788684496.118664:0:22710:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d664867e0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788684496.119136:0:22726:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085897216 00000100:00100000:3.0:1788684496.119141:0:22726:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085897216 00000100:00100000:3.0:1788684496.119330:0:22726:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1788684496.119340:0:22726:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d677ccde450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cebd1789-51a4-46ff-b167-6b1633e930a1+12:22710:x1875571085897216:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788684496.119932:0:22726:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d677ccde450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cebd1789-51a4-46ff-b167-6b1633e930a1+12:22710:x1875571085897216:12345-0@lo:501:mount.lustre.0 Request processed in 592us (1291us total) trans 0 rc 0/0 00000100:00100000:3.0:1788684496.119940:0:22726:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1788684496.120046:0:22725:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1788684496.120114:0:22710:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d677fa80700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cebd1789-51a4-46ff-b167-6b1633e930a1:22710:1875571085897216:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788684496.120287:0:22710:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d677fb46d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cebd1789-51a4-46ff-b167-6b1633e930a1:22710:1875571085897344:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788684496.120339:0:22710:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788684496.120999:0:22710:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d6777111000 going to sleep for 11 seconds 00000100:00100000:1.0:1788684496.121070:0:22725:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085897344 00000100:00100000:1.0:1788684496.121077:0:22725:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085897344 00000100:00100000:1.0:1788684496.121146:0:22725:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1788684496.121164:0:22725:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d677ccddc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cebd1789-51a4-46ff-b167-6b1633e930a1+11:22710:x1875571085897344:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788684496.121288:0:22725:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d677ccddc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cebd1789-51a4-46ff-b167-6b1633e930a1+11:22710:x1875571085897344:12345-0@lo:503:mount.lustre.0 Request processed in 134us (948us total) trans 0 rc 0/0 00000100:00100000:1.0:1788684496.121295:0:22725:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1788684496.121382:0:22710:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d677fb46d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cebd1789-51a4-46ff-b167-6b1633e930a1:22710:1875571085897344:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788684496.123042:0:22760:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d677fa80380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:cebd1789-51a4-46ff-b167-6b1633e930a1:22760:1875571085897472:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788684496.123105:0:22760:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788684496.123144:0:22760:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d664867e0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788684496.123212:0:22726:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085897472 00000100:00100000:0.0:1788684496.123218:0:22726:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085897472 00000100:00100000:0.0:1788684496.123268:0:22726:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1788684496.123276:0:22726:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d677ccdf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cebd1789-51a4-46ff-b167-6b1633e930a1+11:22760:x1875571085897472:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788684496.124172:0:22726:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d677ccdf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cebd1789-51a4-46ff-b167-6b1633e930a1+11:22760:x1875571085897472:12345-0@lo:502:llog_process_th.0 Request processed in 893us (1063us total) trans 0 rc 0/0 00000100:00100000:2.0:1788684496.124327:0:22760:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d677fa80380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:cebd1789-51a4-46ff-b167-6b1633e930a1:22760:1875571085897472:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788684496.124362:0:22760:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788684496.124397:0:22760:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788684496.124400:0:22760:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:2.0:1788684496.124407:0:22760:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8d677cb59000 00000020:00000080:2.0:1788684496.124410:0:22760:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1788684496.124418:0:22760:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788684496.124421:0:22760:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788684496.124423:0:22760:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:2.0:1788684496.124425:0:22760:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788684496.124427:0:22760:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788684496.124429:0:22760:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:2.0:1788684496.124432:0:22760:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8d677cb59000 00000020:00000080:2.0:1788684496.124434:0:22760:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1788684496.124487:0:22760:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788684496.124498:0:22760:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788684496.124499:0:22760:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:2.0:1788684496.124502:0:22760:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788684496.124505:0:22760:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788684496.124506:0:22760:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1788684496.124509:0:22760:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8d677cb59000 00000020:00000080:2.0:1788684496.124511:0:22760:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1788684496.124531:0:22760:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788684496.124534:0:22760:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788684496.124535:0:22760:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1788684496.124537:0:22760:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788684496.124540:0:22760:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788684496.124541:0:22760:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:2.0:1788684496.124544:0:22760:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8d677cb59000 00000020:00000080:2.0:1788684496.124546:0:22760:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1788684496.124584:0:22760:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d677fa80380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:cebd1789-51a4-46ff-b167-6b1633e930a1:22760:1875571085897600:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788684496.126326:0:22760:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788684496.126384:0:22760:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d6745297180 going to sleep for 11 seconds 00000100:00100000:0.0:1788684496.126711:0:22726:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1788684496.126770:0:22726:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085897600 00000100:00100000:0.0:1788684496.126777:0:22726:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085897600 00000100:00100000:0.0:1788684496.126919:0:22726:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1788684496.126929:0:22726:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d677ccdcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cebd1789-51a4-46ff-b167-6b1633e930a1+11:22760:x1875571085897600:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788684496.127047:0:22726:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d677ccdcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cebd1789-51a4-46ff-b167-6b1633e930a1+11:22760:x1875571085897600:12345-0@lo:502:llog_process_th.0 Request processed in 119us (725us total) trans 0 rc 0/0 00000100:00100000:0.0:1788684496.127061:0:22726:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1788684496.127939:0:22760:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d677fa80380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:cebd1789-51a4-46ff-b167-6b1633e930a1:22760:1875571085897600:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788684496.127977:0:22760:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788684496.127985:0:22760:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788684496.127988:0:22760:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:2.0:1788684496.127992:0:22760:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 13 count 13 00000020:01000000:0.0:1788684496.130731:0:22710:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:0.0:1788684496.130776:0:22710:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.144@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788684496.130795:0:22710:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.144@tcp lock: ffff8d66476d5400/0x44bac02bd54add62 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x44bac02bd54add69 expref: -99 pid: 22710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684496.130961:0:22710:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.144@tcp lock: ffff8d66476d5400/0x44bac02bd54add62 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x44bac02bd54add69 expref: -99 pid: 22710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788684496.131014:0:22710:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:0.0:1788684496.131018:0:22710:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff8d677cb59000 10000000:01000000:0.0:1788684496.131021:0:22710:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff8d677cb59000 10000000:01000000:0.0:1788684496.131025:0:22710:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1788684496.131031:0:22710:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8d677cb59000 from 1 10000000:01000000:0.0:1788684496.131034:0:22710:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1788684496.131068:0:22710:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.144@tcp lock: ffff8d6746d3fe00/0x44bac02bd54add70 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684496.131077:0:22710:0:(ldlm_request.c:1106:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.144@tcp lock: ffff8d6746d3fe00/0x44bac02bd54add70 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684496.131088:0:22710:0:(ldlm_request.c:1193:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.144@tcp lock: ffff8d6746d3fe00/0x44bac02bd54add70 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788684496.131110:0:22710:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d677fb46d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cebd1789-51a4-46ff-b167-6b1633e930a1:22710:1875571085897728:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1788684496.131262:0:22710:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788684496.131304:0:22710:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d6744e11180 going to sleep for 11 seconds 00000100:00100000:0.0:1788684496.131329:0:22726:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085897728 00000100:00100000:0.0:1788684496.131336:0:22726:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085897728 00000100:00100000:0.0:1788684496.131413:0:22726:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1788684496.131422:0:22726:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d677ccdf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cebd1789-51a4-46ff-b167-6b1633e930a1+11:22710:x1875571085897728:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788684496.131433:0:22726:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788684496.131446:0:22726:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d6746d3ec00/0x44bac02bd54add77 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x44bac02bd54add70 expref: -99 pid: 22726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684496.131469:0:22726:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d6746d3ec00/0x44bac02bd54add77 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x44bac02bd54add70 expref: 12 pid: 22726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684496.131481:0:22726:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d6746d3ec00/0x44bac02bd54add77 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x44bac02bd54add70 expref: 12 pid: 22726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684496.131490:0:22726:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d6746d3ec00, rc 0) 00000100:00100000:0.0:1788684496.131524:0:22726:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d677ccdf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cebd1789-51a4-46ff-b167-6b1633e930a1+12:22710:x1875571085897728:12345-0@lo:101:mount.lustre.0 Request processed in 103us (341us total) trans 0 rc 0/0 00000100:00100000:0.0:1788684496.131531:0:22726:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1788684496.131582:0:22710:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d677fb46d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cebd1789-51a4-46ff-b167-6b1633e930a1:22710:1875571085897728:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788684496.131596:0:22710:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.144@tcp lock: ffff8d6746d3fe00/0x44bac02bd54add70 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x44bac02bd54add77 expref: -99 pid: 22710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684496.132891:0:22710:0:(ldlm_request.c:840:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.144@tcp lock: ffff8d6746d3fe00/0x44bac02bd54add70 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x44bac02bd54add77 expref: -99 pid: 22710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788684496.132974:0:22710:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d677fb46d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cebd1789-51a4-46ff-b167-6b1633e930a1:22710:1875571085897856:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788684496.133024:0:22710:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788684496.133056:0:22710:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d6744e11180 going to sleep for 11 seconds 00000100:00100000:0.0:1788684496.133080:0:22726:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085897856 00000100:00100000:0.0:1788684496.133085:0:22726:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085897856 00000100:00100000:0.0:1788684496.133125:0:22726:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1788684496.133133:0:22726:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d677ccdec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cebd1789-51a4-46ff-b167-6b1633e930a1+12:22710:x1875571085897856:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788684496.134474:0:22726:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d677ccdec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cebd1789-51a4-46ff-b167-6b1633e930a1+12:22710:x1875571085897856:12345-0@lo:501:mount.lustre.0 Request processed in 1336us (1444us total) trans 0 rc 0/0 00000100:00100000:0.0:1788684496.134484:0:22726:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1788684496.134549:0:22710:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d677fb46d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cebd1789-51a4-46ff-b167-6b1633e930a1:22710:1875571085897856:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788684496.134591:0:22710:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d677fb46d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cebd1789-51a4-46ff-b167-6b1633e930a1:22710:1875571085897984:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788684496.137792:0:22710:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788684496.138119:0:22710:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d6744e11180 going to sleep for 11 seconds 00000100:00100000:3.0:1788684496.140338:0:22726:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085897984 00000100:00100000:3.0:1788684496.140351:0:22726:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085897984 00000100:00100000:3.0:1788684496.140424:0:22726:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1788684496.140434:0:22726:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d677ccdd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cebd1789-51a4-46ff-b167-6b1633e930a1+12:22710:x1875571085897984:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788684496.140581:0:22726:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d677ccdd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cebd1789-51a4-46ff-b167-6b1633e930a1+12:22710:x1875571085897984:12345-0@lo:503:mount.lustre.0 Request processed in 148us (2796us total) trans 0 rc 0/0 00000100:00100000:3.0:1788684496.140589:0:22726:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1788684496.140986:0:22710:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d677fb46d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cebd1789-51a4-46ff-b167-6b1633e930a1:22710:1875571085897984:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788684496.143387:0:22763:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d664790b100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:cebd1789-51a4-46ff-b167-6b1633e930a1:22763:1875571085898112:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788684496.143458:0:22763:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788684496.143494:0:22725:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085898112 00000100:00100000:3.0:1788684496.143501:0:22725:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085898112 00000100:00100000:3.0:1788684496.143542:0:22725:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1788684496.143550:0:22725:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d677ccdc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cebd1789-51a4-46ff-b167-6b1633e930a1+12:22763:x1875571085898112:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788684496.143666:0:22725:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d677ccdc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cebd1789-51a4-46ff-b167-6b1633e930a1+12:22763:x1875571085898112:12345-0@lo:502:llog_process_th.0 Request processed in 115us (207us total) trans 0 rc 0/0 00000100:00100000:3.0:1788684496.143675:0:22725:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1788684496.144425:0:22763:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d677cef4480 going to sleep for 11 seconds 00000100:00100000:3.0:1788684496.144460:0:22763:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d664790b100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:cebd1789-51a4-46ff-b167-6b1633e930a1:22763:1875571085898112:0@lo:502:llog_process_th.0 00000020:01000004:3.0:1788684496.144521:0:22763:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:3.0:1788684496.144534:0:22763:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (ffff8d677e144d40) 00000020:00000080:3.0:1788684496.144552:0:22763:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type lwp with refcount 2 00000020:01000004:3.0:1788684496.148943:0:22763:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8d677cb59000 from lustre-MDT0000, refs=4 00000020:01000004:3.0:1788684496.148953:0:22763:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8d677cb59000 from lustre-MDT0000, refs=4 00000020:01000004:3.0:1788684496.148956:0:22763:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8d677cb59000 4 00010000:00080000:3.0:1788684496.148993:0:22763:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8d664742a800@lustre-MDT0000-lwp-MDT0000: add connection 192.168.206.144@tcp at head 00010000:00010000:3.0:1788684496.152776:0:22763:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-4 is initialized 00000020:00000080:3.0:1788684496.157653:0:22763:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:3.0:1788684496.157733:0:22763:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1788684496.157747:0:22763:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0x44bac02bd54add85 00000100:00080000:3.0:1788684496.157758:0:22763:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1788684496.157774:0:22763:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff8d664742a800 using connection 192.168.206.144@tcp/0@lo 00000100:00100000:3.0:1788684496.157973:0:22763:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8d664790b100 x1875571085898240/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788684496.158017:0:3622:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d664790b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3622:1875571085898240:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1788684496.158085:0:3622:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1788684496.158134:0:22763:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:3.0:1788684496.159933:0:22732:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085898240 00000100:00100000:3.0:1788684496.159947:0:22732:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085898240 00000100:00100000:3.0:1788684496.159984:0:22732:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788684496.159992:0:22732:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6647909500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3622:x1875571085898240:12345-0@lo:38:llog_process_th.0 00000100:00100000:3.0:1788684496.160074:0:22732:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6647909500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3622:x1875571085898240:12345-0@lo:38:llog_process_th.0 Request processed in 82us (1989us total) trans 0 rc -11/-11 00000100:00100000:3.0:1788684496.160082:0:22732:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788684496.160132:0:3622:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1788684496.160139:0:3622:0:(import.c:65:import_set_state_nolock()) ffff8d664742a800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788684496.160143:0:3622:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:3.0:1788684496.160146:0:3622:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d664790b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3622:1875571085898240:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1788684496.162056:0:22763:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d664790b100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:cebd1789-51a4-46ff-b167-6b1633e930a1:22763:1875571085898368:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788684496.162125:0:22763:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788684496.162159:0:22727:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085898368 00000100:00100000:3.0:1788684496.162165:0:22727:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085898368 00000100:00100000:3.0:1788684496.162201:0:22727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1788684496.162209:0:22727:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d677ccdf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cebd1789-51a4-46ff-b167-6b1633e930a1+12:22763:x1875571085898368:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788684496.162323:0:22727:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d677ccdf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cebd1789-51a4-46ff-b167-6b1633e930a1+12:22763:x1875571085898368:12345-0@lo:502:llog_process_th.0 Request processed in 114us (197us total) trans 0 rc 0/0 00000100:00100000:3.0:1788684496.162330:0:22727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1788684496.162394:0:22763:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d677cef4f00 going to sleep for 11 seconds 00000100:00100000:3.0:1788684496.162413:0:22763:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d664790b100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:cebd1789-51a4-46ff-b167-6b1633e930a1:22763:1875571085898368:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788684496.162450:0:22763:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d664790b100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:cebd1789-51a4-46ff-b167-6b1633e930a1:22763:1875571085898496:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788684496.162480:0:22763:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788684496.162499:0:22726:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085898496 00000100:00100000:3.0:1788684496.162503:0:22726:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085898496 00000100:00100000:3.0:1788684496.162523:0:22726:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1788684496.162528:0:22726:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d677ccde850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cebd1789-51a4-46ff-b167-6b1633e930a1+12:22763:x1875571085898496:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788684496.162581:0:22726:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d677ccde850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cebd1789-51a4-46ff-b167-6b1633e930a1+12:22763:x1875571085898496:12345-0@lo:502:llog_process_th.0 Request processed in 52us (101us total) trans 0 rc 0/0 00000100:00100000:3.0:1788684496.162588:0:22726:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1788684496.162621:0:22763:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d677cef4f00 going to sleep for 11 seconds 00000100:00100000:3.0:1788684496.162640:0:22763:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d664790b100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:cebd1789-51a4-46ff-b167-6b1633e930a1:22763:1875571085898496:0@lo:502:llog_process_th.0 00000040:00080000:3.0:1788684496.162657:0:22763:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 00000020:01000000:3.0:1788684496.162721:0:22710:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:3.0:1788684496.162740:0:22710:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.144@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1788684496.162755:0:22710:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.144@tcp lock: ffff8d6746d3fe00/0x44bac02bd54add70 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x44bac02bd54add77 expref: -99 pid: 22710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684496.162775:0:22710:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.144@tcp lock: ffff8d6746d3fe00/0x44bac02bd54add70 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x44bac02bd54add77 expref: -99 pid: 22710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:3.0:1788684496.167712:0:22710:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:3.0:1788684496.167716:0:22710:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1788684496.167718:0:22710:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788684496.167719:0:22710:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788684496.167721:0:22710:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788684496.167723:0:22710:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788684496.167724:0:22710:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1788684496.167726:0:22710:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1788684496.167728:0:22710:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788684496.167729:0:22710:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1788684496.167732:0:22710:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020005 00000020:01000004:3.0:1788684496.167736:0:22710:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1788684496.167737:0:22710:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1788684496.167738:0:22710:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788684496.167739:0:22710:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788684496.167740:0:22710:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788684496.167742:0:22710:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788684496.167743:0:22710:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1788684496.167744:0:22710:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1788684496.167745:0:22710:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788684496.167746:0:22710:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1788684496.169062:0:22710:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:3.0:1788684496.169086:0:22710:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d664790b100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cebd1789-51a4-46ff-b167-6b1633e930a1:22710:1875571085898624:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1788684496.169152:0:22710:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788684496.169198:0:22710:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d677cef4f00 going to sleep for 11 seconds 00000100:00100000:3.0:1788684496.169231:0:22725:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085898624 00000100:00100000:3.0:1788684496.169239:0:22725:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085898624 00000100:00100000:3.0:1788684496.169295:0:22725:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1788684496.169304:0:22725:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d677ccdc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cebd1789-51a4-46ff-b167-6b1633e930a1+12:22710:x1875571085898624:12345-0@lo:253:mount.lustre.0 20000000:01000000:3.0:1788684496.169330:0:22725:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:3.0:1788684496.169343:0:22725:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:3.0:1788684496.182038:0:22725:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:3.0:1788684496.182057:0:22725:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:3.0:1788684496.182441:0:22725:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d677ccdc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cebd1789-51a4-46ff-b167-6b1633e930a1+12:22710:x1875571085898624:12345-0@lo:253:mount.lustre.0 Request processed in 13133us (13285us total) trans 0 rc 0/0 00000100:00100000:3.0:1788684496.182454:0:22725:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1788684496.182521:0:22710:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d664790b100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cebd1789-51a4-46ff-b167-6b1633e930a1:22710:1875571085898624:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1788684496.182534:0:22710:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:3.0:1788684496.182537:0:22710:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1788684496.182539:0:22710:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1788684496.182541:0:22710:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788684496.182542:0:22710:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788684496.182543:0:22710:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788684496.182544:0:22710:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788684496.182545:0:22710:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1788684496.182547:0:22710:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1788684496.182549:0:22710:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788684496.182551:0:22710:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:3.0:1788684496.182564:0:22710:0:(tgt_mount.c:2698:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 20000000:01000000:2.0:1788684496.184571:0:22748:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1788684496.184579:0:22748:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1788684496.184600:0:22748:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8d66476d4800/0x44bac02bd54add8c lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 22748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684496.184617:0:22748:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8d66479a0800/0x44bac02bd54add5b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x44bac02bd54add54 expref: 11 pid: 22727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684496.184640:0:22748:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8d66476d4800/0x44bac02bd54add8c lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 22748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684496.184678:0:22748:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8d66479a0800/0x44bac02bd54add5b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x44bac02bd54add54 expref: 11 pid: 22727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684496.184692:0:22748:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8d66479a0800/0x44bac02bd54add5b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x44bac02bd54add54 expref: 11 pid: 22727 timeout: 677 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788684496.184706:0:22748:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d677fa80380 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22748:1875571085898752:0@lo:104: 00000100:00100000:2.0:1788684496.184761:0:22748:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788684496.184863:0:22748:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d6748270480 going to sleep for 11 seconds 00000100:00100000:2.0:1788684496.187839:0:22715:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085898752 00000100:00100000:2.0:1788684496.187852:0:22715:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085898752 00000100:00100000:2.0:1788684496.187903:0:22715:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788684496.187913:0:22715:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d677fa81880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:cebd1789-51a4-46ff-b167-6b1633e930a1+3:22748:x1875571085898752:12345-0@lo:104: 00010000:00010000:2.0:1788684496.187931:0:22715:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.144@tcp lock: ffff8d6746cb3c00/0x44bac02bd54add54 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x44bac02bd54add5b expref: -99 pid: 22710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684496.188017:0:22715:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1788684496.188023:0:22715:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d677fa81880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:cebd1789-51a4-46ff-b167-6b1633e930a1+3:22748:x1875571085898752:12345-0@lo:104: Request processed in 113us (3263us total) trans 0 rc 0/0 00000100:00100000:2.0:1788684496.188030:0:22715:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788684496.188071:0:22748:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d677fa80380 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22748:1875571085898752:0@lo:104: 00010000:00010000:2.0:1788684496.188094:0:22748:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8d66476d4800/0x44bac02bd54add8c lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 22748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684496.189418:0:22721:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788684496.189429:0:22721:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.144@tcp lock: ffff8d6746cb3c00/0x44bac02bd54add54 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x44bac02bd54add5b expref: -99 pid: 22710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684496.189439:0:22721:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d6746cb3c00 already unused, calling callback (ffffffffc1297c20) 10000000:00010000:1.0:1788684496.189444:0:22721:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.144@tcp lock: ffff8d6746cb3c00/0x44bac02bd54add54 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x44bac02bd54add5b expref: -99 pid: 22710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684496.189453:0:22721:0:(ldlm_request.c:1390:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.144@tcp lock: ffff8d6746cb3c00/0x44bac02bd54add54 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x44bac02bd54add5b expref: -99 pid: 22710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788684496.189460:0:22721:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.144@tcp lock: ffff8d6746cb3c00/0x44bac02bd54add54 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x44bac02bd54add5b expref: -99 pid: 22710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788684496.189477:0:22721:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1788684496.189527:0:22721:0:(ldlm_request.c:1438:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.144@tcp lock: ffff8d6746cb3c00/0x44bac02bd54add54 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x44bac02bd54add5b expref: -99 pid: 22710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684496.189534:0:22721:0:(ldlm_request.c:1497:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788684496.189554:0:22721:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.144@tcp lock: ffff8d6746cb3c00/0x44bac02bd54add54 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x44bac02bd54add5b expref: -99 pid: 22710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684496.189562:0:22721:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.144@tcp lock: ffff8d6746cb3c00/0x44bac02bd54add54 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x44bac02bd54add5b expref: -99 pid: 22710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684496.189580:0:22721:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788684496.189581:0:22721:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788684496.189583:0:22721:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788684496.190393:0:3625:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d674698ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:cebd1789-51a4-46ff-b167-6b1633e930a1:3625:1875571085898880:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788684496.190465:0:3625:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788684496.194040:0:22717:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085898880 00000100:00100000:1.0:1788684496.194054:0:22717:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085898880 00010000:00010000:1.0:1788684496.194087:0:22717:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8d66479a0800/0x44bac02bd54add5b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x44bac02bd54add54 expref: 12 pid: 22727 timeout: 677 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788684496.194119:0:22717:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788684496.194127:0:22717:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d677fa80380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cebd1789-51a4-46ff-b167-6b1633e930a1+12:3625:x1875571085898880:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788684496.194140:0:22717:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788684496.194146:0:22717:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8d66479a0800/0x44bac02bd54add5b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x44bac02bd54add54 expref: 12 pid: 22727 timeout: 677 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684496.194157:0:22717:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8d66479a0800/0x44bac02bd54add5b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x44bac02bd54add54 expref: 12 pid: 22727 timeout: 677 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684496.194173:0:22717:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d66479a0800/0x44bac02bd54add5b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x44bac02bd54add54 expref: 12 pid: 22727 timeout: 677 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684496.194195:0:22717:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8d66476d4800/0x44bac02bd54add8c lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 22748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684496.194203:0:22717:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d66476d4800/0x44bac02bd54add8c lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 22748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1788684496.194218:0:22717:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.009639388s 00010000:00010000:1.0:1788684496.194222:0:22717:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8d66476d4800/0x44bac02bd54add8c lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 22748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684496.194229:0:22717:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8d66476d4800/0x44bac02bd54add8c lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 22748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684496.194236:0:22717:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8d66476d4800/0x44bac02bd54add8c lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 22748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684496.194243:0:22717:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8d66476d4800/0x44bac02bd54add8c lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 22748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684496.194261:0:22717:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d66476d4800 already unused, calling callback (ffffffffc0cae340) 00010000:00010000:1.0:1788684496.194265:0:22717:0:(ldlm_request.c:377:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8d66476d4800/0x44bac02bd54add8c lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 22748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684496.194273:0:22717:0:(ldlm_request.c:1415:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8d66476d4800/0x44bac02bd54add8c lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 22748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684496.194286:0:22717:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8d66476d4800/0x44bac02bd54add8c lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684496.194296:0:22717:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788684496.194390:0:22717:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d677fa80380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cebd1789-51a4-46ff-b167-6b1633e930a1+11:3625:x1875571085898880:12345-0@lo:103:ldlm_bl.0 Request processed in 237us (3897us total) trans 0 rc 0/0 00000100:00100000:1.0:1788684496.194398:0:22717:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788684496.194437:0:3625:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d674698ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:cebd1789-51a4-46ff-b167-6b1633e930a1:3625:1875571085898880:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788684496.195497:0:22748:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8d66476d4800/0x44bac02bd54add8c lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684496.195511:0:22748:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8d66476d4800/0x44bac02bd54add8c lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684496.195518:0:22748:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d66476d4800/0x44bac02bd54add8c lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00080000:3.0:1788684496.233469:0:22710:0:(update_trans.c:1496:distribute_txn_commit_batchid_init()) lustre-MDT0000: committed batchid 4294967530 00000040:01000000:2.0:1788684496.234178:0:22710:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000020:00080000:3.0:1788684496.234217:0:22772:0:(update_trans.c:1538:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 4294967530 00000020:00080000:3.0:1788684496.234222:0:22772:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4294967530 00000040:01000000:3.0:1788684496.234908:0:22773:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:2.0:1788684496.234961:0:22710:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0001-osp-MDT0000 ctxt 16 is initialized 00000100:00080000:3.0:1788684496.235503:0:22774:0:(client.c:1846:ptlrpc_send_new_req()) @@@ req waiting for recovery: (FULL != DISCONN) req@ffff8d664790b100 x1875571085899008/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 304/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'lod0000_rec0001.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788684496.235528:0:22774:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d6750acac00 going to sleep for 0 seconds 00000040:01000000:2.0:1788684496.236137:0:22710:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:2.0:1788684496.236265:0:22710:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:2.0:1788684496.237111:0:22710:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:2.0:1788684496.237121:0:22710:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:2.0:1788684496.237170:0:22710:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788684496.237520:0:22773:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788684496.239735:0:22773:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000004:00080000:3.0:1788684496.239812:0:22773:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000040:00080000:0.0:1788684496.251506:0:22710:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:0.0:1788684496.252506:0:22710:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:0.0:1788684496.252552:0:22710:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00000040:00080000:0.0:1788684496.253991:0:22710:0:(llog_cat.c:403:llog_cat_set_first_idx()) catlog [0xa:0x7:0x0] first idx 1, last_idx 2 00080000:10000000:0.0:1788684496.254943:0:22710:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x36:0x0] (8/32) registered 00000001:00000004:0.0:1788684496.261164:0:22710:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 3, last_transno is 12884901888 00000001:00080000:0.0:1788684496.263567:0:22710:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:0.0:1788684496.263614:0:22710:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffb81ec16bf988 00100000:10000000:0.0:1788684496.263623:0:22710:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:0.0:1788684496.266727:0:22710:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:0.0:1788684496.266742:0:22710:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.206.144@tcp: cl_mgc_mutex unlock 00000020:01000004:0.0:1788684496.266975:0:22710:0:(tgt_mount.c:2464:server_fill_super_common()) Server sb, dev=45 00000080:00000004:0.0:1788684496.266993:0:22710:0:(super25.c:182:lustre_fill_super()) /dev/mapper/mds1_flakey: Mount complete 00000020:00000004:2.0:1788684496.274053:0:22710:0:(tgt_mount.c:2350:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1788684496.274240:0:22710:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1788684496.578199:0:22720:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1788684496.625078:0:22729:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1788684496.625085:0:22729:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8d677cb59000 from 11 10000000:01000000:0.0:1788684496.625091:0:22729:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1788684496.625139:0:22729:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.144@tcp lock: ffff8d6746d3f600/0x44bac02bd54add93 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684496.625169:0:22729:0:(ldlm_request.c:1106:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.144@tcp lock: ffff8d6746d3f600/0x44bac02bd54add93 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684496.625190:0:22729:0:(ldlm_request.c:1193:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.144@tcp lock: ffff8d6746d3f600/0x44bac02bd54add93 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788684496.625216:0:22729:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d677fb46d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cebd1789-51a4-46ff-b167-6b1633e930a1:22729:1875571085899136:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788684496.625293:0:22729:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788684496.625344:0:22729:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d6746d63480 going to sleep for 11 seconds 00000100:00100000:1.0:1788684496.625422:0:22727:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085899136 00000100:00100000:1.0:1788684496.625430:0:22727:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085899136 00000100:00100000:1.0:1788684496.625481:0:22727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1788684496.625490:0:22727:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d677ccdfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cebd1789-51a4-46ff-b167-6b1633e930a1+11:22729:x1875571085899136:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788684496.625503:0:22727:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788684496.625515:0:22727:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d6746cb3c00/0x44bac02bd54add9a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x44bac02bd54add93 expref: -99 pid: 22727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684496.625538:0:22727:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d6746cb3c00/0x44bac02bd54add9a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x44bac02bd54add93 expref: 12 pid: 22727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684496.625549:0:22727:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d6746cb3c00/0x44bac02bd54add9a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x44bac02bd54add93 expref: 12 pid: 22727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684496.625558:0:22727:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d6746cb3c00, rc 0) 00000100:00100000:1.0:1788684496.625597:0:22727:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d677ccdfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cebd1789-51a4-46ff-b167-6b1633e930a1+12:22729:x1875571085899136:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 107us (304us total) trans 0 rc 0/0 00000100:00100000:1.0:1788684496.625615:0:22727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1788684496.626324:0:22729:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d677fb46d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cebd1789-51a4-46ff-b167-6b1633e930a1:22729:1875571085899136:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788684496.626344:0:22729:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.144@tcp lock: ffff8d6746d3f600/0x44bac02bd54add93 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x44bac02bd54add9a expref: -99 pid: 22729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684496.626354:0:22729:0:(ldlm_request.c:840:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.144@tcp lock: ffff8d6746d3f600/0x44bac02bd54add93 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x44bac02bd54add9a expref: -99 pid: 22729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788684496.626444:0:22729:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d677fb46d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cebd1789-51a4-46ff-b167-6b1633e930a1:22729:1875571085899264:0@lo:256:ll_cfg_requeue.0 00000100:00100000:0.0:1788684496.626481:0:22729:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788684496.626505:0:22729:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d6746d63480 going to sleep for 11 seconds 00000100:00100000:1.0:1788684496.626563:0:22725:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085899264 00000100:00100000:1.0:1788684496.626568:0:22725:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085899264 00000100:00100000:1.0:1788684496.626615:0:22725:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1788684496.626624:0:22725:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d677ccdc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cebd1789-51a4-46ff-b167-6b1633e930a1+12:22729:x1875571085899264:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:1.0:1788684496.626638:0:22725:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1788684496.626655:0:22725:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1788684496.626658:0:22725:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 11 00000100:00100000:1.0:1788684496.626730:0:22725:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d677ccdc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cebd1789-51a4-46ff-b167-6b1633e930a1+12:22729:x1875571085899264:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 107us (247us total) trans 0 rc 0/0 00000100:00100000:1.0:1788684496.626738:0:22725:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1788684496.627441:0:22729:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d677fb46d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cebd1789-51a4-46ff-b167-6b1633e930a1:22729:1875571085899264:0@lo:256:ll_cfg_requeue.0 10000000:01000000:0.0:1788684496.627503:0:22729:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.144@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1788684496.627511:0:22729:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.144@tcp lock: ffff8d6746d3f600/0x44bac02bd54add93 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x44bac02bd54add9a expref: -99 pid: 22729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684496.627522:0:22729:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.144@tcp lock: ffff8d6746d3f600/0x44bac02bd54add93 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x44bac02bd54add9a expref: -99 pid: 22729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788684497.224007:0:22768:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:2.0:1788684497.224017:0:22768:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788684497.226675:0:22768:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:2.0:1788684497.226686:0:22768:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:3.0:1788684497.278343:0:22774:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d6750acac00 going to sleep for 0 seconds 00010000:00010000:1.0:1788684497.599335:0:22721:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1788684498.237568:0:22768:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:2.0:1788684498.237578:0:22768:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788684498.237721:0:22768:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 1 count 1 00000040:00080000:2.0:1788684498.237772:0:22768:0:(llog_cat_server.c:902:llog_cat_cleanup()) cancel plain log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788684498.237935:0:22768:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 1 00000100:00100000:3.0:1788684498.302571:0:22774:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d6750acac00 going to sleep for 0 seconds 00010000:00010000:1.0:1788684498.621613:0:22720:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788684499.325716:0:22774:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d6750acac00 going to sleep for 0 seconds 00010000:00010000:1.0:1788684499.646178:0:22721:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788684500.351671:0:22774:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d6750acac00 going to sleep for 0 seconds 00000001:02000400:0.0:1788684500.649897:0:23016:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg644-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:1.0:1788684500.670219:0:22720:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788684501.375545:0:22774:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d6750acac00 going to sleep for 0 seconds 00000100:00080000:0.0:1788684501.630587:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:0.0:1788684501.630595:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:0.0:1788684501.630598:0:36:0:(import.c:65:import_set_state_nolock()) ffff8d6775fa3000 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788684501.630605:0:36:0:(import.c:545:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 577 00000100:00080000:0.0:1788684501.630611:0:36:0:(import.c:630:import_select_connection()) lustre-MDT0001-osp-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1788684501.630618:0:36:0:(import.c:665:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff8d6775fa3000 using connection 192.168.206.144@tcp/0@lo 00000100:00100000:0.0:1788684501.630642:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8d677fb45f80 x1875571085899520/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788684501.630650:0:3626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d677fb46d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:cebd1789-51a4-46ff-b167-6b1633e930a1:3626:1875571085899392:0@lo:400:kworker.0 00000100:00080000:0.0:1788684501.630665:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788684501.630670:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1788684501.630672:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788684501.630675:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1788684501.630678:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:0.0:1788684501.630681:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1788684501.630683:0:36:0:(import.c:65:import_set_state_nolock()) ffff8d664742a800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788684501.630689:0:36:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff8d664742a800 using connection 192.168.206.144@tcp/0@lo 00000100:00100000:0.0:1788684501.630703:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8d677fb45180 x1875571085899648/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788684501.630722:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788684501.630730:0:3622:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d677fb45f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3622:1875571085899520:0@lo:38:kworker.0 00000100:00100000:0.0:1788684501.630770:0:3622:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788684501.630815:0:3622:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d677fb45180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3622:1875571085899648:0@lo:38:kworker.0 00000100:00100000:0.0:1788684501.630845:0:3622:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788684501.630879:0:22726:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085899392 00000100:00100000:0.0:1788684501.630886:0:22726:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085899392 00000100:00100000:0.0:1788684501.630937:0:22726:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1788684501.630948:0:22726:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6746cac450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cebd1789-51a4-46ff-b167-6b1633e930a1+12:3626:x1875571085899392:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788684501.630960:0:22734:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085899648 00000100:00100000:3.0:1788684501.630966:0:22734:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085899648 00000100:00100000:0.0:1788684501.631000:0:22726:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6746cac450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cebd1789-51a4-46ff-b167-6b1633e930a1+12:3626:x1875571085899392:12345-0@lo:400:kworker.0 Request processed in 54us (279us total) trans 0 rc 0/0 00000100:00100000:0.0:1788684501.631007:0:22726:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1788684501.631042:0:22738:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085899520 00000100:00100000:0.0:1788684501.631046:0:22738:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085899520 00000100:00100000:0.0:1788684501.631061:0:22738:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788684501.631065:0:22738:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d677fb45c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3622:x1875571085899520:12345-0@lo:38:kworker.0 00010000:00020000:0.0:1788684501.631078:0:22738:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1788684501.631121:0:22738:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d677fb45c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3622:x1875571085899520:12345-0@lo:38:kworker.0 Request processed in 55us (350us total) trans 0 rc -19/-19 00000100:00100000:0.0:1788684501.631127:0:22738:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788684501.631160:0:3626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d677fb46d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:cebd1789-51a4-46ff-b167-6b1633e930a1:3626:1875571085899392:0@lo:400:kworker.0 00000100:00080000:0.0:1788684501.631186:0:3622:0:(import.c:65:import_set_state_nolock()) ffff8d6775fa3000 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788684501.631190:0:3622:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1788684501.631193:0:3622:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d677fb45f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3622:1875571085899520:0@lo:38:kworker.0 00000100:00100000:2.0:1788684501.632867:0:22732:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788684501.632889:0:22732:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d677fb44700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3622:x1875571085899648:12345-0@lo:38:kworker.0 00010000:00080000:2.0:1788684501.632929:0:22732:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 582 last 0 00000020:00000080:2.0:1788684501.632965:0:22732:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0x44bac02bd54adda1 00000004:00100000:2.0:1788684501.632982:0:22732:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1788684501.633239:0:22732:0:(import.c:65:import_set_state_nolock()) ffff8d6647911800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788684501.633320:0:22732:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d677fb44700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3622:x1875571085899648:12345-0@lo:38:kworker.0 Request processed in 430us (2473us total) trans 0 rc 0/0 00000100:00100000:2.0:1788684501.633328:0:22732:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:0.0:1788684501.633475:0:3622:0:(ldlm_request.c:1670:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff8d677fb45180 x1875571085899648/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788684511 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788684501.633491:0:3622:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 3 00000100:00080000:0.0:1788684501.633498:0:3622:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:0.0:1788684501.633510:0:3622:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1788684501.633513:0:3622:0:(import.c:65:import_set_state_nolock()) ffff8d664742a800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1788684501.633519:0:3622:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d677fb45180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3622:1875571085899648:0@lo:38:kworker.0 00000020:00000004:2.0:1788684501.650119:0:23068:0:(tgt_mount.c:2350:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1788684501.650343:0:23068:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1788684501.694042:0:22721:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788684502.397461:0:22774:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d6750acac00 going to sleep for 0 seconds 00000020:00000004:0.0:1788684502.667254:0:23119:0:(tgt_mount.c:2350:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1788684502.667465:0:23119:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:2.0:1788684502.719728:0:22720:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788684503.423080:0:22774:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d6750acac00 going to sleep for 0 seconds 00010000:00010000:1.0:1788684503.746462:0:22721:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788684504.445475:0:22774:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d6750acac00 going to sleep for 0 seconds 00010000:00010000:1.0:1788684504.773696:0:22720:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788684505.471721:0:22774:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d6750acac00 going to sleep for 0 seconds 00010000:00010000:0.0:1788684505.790137:0:22721:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788684506.494558:0:22774:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d6750acac00 going to sleep for 0 seconds 00000100:00100000:2.0:1788684506.749522:0:3622:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788684496/real 1788684496] req@ffff8d6647908000 x1875571085896576/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788684506 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788684506.749551:0:3622:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8d6647908000 x1875571085896576/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788684506 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788684506.749563:0:3622:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788684496/real 1788684496] req@ffff8d677fb44000 x1875571085896448/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788684506 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788684506.749576:0:3622:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8d677fb44000 x1875571085896448/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788684506 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788684506.749594:0:3622:0:(import.c:65:import_set_state_nolock()) ffff8d6775fa5800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788684506.749612:0:3622:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:2.0:1788684506.749616:0:3622:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6647908000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3622:1875571085896576:0@lo:8:llog_process_th.0 00000100:00080000:2.0:1788684506.749622:0:3622:0:(import.c:65:import_set_state_nolock()) ffff8d677fab9000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788684506.749627:0:3622:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:2.0:1788684506.749637:0:3622:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d677fb44000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3622:1875571085896448:0@lo:8:llog_process_th.0 00000100:00080000:1.0:1788684506.750169:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:1.0:1788684506.750174:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:1.0:1788684506.750177:0:38:0:(import.c:65:import_set_state_nolock()) ffff8d6775fa3000 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788684506.750182:0:38:0:(import.c:545:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 582 00000100:00080000:1.0:1788684506.750187:0:38:0:(import.c:630:import_select_connection()) lustre-MDT0001-osp-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:1.0:1788684506.750205:0:38:0:(import.c:665:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff8d6775fa3000 using connection 192.168.206.144@tcp/0@lo 00000100:00100000:1.0:1788684506.750227:0:38:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8d674698f100 x1875571085899904/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788684506.750240:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788684506.750243:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:1.0:1788684506.750245:0:38:0:(import.c:65:import_set_state_nolock()) ffff8d677fab9000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788684506.750248:0:38:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 577 00000100:00080000:1.0:1788684506.750250:0:38:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1788684506.750253:0:38:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff8d677fab9000 using connection 192.168.206.144@tcp/0@lo 00000100:00100000:1.0:1788684506.750273:0:38:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8d674698e680 x1875571085900032/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788684506.750282:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788684506.750284:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1788684506.750286:0:38:0:(import.c:65:import_set_state_nolock()) ffff8d6775fa5800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788684506.750289:0:38:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 577 00000100:00080000:1.0:1788684506.750291:0:38:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1788684506.750294:0:38:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff8d6775fa5800 using connection 192.168.206.144@tcp/0@lo 00000100:00100000:1.0:1788684506.750320:0:38:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8d674698ed80 x1875571085900160/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788684506.750507:0:3624:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d674698c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3624:1875571085900288:0@lo:400:kworker.0 00000100:00100000:2.0:1788684506.750569:0:3624:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788684506.750627:0:3624:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788684506.750634:0:3624:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d674698ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:cebd1789-51a4-46ff-b167-6b1633e930a1:3624:1875571085899776:0@lo:400:kworker.0 00000100:00100000:2.0:1788684506.750662:0:3624:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788684506.750698:0:22727:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085899776 00000100:00100000:2.0:1788684506.750705:0:22727:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085899776 00000100:00100000:2.0:1788684506.750746:0:22727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1788684506.750754:0:22727:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6746cad050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cebd1789-51a4-46ff-b167-6b1633e930a1+12:3624:x1875571085899776:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788684506.750797:0:22727:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6746cad050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cebd1789-51a4-46ff-b167-6b1633e930a1+12:3624:x1875571085899776:12345-0@lo:400:kworker.0 Request processed in 44us (134us total) trans 0 rc 0/0 00000100:00100000:2.0:1788684506.750805:0:22727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1788684506.750849:0:3622:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d674698f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3622:1875571085899904:0@lo:38:kworker.0 00000100:00100000:2.0:1788684506.750874:0:3622:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788684506.750891:0:3622:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d674698e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3622:1875571085900032:0@lo:8:kworker.0 00000400:00000100:2.0:1788684506.750911:0:3622:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875571085900032 offset 0 length 520: 4 00000100:00100000:2.0:1788684506.750922:0:3622:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d674698ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3622:1875571085900160:0@lo:8:kworker.0 00000400:00000100:2.0:1788684506.750935:0:3622:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875571085900160 offset 0 length 520: 4 00000100:00100000:2.0:1788684506.750954:0:22738:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085899904 00000100:00100000:2.0:1788684506.750957:0:22738:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085899904 00000100:00100000:2.0:1788684506.750975:0:22738:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788684506.750980:0:22738:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d677fa81f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3622:x1875571085899904:12345-0@lo:38:kworker.0 00010000:00020000:2.0:1788684506.750996:0:22738:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1788684506.751039:0:22738:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d677fa81f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3622:x1875571085899904:12345-0@lo:38:kworker.0 Request processed in 58us (164us total) trans 0 rc -19/-19 00000100:00100000:2.0:1788684506.751045:0:22738:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788684506.751077:0:3624:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d674698ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:cebd1789-51a4-46ff-b167-6b1633e930a1:3624:1875571085899776:0@lo:400:kworker.0 00000100:00080000:2.0:1788684506.751100:0:3622:0:(import.c:65:import_set_state_nolock()) ffff8d6775fa3000 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788684506.751104:0:3622:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1788684506.751107:0:3622:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d674698f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3622:1875571085899904:0@lo:38:kworker.0 00000100:00100000:1.0:1788684506.751403:0:22733:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085900288 00000100:00100000:1.0:1788684506.751408:0:22733:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085900288 00000100:00100000:1.0:1788684506.751433:0:22733:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788684506.751439:0:22733:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d677fa83480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3624:x1875571085900288:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788684506.751498:0:22733:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d677fa83480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3624:x1875571085900288:12345-0@lo:400:kworker.0 Request processed in 59us (928us total) trans 0 rc 0/0 00000100:00100000:1.0:1788684506.751504:0:22733:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:2.0:1788684506.751980:0:3624:0:(ldlm_request.c:1670:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff8d674698c700 x1875571085900288/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788684522 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788684506.751994:0:3624:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d674698c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3624:1875571085900288:0@lo:400:kworker.0 00010000:00010000:3.0:1788684506.813712:0:22720:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788684507.521159:0:22774:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d6750acac00 going to sleep for 0 seconds 00010000:00010000:0.0:1788684507.838134:0:22721:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788684508.479108:0:22768:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:1.0:1788684508.544789:0:22774:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d6750acac00 going to sleep for 0 seconds 00000020:01000004:3.0:1788684508.694695:0:23463:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:3.0:1788684508.694699:0:23463:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/mds2_flakey 00000020:01000004:3.0:1788684508.694701:0:23463:0:(obd_mount.c:929:lmd_print()) options: user_xattr,errors=remount-ro 00000080:01200004:3.0:1788684508.694881:0:23463:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff8d6647429800 00000020:01000004:3.0:1788684508.694899:0:23463:0:(tgt_mount.c:2506:osd_start()) Attempting to start lustre-MDT0001, type=osd-ldiskfs, lsifl=200001, mountfl=0 00000020:01000004:3.0:1788684508.694912:0:23463:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-osd (typ=osd-ldiskfs) 00000020:00000080:3.0:1788684508.694926:0:23463:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-osd (ffff8d677e143380) 00000020:00000080:3.0:1788684508.694942:0:23463:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type osd-ldiskfs with refcount 2 00100000:10000000:0.0:1788684508.797226:0:23463:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0xd:0x0] (16/1) registered 00100000:10000000:0.0:1788684508.798721:0:23463:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:0.0:1788684508.802934:0:23463:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x22:0x0] (24/16) registered 00100000:10000000:0.0:1788684508.803211:0:23463:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x10:0x0] (16/1) registered 00100000:10000000:0.0:1788684508.803438:0:23463:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x20:0x0] (24/16) registered 00100000:10000000:0.0:1788684508.803716:0:23463:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x17:0x0] (16/1) registered 00100000:10000000:0.0:1788684508.804218:0:23463:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x11:0x0] (16/1) registered 00100000:10000000:0.0:1788684508.805037:0:23463:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x26:0x0] (24/16) registered 00100000:10000000:0.0:1788684508.805361:0:23463:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x12:0x0] (16/1) registered 00100000:10000000:0.0:1788684508.805639:0:23463:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x28:0x0] (24/16) registered 00100000:10000000:0.0:1788684508.805887:0:23463:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x18:0x0] (16/1) registered 00100000:10000000:0.0:1788684508.806167:0:23463:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2b:0x0] (24/16) registered 00100000:10000000:0.0:1788684508.806476:0:23463:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1a:0x0] (16/1) registered 00100000:10000000:0.0:1788684508.806747:0:23463:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x23:0x0] (24/16) registered 00100000:10000000:0.0:1788684508.807023:0:23463:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0xf:0x0] (16/1) registered 00100000:10000000:0.0:1788684508.807701:0:23463:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2a:0x0] (24/16) registered 00100000:10000000:0.0:1788684508.808289:0:23463:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0xe:0x0] (16/1) registered 00100000:10000000:0.0:1788684508.808521:0:23463:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x19:0x0] (16/1) registered 00100000:10000000:0.0:1788684508.808806:0:23463:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x25:0x0] (24/16) registered 00100000:10000000:0.0:1788684508.809396:0:23463:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x15:0x0] (16/1) registered 00100000:10000000:0.0:1788684508.809626:0:23463:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1c:0x0] (16/1) registered 00100000:10000000:0.0:1788684508.810032:0:23463:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1d:0x0] (16/1) registered 00100000:10000000:0.0:1788684508.810424:0:23463:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x29:0x0] (24/16) registered 00100000:10000000:0.0:1788684508.810635:0:23463:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x16:0x0] (16/1) registered 00100000:10000000:0.0:1788684508.811040:0:23463:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1b:0x0] (16/1) registered 00100000:10000000:0.0:1788684508.811300:0:23463:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1f:0x0] (24/16) registered 00100000:10000000:0.0:1788684508.811533:0:23463:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2e:0x0] (24/16) registered 00100000:10000000:0.0:1788684508.811849:0:23463:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2d:0x0] (24/16) registered 00100000:10000000:0.0:1788684508.812319:0:23463:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x24:0x0] (24/16) registered 00100000:10000000:0.0:1788684508.812552:0:23463:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x21:0x0] (24/16) registered 00100000:10000000:0.0:1788684508.812852:0:23463:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x27:0x0] (24/16) registered 00100000:10000000:0.0:1788684508.813166:0:23463:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2c:0x0] (24/16) registered 00100000:10000000:0.0:1788684508.813462:0:23463:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x13:0x0] (16/1) registered 00100000:10000000:0.0:1788684508.813689:0:23463:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x14:0x0] (16/1) registered 00100000:10000000:0.0:1788684508.814896:0:23463:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x7:0x0] (8/32) registered 00100000:10000000:0.0:1788684508.815178:0:23463:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:0.0:1788684508.815786:0:23463:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x4:0x0] (8/32) registered 00100000:10000000:0.0:1788684508.816065:0:23463:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x20001:0x0] (8/8) registered 00100000:10000000:0.0:1788684508.816326:0:23463:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x5:0x0] (8/32) registered 00100000:10000000:0.0:1788684508.816656:0:23463:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x6:0x0] (8/32) registered 00100000:10000000:0.0:1788684508.817019:0:23463:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x20002:0x0] (8/8) registered 00100000:10000000:0.0:1788684508.817317:0:23463:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:0.0:1788684508.817541:0:23463:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x3:0x0] (8/32) registered 00100000:10000000:0.0:1788684508.817839:0:23463:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:0.0:1788684508.818110:0:23463:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x8:0x0] (8/32) registered 00100000:10000000:0.0:1788684508.818314:0:23463:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x20003:0x0] (8/8) registered 00080000:01000000:0.0:1788684508.820010:0:23463:0:(osd_lproc.c:911:osd_procfs_init()) lustre-MDT0001: register osd-ldiskfs tunable parameters 00000020:00000080:0.0:1788684508.820236:0:23463:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-osd (uuid lustre-MDT0001-osd_UUID) 00080000:01000000:0.0:1788684508.820248:0:23463:0:(osd_handler.c:8924:osd_obd_connect()) connect #0 00000020:00000080:0.0:1788684508.820259:0:23463:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x44bac02bd54addaf 00000020:01000004:0.0:1788684508.820266:0:23463:0:(tgt_mount.c:2591:server_fill_super()) Found service lustre-MDT0001 on device /dev/mapper/mds2_flakey 00000020:01000004:0.0:1788684508.820286:0:23463:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.206.144@tcp:Set MGC reconnect 1 10000000:01000000:0.0:1788684508.820289:0:23463:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.206.144@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:0.0:1788684508.820295:0:23463:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-MDT0001 00000020:01000004:0.0:1788684508.820320:0:23463:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/mds2_flakey 10000000:01000000:0.0:1788684508.820324:0:23463:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.206.144@tcp: cl_mgc_mutex lustre-MDT0001-osd for locked: rc = 0 00000040:01000000:1.0:1788684508.825796:0:23463:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.206.144@tcp ctxt 0 is initialized 00000020:01000004:1.0:1788684508.825843:0:23463:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0001, fs=lustre, 192.168.206.144@tcp, index=0001, flags=0x20001 00000020:01000004:1.0:1788684508.825847:0:23463:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:1.0:1788684508.825849:0:23463:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:1.0:1788684508.825851:0:23463:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788684508.825852:0:23463:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788684508.825853:0:23463:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788684508.825854:0:23463:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788684508.825856:0:23463:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1788684508.825858:0:23463:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788684508.825859:0:23463:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1788684508.825865:0:23463:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0001 0x10020001 00000020:01000004:1.0:1788684508.825867:0:23463:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1788684508.825869:0:23463:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:1.0:1788684508.825870:0:23463:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788684508.825871:0:23463:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788684508.825872:0:23463:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788684508.825873:0:23463:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788684508.825874:0:23463:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1788684508.825875:0:23463:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788684508.825876:0:23463:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1788684508.826239:0:23463:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0001 00000100:00100000:1.0:1788684508.826259:0:23463:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d674698d880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cebd1789-51a4-46ff-b167-6b1633e930a1:23463:1875571085900416:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1788684508.826319:0:23463:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788684508.826415:0:23463:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d6742f850c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788684508.826539:0:22725:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085900416 00000100:00100000:0.0:1788684508.826546:0:22725:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085900416 00000100:00100000:1.0:1788684508.826712:0:22725:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1788684508.826723:0:22725:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6746caf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cebd1789-51a4-46ff-b167-6b1633e930a1+12:23463:x1875571085900416:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1788684508.826752:0:22725:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:1.0:1788684508.826754:0:22725:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-MDT0001 is running on 0@lo 20000000:01000000:1.0:1788684508.826762:0:22725:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0001, index=1, rc=0 00000100:00100000:1.0:1788684508.827117:0:22725:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6746caf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cebd1789-51a4-46ff-b167-6b1633e930a1+12:23463:x1875571085900416:12345-0@lo:253:mount.lustre.0 Request processed in 394us (794us total) trans 0 rc 0/0 00000100:00100000:1.0:1788684508.827125:0:22725:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1788684508.827217:0:23463:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d674698d880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cebd1789-51a4-46ff-b167-6b1633e930a1:23463:1875571085900416:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1788684508.827227:0:23463:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0001 got index = 1 00000020:01000004:3.0:1788684508.827230:0:23463:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1788684508.827231:0:23463:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:3.0:1788684508.827233:0:23463:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788684508.827234:0:23463:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788684508.827235:0:23463:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788684508.827236:0:23463:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788684508.827237:0:23463:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1788684508.827239:0:23463:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788684508.827248:0:23463:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:3.0:1788684508.827268:0:23463:0:(tgt_mount.c:101:server_register_mount()) register mount ffff8d6647429800 from lustre-MDT0001 10000000:01000000:3.0:1788684508.827293:0:23463:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0001 from 0 10000000:01000000:3.0:1788684508.827296:0:23463:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0001-0000000000000000 10000000:01000000:3.0:1788684508.827302:0:23463:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff8d677e3e8000 local copy 00010000:00010000:3.0:1788684508.827311:0:23463:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.144@tcp lock: ffff8d6746d3ea00/0x44bac02bd54adca5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x44bac02bd54adcac expref: -99 pid: 22710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788684508.827434:0:23463:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6647908a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cebd1789-51a4-46ff-b167-6b1633e930a1:23463:1875571085900544:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788684508.827463:0:23463:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788684508.827876:0:23463:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d6748205f00 going to sleep for 11 seconds 00000100:00100000:2.0:1788684508.828009:0:22727:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085900544 00000100:00100000:2.0:1788684508.828016:0:22727:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085900544 00000100:00100000:2.0:1788684508.828062:0:22727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1788684508.828071:0:22727:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6746cacc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cebd1789-51a4-46ff-b167-6b1633e930a1+12:23463:x1875571085900544:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788684508.828155:0:22727:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6746cacc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cebd1789-51a4-46ff-b167-6b1633e930a1+12:23463:x1875571085900544:12345-0@lo:501:mount.lustre.0 Request processed in 84us (690us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788684508.828161:0:22727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1788684508.828311:0:23463:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6647908a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cebd1789-51a4-46ff-b167-6b1633e930a1:23463:1875571085900544:0@lo:501:mount.lustre.0 10000000:01000000:3.0:1788684508.828329:0:23463:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.206.144@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:3.0:1788684508.828350:0:23463:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.206.144@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:3.0:1788684508.828357:0:23463:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.144@tcp lock: ffff8d6746d3ea00/0x44bac02bd54adca5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x44bac02bd54adcac expref: -99 pid: 22710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684508.828389:0:23463:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.144@tcp lock: ffff8d6746d3ea00/0x44bac02bd54adca5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x44bac02bd54adcac expref: -99 pid: 22710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788684508.828419:0:23463:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff8d6647429800 10000000:01000000:3.0:1788684508.828424:0:23463:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:3.0:1788684508.828428:0:23463:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffff8d677e3e8000 10000000:01000000:3.0:1788684508.828431:0:23463:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:3.0:1788684508.828435:0:23463:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff8d677e3e8000 from 1 10000000:01000000:3.0:1788684508.828437:0:23463:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:3.0:1788684508.828465:0:23463:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.144@tcp lock: ffff8d66479a0600/0x44bac02bd54addb6 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 23463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684508.828474:0:23463:0:(ldlm_request.c:1106:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.144@tcp lock: ffff8d66479a0600/0x44bac02bd54addb6 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 23463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684508.828492:0:23463:0:(ldlm_request.c:1193:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.144@tcp lock: ffff8d66479a0600/0x44bac02bd54addb6 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 23463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788684508.828508:0:23463:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6647908a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cebd1789-51a4-46ff-b167-6b1633e930a1:23463:1875571085900672:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788684508.828537:0:23463:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788684508.828556:0:23463:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d6748205f00 going to sleep for 11 seconds 00000100:00100000:2.0:1788684508.828620:0:22727:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085900672 00000100:00100000:2.0:1788684508.828625:0:22727:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085900672 00000100:00100000:2.0:1788684508.828643:0:22727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1788684508.828649:0:22727:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6746caf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cebd1789-51a4-46ff-b167-6b1633e930a1+12:23463:x1875571085900672:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788684508.828658:0:22727:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788684508.828669:0:22727:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d66476d4e00/0x44bac02bd54addbd lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x44bac02bd54addb6 expref: -99 pid: 22727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684508.828778:0:22727:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d66476d4e00/0x44bac02bd54addbd lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x44bac02bd54addb6 expref: 13 pid: 22727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684508.828792:0:22727:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d66476d4e00/0x44bac02bd54addbd lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x44bac02bd54addb6 expref: 13 pid: 22727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684508.828800:0:22727:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d66476d4e00, rc 0) 00000100:00100000:2.0:1788684508.828883:0:22727:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6746caf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cebd1789-51a4-46ff-b167-6b1633e930a1+13:23463:x1875571085900672:12345-0@lo:101:mount.lustre.0 Request processed in 233us (345us total) trans 0 rc 0/0 00000100:00100000:2.0:1788684508.828891:0:22727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1788684508.829312:0:23463:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6647908a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cebd1789-51a4-46ff-b167-6b1633e930a1:23463:1875571085900672:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788684508.829327:0:23463:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.144@tcp lock: ffff8d66479a0600/0x44bac02bd54addb6 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x44bac02bd54addbd expref: -99 pid: 23463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684508.829336:0:23463:0:(ldlm_request.c:840:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.144@tcp lock: ffff8d66479a0600/0x44bac02bd54addb6 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x44bac02bd54addbd expref: -99 pid: 23463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788684508.829352:0:23463:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.144@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:3.0:1788684508.829430:0:23463:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.144@tcp lock: ffff8d66479a0600/0x44bac02bd54addb6 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x44bac02bd54addbd expref: -99 pid: 23463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684508.829439:0:23463:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.144@tcp lock: ffff8d66479a0600/0x44bac02bd54addb6 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x44bac02bd54addbd expref: -99 pid: 23463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788684508.829447:0:23463:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff8d6647429800 10000000:01000000:3.0:1788684508.829452:0:23463:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:3.0:1788684508.829456:0:23463:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff8d6647429800 from 1 10000000:01000000:3.0:1788684508.829458:0:23463:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:3.0:1788684508.829476:0:23463:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.144@tcp lock: ffff8d66479a0a00/0x44bac02bd54addc4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 23463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684508.829484:0:23463:0:(ldlm_request.c:1106:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.144@tcp lock: ffff8d66479a0a00/0x44bac02bd54addc4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 23463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684508.829501:0:23463:0:(ldlm_request.c:1193:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.144@tcp lock: ffff8d66479a0a00/0x44bac02bd54addc4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 23463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788684508.829514:0:23463:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6647908a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cebd1789-51a4-46ff-b167-6b1633e930a1:23463:1875571085900800:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788684508.829543:0:23463:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788684508.829574:0:23463:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d6748205f00 going to sleep for 11 seconds 00000100:00100000:0.0:1788684508.829677:0:22726:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085900800 00000100:00100000:0.0:1788684508.829682:0:22726:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085900800 00000100:00100000:0.0:1788684508.829793:0:22726:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1788684508.829802:0:22726:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6746cad850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cebd1789-51a4-46ff-b167-6b1633e930a1+13:23463:x1875571085900800:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788684508.829812:0:22726:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788684508.829822:0:22726:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d6746d3f800/0x44bac02bd54addcb lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x44bac02bd54addc4 expref: -99 pid: 22726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684508.829838:0:22726:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d6746d3f800/0x44bac02bd54addcb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x44bac02bd54addc4 expref: 14 pid: 22726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684508.829846:0:22726:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d6746d3f800/0x44bac02bd54addcb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x44bac02bd54addc4 expref: 14 pid: 22726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684508.829853:0:22726:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d6746d3f800, rc 0) 00000100:00100000:0.0:1788684508.829887:0:22726:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6746cad850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cebd1789-51a4-46ff-b167-6b1633e930a1+14:23463:x1875571085900800:12345-0@lo:101:mount.lustre.0 Request processed in 87us (344us total) trans 0 rc 0/0 00000100:00100000:3.0:1788684508.830007:0:23463:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6647908a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cebd1789-51a4-46ff-b167-6b1633e930a1:23463:1875571085900800:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788684508.830018:0:23463:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.144@tcp lock: ffff8d66479a0a00/0x44bac02bd54addc4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x44bac02bd54addcb expref: -99 pid: 23463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684508.830025:0:23463:0:(ldlm_request.c:840:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.144@tcp lock: ffff8d66479a0a00/0x44bac02bd54addc4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x44bac02bd54addcb expref: -99 pid: 23463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788684508.830035:0:23463:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.144@tcp: configuration from log 'lustre-barrier' succeeded (0). 00000100:00100000:0.0:1788684508.830063:0:22726:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00010000:00010000:3.0:1788684508.830281:0:23463:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.144@tcp lock: ffff8d66479a0a00/0x44bac02bd54addc4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x44bac02bd54addcb expref: -99 pid: 23463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684508.830290:0:23463:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.144@tcp lock: ffff8d66479a0a00/0x44bac02bd54addc4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x44bac02bd54addcb expref: -99 pid: 23463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788684508.830297:0:23463:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0001-0000000000000000 10000000:01000000:3.0:1788684508.830301:0:23463:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1788684508.830305:0:23463:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff8d6647429800 10000000:01000000:3.0:1788684508.830308:0:23463:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:3.0:1788684508.830312:0:23463:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 1 10000000:01000000:3.0:1788684508.830314:0:23463:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:3.0:1788684508.830333:0:23463:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.144@tcp lock: ffff8d66479a0000/0x44bac02bd54addd2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 23463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684508.830346:0:23463:0:(ldlm_request.c:1106:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.144@tcp lock: ffff8d66479a0000/0x44bac02bd54addd2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 23463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684508.830355:0:23463:0:(ldlm_request.c:1193:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.144@tcp lock: ffff8d66479a0000/0x44bac02bd54addd2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 23463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788684508.830401:0:23463:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6647908a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cebd1789-51a4-46ff-b167-6b1633e930a1:23463:1875571085900928:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788684508.830430:0:23463:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788684508.830450:0:23463:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d6748205f00 going to sleep for 11 seconds 00000100:00100000:0.0:1788684508.830512:0:22725:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085900928 00000100:00100000:0.0:1788684508.830516:0:22725:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085900928 00000100:00100000:0.0:1788684508.830583:0:22725:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1788684508.830591:0:22725:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6746cac050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cebd1789-51a4-46ff-b167-6b1633e930a1+14:23463:x1875571085900928:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788684508.830599:0:22725:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788684508.830609:0:22725:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d6746d3e200/0x44bac02bd54addd9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x44bac02bd54addd2 expref: -99 pid: 22725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684508.830624:0:22725:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d6746d3e200/0x44bac02bd54addd9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x44bac02bd54addd2 expref: 15 pid: 22725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684508.830633:0:22725:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d6746d3e200/0x44bac02bd54addd9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x44bac02bd54addd2 expref: 15 pid: 22725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684508.830640:0:22725:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d6746d3e200, rc 0) 00000100:00100000:0.0:1788684508.830676:0:22725:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6746cac050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cebd1789-51a4-46ff-b167-6b1633e930a1+15:23463:x1875571085900928:12345-0@lo:101:mount.lustre.0 Request processed in 86us (245us total) trans 0 rc 0/0 00000100:00100000:0.0:1788684508.830682:0:22725:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1788684508.830925:0:23463:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6647908a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cebd1789-51a4-46ff-b167-6b1633e930a1:23463:1875571085900928:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788684508.830937:0:23463:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.144@tcp lock: ffff8d66479a0000/0x44bac02bd54addd2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x44bac02bd54addd9 expref: -99 pid: 23463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684508.830945:0:23463:0:(ldlm_request.c:840:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.144@tcp lock: ffff8d66479a0000/0x44bac02bd54addd2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x44bac02bd54addd9 expref: -99 pid: 23463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788684508.832442:0:23463:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 46 count 46 00000040:00080000:3.0:1788684508.833237:0:23463:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788684508.838327:0:23463:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].1, 224 off8416 00000040:00080000:3.0:1788684508.838429:0:23463:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].2, 136 off8552 00000040:00080000:3.0:1788684508.838452:0:23463:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].3, 176 off8728 00000040:00080000:3.0:1788684508.838468:0:23463:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].4, 224 off8952 00000040:00080000:3.0:1788684508.838481:0:23463:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].5, 224 off9176 00000040:00080000:3.0:1788684508.838494:0:23463:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].6, 120 off9296 00000040:00080000:3.0:1788684508.838513:0:23463:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].7, 112 off9408 00000040:00080000:3.0:1788684508.838527:0:23463:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].8, 160 off9568 00000040:00080000:3.0:1788684508.838541:0:23463:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].9, 224 off9792 00000040:00080000:3.0:1788684508.838555:0:23463:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].10, 224 off10016 00000040:00080000:3.0:1788684508.838580:0:23463:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].11, 88 off10104 00000040:00080000:3.0:1788684508.838595:0:23463:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].12, 144 off10248 00000040:00080000:3.0:1788684508.838608:0:23463:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].13, 152 off10400 00000040:00080000:3.0:1788684508.838622:0:23463:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].14, 168 off10568 00000040:00080000:3.0:1788684508.838635:0:23463:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].15, 224 off10792 00000040:00080000:3.0:1788684508.838648:0:23463:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].16, 224 off11016 00000040:00080000:3.0:1788684508.838661:0:23463:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].17, 80 off11096 00000040:00080000:3.0:1788684508.838674:0:23463:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].18, 224 off11320 00000040:00080000:3.0:1788684508.838687:0:23463:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].19, 224 off11544 00000040:00080000:3.0:1788684508.838699:0:23463:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].20, 160 off11704 00000040:00080000:3.0:1788684508.838968:0:23463:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].21, 224 off11928 00000040:00080000:3.0:1788684508.838984:0:23463:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].22, 224 off12152 00000040:00080000:3.0:1788684508.838998:0:23463:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].23, 80 off12232 00000040:00080000:3.0:1788684508.839012:0:23463:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].24, 224 off12456 00000040:00080000:3.0:1788684508.839026:0:23463:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].25, 224 off12680 00000040:00080000:3.0:1788684508.839039:0:23463:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].26, 88 off12768 00000040:00080000:3.0:1788684508.839118:0:23463:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].27, 144 off12912 00000040:00080000:3.0:1788684508.839134:0:23463:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].28, 152 off13064 00000040:00080000:3.0:1788684508.839150:0:23463:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].29, 136 off13200 00000040:00080000:3.0:1788684508.839163:0:23463:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].30, 224 off13424 00000040:00080000:3.0:1788684508.839177:0:23463:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].31, 224 off13648 00000040:00080000:3.0:1788684508.839203:0:23463:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].32, 80 off13728 00000040:00080000:3.0:1788684508.839219:0:23463:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].33, 224 off13952 00000040:00080000:3.0:1788684508.839232:0:23463:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].34, 224 off14176 00000040:00080000:3.0:1788684508.839246:0:23463:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].35, 88 off14264 00000040:00080000:3.0:1788684508.839260:0:23463:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].36, 144 off14408 00000040:00080000:3.0:1788684508.839273:0:23463:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].37, 152 off14560 00000040:00080000:3.0:1788684508.839286:0:23463:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].38, 136 off14696 00000040:00080000:3.0:1788684508.839300:0:23463:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].39, 224 off14920 00000040:00080000:3.0:1788684508.839313:0:23463:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].40, 224 off15144 00000040:00080000:3.0:1788684508.839325:0:23463:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].41, 80 off15224 00000040:00080000:3.0:1788684508.839336:0:23463:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].42, 224 off15448 00000040:00080000:3.0:1788684508.839350:0:23463:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].43, 224 off15672 00000040:00080000:3.0:1788684508.839408:0:23463:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].44, 120 off15792 00000040:00080000:3.0:1788684508.839438:0:23463:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].45, 224 off16016 00000040:00080000:3.0:1788684508.839444:0:23463:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 45 count 46 00000100:00100000:3.0:1788684508.839546:0:23463:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6647908a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cebd1789-51a4-46ff-b167-6b1633e930a1:23463:1875571085901056:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788684508.839608:0:23463:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788684508.839656:0:23463:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d67482059c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788684508.839841:0:22727:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085901056 00000100:00100000:2.0:1788684508.839849:0:22727:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085901056 00000100:00100000:2.0:1788684508.839909:0:22727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1788684508.839919:0:22727:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6746caec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cebd1789-51a4-46ff-b167-6b1633e930a1+15:23463:x1875571085901056:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788684508.841123:0:22727:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6746caec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cebd1789-51a4-46ff-b167-6b1633e930a1+15:23463:x1875571085901056:12345-0@lo:501:mount.lustre.0 Request processed in 1129us (1439us total) trans 0 rc 0/0 00000100:00100000:2.0:1788684508.841135:0:22727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1788684508.848439:0:23463:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6647908a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cebd1789-51a4-46ff-b167-6b1633e930a1:23463:1875571085901056:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788684508.848510:0:23463:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6647908a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cebd1789-51a4-46ff-b167-6b1633e930a1:23463:1875571085901184:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788684508.848589:0:23463:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788684508.848625:0:23463:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d67482059c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788684508.848712:0:22725:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085901184 00000100:00100000:0.0:1788684508.848719:0:22725:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085901184 00000100:00100000:0.0:1788684508.848777:0:22725:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1788684508.848787:0:22725:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6746cac850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cebd1789-51a4-46ff-b167-6b1633e930a1+15:23463:x1875571085901184:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788684508.851474:0:22725:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6746cac850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cebd1789-51a4-46ff-b167-6b1633e930a1+15:23463:x1875571085901184:12345-0@lo:503:mount.lustre.0 Request processed in 2680us (2877us total) trans 0 rc 0/0 00000100:00100000:0.0:1788684508.851488:0:22725:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1788684508.851634:0:23463:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6647908a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cebd1789-51a4-46ff-b167-6b1633e930a1:23463:1875571085901184:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1788684508.852107:0:23463:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1788684508.852251:0:23463:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d677fa83b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cebd1789-51a4-46ff-b167-6b1633e930a1:23463:1875571085901312:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788684508.852309:0:23463:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788684508.852337:0:23463:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d6742ffd3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788684508.853067:0:22726:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085901312 00000100:00100000:0.0:1788684508.853086:0:22726:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085901312 00000100:00100000:0.0:1788684508.853138:0:22726:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1788684508.853157:0:22726:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6746cadc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cebd1789-51a4-46ff-b167-6b1633e930a1+15:23463:x1875571085901312:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788684508.854535:0:22726:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6746cadc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cebd1789-51a4-46ff-b167-6b1633e930a1+15:23463:x1875571085901312:12345-0@lo:502:mount.lustre.0 Request processed in 1383us (2220us total) trans 0 rc 0/0 00000100:00100000:0.0:1788684508.854554:0:22726:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1788684508.854590:0:23463:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d677fa83b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cebd1789-51a4-46ff-b167-6b1633e930a1:23463:1875571085901312:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1788684508.854834:0:23463:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].1, 224 off8416 00000040:00080000:2.0:1788684508.854864:0:23463:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].2, 136 off8552 00000040:00080000:2.0:1788684508.854879:0:23463:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].3, 176 off8728 00000040:00080000:2.0:1788684508.854894:0:23463:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].4, 224 off8952 00000040:00080000:2.0:1788684508.855119:0:23463:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].5, 224 off9176 00000040:00080000:2.0:1788684508.855146:0:23463:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].6, 120 off9296 00000040:00080000:2.0:1788684508.855161:0:23463:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].7, 112 off9408 00000040:00080000:2.0:1788684508.855173:0:23463:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].8, 160 off9568 00000040:00080000:2.0:1788684508.855200:0:23463:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].9, 224 off9792 00000040:00080000:2.0:1788684508.855217:0:23463:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].10, 224 off10016 00000040:00080000:2.0:1788684508.855231:0:23463:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].11, 88 off10104 00000040:00080000:2.0:1788684508.855245:0:23463:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].12, 144 off10248 00000040:00080000:2.0:1788684508.855260:0:23463:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].13, 152 off10400 00000040:00080000:2.0:1788684508.855274:0:23463:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].14, 168 off10568 00000040:00080000:2.0:1788684508.855287:0:23463:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].15, 224 off10792 00000040:00080000:2.0:1788684508.855299:0:23463:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].16, 224 off11016 00000040:00080000:2.0:1788684508.855311:0:23463:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].17, 80 off11096 00000040:00080000:2.0:1788684508.855322:0:23463:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].18, 224 off11320 00000040:00080000:2.0:1788684508.855332:0:23463:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].19, 224 off11544 00000040:00080000:2.0:1788684508.855343:0:23463:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].20, 160 off11704 00000040:00080000:2.0:1788684508.855356:0:23463:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].21, 224 off11928 00000040:00080000:2.0:1788684508.855413:0:23463:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].22, 224 off12152 00000040:00080000:2.0:1788684508.855431:0:23463:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].23, 80 off12232 00000040:00080000:2.0:1788684508.855445:0:23463:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].24, 224 off12456 00000040:00080000:2.0:1788684508.855460:0:23463:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].25, 224 off12680 00000040:00080000:2.0:1788684508.855473:0:23463:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].26, 88 off12768 00000040:00080000:2.0:1788684508.855486:0:23463:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].27, 144 off12912 00000040:00080000:2.0:1788684508.855498:0:23463:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].28, 152 off13064 00000040:00080000:2.0:1788684508.855509:0:23463:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].29, 136 off13200 00000040:00080000:2.0:1788684508.855520:0:23463:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].30, 224 off13424 00000040:00080000:2.0:1788684508.855530:0:23463:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].31, 224 off13648 00000040:00080000:2.0:1788684508.855541:0:23463:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].32, 80 off13728 00000040:00080000:2.0:1788684508.855553:0:23463:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].33, 224 off13952 00000040:00080000:2.0:1788684508.855566:0:23463:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].34, 224 off14176 00000040:00080000:2.0:1788684508.855578:0:23463:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].35, 88 off14264 00000040:00080000:2.0:1788684508.855592:0:23463:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].36, 144 off14408 00000040:00080000:2.0:1788684508.855607:0:23463:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].37, 152 off14560 00000040:00080000:2.0:1788684508.855619:0:23463:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].38, 136 off14696 00000040:00080000:2.0:1788684508.855645:0:23463:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].39, 224 off14920 00000040:00080000:2.0:1788684508.855659:0:23463:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].40, 224 off15144 00000040:00080000:2.0:1788684508.855671:0:23463:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].41, 80 off15224 00000040:00080000:2.0:1788684508.855684:0:23463:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].42, 224 off15448 00000040:00080000:2.0:1788684508.855695:0:23463:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].43, 224 off15672 00000040:00080000:2.0:1788684508.855706:0:23463:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].44, 120 off15792 00000100:00100000:2.0:1788684508.855747:0:23463:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d677fa83b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cebd1789-51a4-46ff-b167-6b1633e930a1:23463:1875571085901440:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788684508.855807:0:23463:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788684508.855846:0:23463:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d6742ffd3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788684508.856290:0:22725:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085901440 00000100:00100000:0.0:1788684508.856300:0:22725:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085901440 00000100:00100000:0.0:1788684508.856345:0:22725:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1788684508.856355:0:22725:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6746cae050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cebd1789-51a4-46ff-b167-6b1633e930a1+15:23463:x1875571085901440:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788684508.857512:0:22725:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6746cae050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cebd1789-51a4-46ff-b167-6b1633e930a1+15:23463:x1875571085901440:12345-0@lo:502:mount.lustre.0 Request processed in 1153us (1699us total) trans 0 rc 0/0 00000100:00100000:0.0:1788684508.857523:0:22725:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00010000:00010000:1.0:1788684508.861975:0:22720:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788684508.871030:0:23463:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d677fa83b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cebd1789-51a4-46ff-b167-6b1633e930a1:23463:1875571085901440:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1788684508.871211:0:23463:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].45, 224 off16016 00000040:00080000:2.0:1788684508.871227:0:23463:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 45 count 46 00000020:01000000:2.0:1788684508.876863:0:23467:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788684508.876878:0:23467:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788684508.876880:0:23467:0:(obd_config.c:1563:class_process_config()) marker 11 (0x1) lustre-MDT0001-m lov setup 00000020:01000000:2.0:1788684508.876886:0:23467:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0001) 00000020:00000080:2.0:1788684508.876889:0:23467:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1788684508.876913:0:23467:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-mdtlov (ffff8d677cf2cd40) 00000020:00000080:2.0:1788684508.876936:0:23467:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type lod with refcount 2 00000020:00000080:2.0:1788684508.876942:0:23467:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:2.0:1788684508.877039:0:23467:0:(osd_handler.c:8924:osd_obd_connect()) connect #1 00000020:00000080:2.0:1788684508.877057:0:23467:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x44bac02bd54adde7 00000020:00000080:2.0:1788684508.877276:0:23467:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-mdtlov (uuid lustre-MDT0001-mdtlov_UUID) 00000020:01000000:2.0:1788684508.877281:0:23467:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788684508.877284:0:23467:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788684508.877286:0:23467:0:(obd_config.c:1563:class_process_config()) marker 11 (0x2) lustre-MDT0001-m lov setup 00000020:01000000:2.0:1788684508.877288:0:23467:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788684508.877292:0:23467:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788684508.877293:0:23467:0:(obd_config.c:1563:class_process_config()) marker 12 (0x1) lustre-MDT0001 add mdt 00000020:00000080:2.0:1788684508.877296:0:23467:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1788684508.877304:0:23467:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001 (ffff8d677cf28000) 00000020:00000080:2.0:1788684508.877315:0:23467:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type mdt with refcount 2 00000020:00000080:2.0:1788684508.877318:0:23467:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:2.0:1788684508.877325:0:23467:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0001 osc lustre-MDT0001-mdtlov mdc (null) 00000020:01000000:2.0:1788684508.877327:0:23467:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0001 00000020:00000080:2.0:1788684508.877333:0:23467:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:2.0:1788684508.877408:0:23467:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8d6647429800 from lustre-MDT0001, refs=2 00000020:00000080:2.0:1788684508.877420:0:23467:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0001 (ffff8d677721cd40) 00000020:00000080:2.0:1788684508.877429:0:23467:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type mdd with refcount 2 00000004:01000000:2.0:1788684508.877489:0:23467:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:2.0:1788684508.877494:0:23467:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x44bac02bd54addfc 00000020:00000080:2.0:1788684508.877593:0:23467:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0001 (uuid lustre-MDD0001_UUID) 00000004:01000000:2.0:1788684508.877599:0:23467:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:2.0:1788684508.877603:0:23467:0:(genops.c:1385:class_connect()) connect: client lustre-MDD0001_UUID, cookie 0x44bac02bd54ade03 00080000:01000000:2.0:1788684508.877608:0:23467:0:(osd_handler.c:8924:osd_obd_connect()) connect #2 00000020:00000080:2.0:1788684508.877611:0:23467:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x44bac02bd54ade0a 00010000:00010000:3.0:1788684508.956349:0:23467:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0001_UUID-2 is initialized 00000001:00000004:3.0:1788684508.956800:0:23467:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 3, last_transno is 8589934595 00000001:00080000:3.0:1788684508.957098:0:23467:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0001: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:1.0:1788684508.960516:0:23467:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001 (uuid lustre-MDT0001_UUID) 00000020:01000000:1.0:1788684508.960530:0:23467:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788684508.960537:0:23467:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788684508.960539:0:23467:0:(obd_config.c:1563:class_process_config()) marker 12 (0x2) lustre-MDT0001 add mdt 00000020:01000000:1.0:1788684508.960543:0:23467:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788684508.960549:0:23467:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788684508.960551:0:23467:0:(obd_config.c:1563:class_process_config()) marker 13 (0x1) lustre-MDT0000 add osp 00000020:00000080:1.0:1788684508.960554:0:23467:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1788684508.960559:0:23467:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.206.144@tcp to nid 0x20000c0a8ce90 (192.168.206.144@tcp) 00000020:00000080:1.0:1788684508.960584:0:23467:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1788684508.960605:0:23467:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osp-MDT0001 (ffff8d677e3ecd40) 00000020:00000080:1.0:1788684508.960625:0:23467:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type osp with refcount 2 00000020:00000080:1.0:1788684508.960632:0:23467:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1788684508.960700:0:23467:0:(osp_dev.c:1203:osp_init0()) lustre-MDT0000-osp-MDT0001: connect to lustre-MDT0001-osd (lustre-MDT0000-osp-MDT0001) 00080000:01000000:1.0:1788684508.960706:0:23467:0:(osd_handler.c:8924:osd_obd_connect()) connect #3 00000020:00000080:1.0:1788684508.960713:0:23467:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x44bac02bd54ade18 00010000:00080000:1.0:1788684508.960743:0:23467:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8d6775ee2800@lustre-MDT0000-osp-MDT0001: add connection 192.168.206.144@tcp at head 00010000:00010000:1.0:1788684508.962883:0:23467:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-osp-MDT0001-5 is initialized 00000020:00000080:2.0:1788684508.963886:0:23467:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osp-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:2.0:1788684508.963900:0:23467:0:(obd_config.c:1472:class_process_config()) processing cmd: cf014 00000004:01000000:2.0:1788684508.963933:0:23467:0:(lod_lov.c:128:lod_add_device()) osp:lustre-MDT0000_UUID idx:0 gen:1 00000020:00000080:2.0:1788684508.963954:0:23467:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x44bac02bd54ade1f 00000100:00080000:2.0:1788684508.963965:0:23467:0:(import.c:545:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1788684508.963971:0:23467:0:(import.c:665:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff8d6775ee2800 using connection 192.168.206.144@tcp/0@lo 00000100:00100000:2.0:1788684508.964014:0:23467:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8d677fa83800 x1875571085901568/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788684508.964043:0:23467:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID 00000100:00080000:2.0:1788684508.964130:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:2.0:1788684508.964134:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:2.0:1788684508.964137:0:36:0:(import.c:65:import_set_state_nolock()) ffff8d6775fa3000 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788684508.964141:0:36:0:(import.c:545:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 587 00000100:00080000:2.0:1788684508.964145:0:36:0:(import.c:630:import_select_connection()) lustre-MDT0001-osp-MDT0000: tried all connections, increasing latency to 15s 00000100:00080000:2.0:1788684508.965225:0:36:0:(import.c:665:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff8d6775fa3000 using connection 192.168.206.144@tcp/0@lo 00000100:00100000:2.0:1788684508.965254:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8d677fa80000 x1875571085901696/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788684508.965273:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788684508.965277:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1788684508.965280:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788684508.965282:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1788684508.965334:0:3625:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d677fa82a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3625:1875571085901824:0@lo:400:kworker.0 00000100:00100000:2.0:1788684508.965410:0:3625:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:01000000:2.0:1788684508.965509:0:23467:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788684508.965515:0:23467:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788684508.965518:0:23467:0:(obd_config.c:1563:class_process_config()) marker 13 (0x2) lustre-MDT0000 add osp 00000020:01000000:2.0:1788684508.965522:0:23467:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:2.0:1788684508.965524:0:23467:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #14 00000020:01000000:2.0:1788684508.965525:0:23467:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1788684508.965527:0:23467:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1788684508.965528:0:23467:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:2.0:1788684508.965530:0:23467:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788684508.965532:0:23467:0:(obd_config.c:1563:class_process_config()) marker 14 (0x6) lustre sys.timeout 00000020:01000000:2.0:1788684508.965534:0:23467:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788684508.965538:0:23467:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788684508.965540:0:23467:0:(obd_config.c:1563:class_process_config()) marker 15 (0x1) lustre-MDT0001 mdt.identity_upcall 00000020:00000080:2.0:1788684508.965543:0:23467:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:2.0:1788684508.965585:0:23467:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0001: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:2.0:1788684508.965598:0:23467:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788684508.965601:0:23467:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788684508.965602:0:23467:0:(obd_config.c:1563:class_process_config()) marker 15 (0x2) lustre-MDT0001 mdt.identity_upcall 00000020:01000000:2.0:1788684508.965604:0:23467:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:2.0:1788684508.965606:0:23467:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #18 00000020:01000000:2.0:1788684508.965608:0:23467:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1788684508.965609:0:23467:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1788684508.965611:0:23467:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:2.0:1788684508.965619:0:23467:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788684508.965621:0:23467:0:(obd_config.c:1563:class_process_config()) marker 18 (0x6) lustre sys.timeout 00000020:01000000:2.0:1788684508.965625:0:23467:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1788684508.965628:0:23467:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/mds2_flakey 00000020:00000080:2.0:1788684508.965632:0:23467:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788684508.965633:0:23467:0:(obd_config.c:1563:class_process_config()) marker 23 (0x1) lustre-OST0000 add osc 00000020:00000080:2.0:1788684508.965635:0:23467:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1788684508.965639:0:23467:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.206.144@tcp to nid 0x20000c0a8ce90 (192.168.206.144@tcp) 00000020:01000000:2.0:1788684508.965658:0:23467:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0001) 00000020:00000080:2.0:1788684508.965661:0:23467:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1788684508.965673:0:23467:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0001 (ffff8d67772199c0) 00000020:00000080:2.0:1788684508.965687:0:23467:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type osp with refcount 2 00000020:00000080:2.0:1788684508.965692:0:23467:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000100:00100000:1.0:1788684508.965974:0:3622:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d677fa83800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3622:1875571085901568:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1788684508.966022:0:3622:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788684508.966065:0:3622:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d677fa80000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3622:1875571085901696:0@lo:38:kworker.0 00000100:00100000:1.0:1788684508.966087:0:3622:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788684508.966320:0:22738:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085901568 00000100:00100000:2.0:1788684508.966328:0:22738:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085901568 00000100:00100000:2.0:1788684508.966348:0:22738:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085901696 00000100:00100000:2.0:1788684508.966350:0:22738:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085901696 00000100:00100000:2.0:1788684508.966361:0:22738:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788684508.966395:0:22738:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d674698d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3622:x1875571085901568:12345-0@lo:38:llog_process_th.0 00010000:00080000:2.0:1788684508.966431:0:22738:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 589 last 0 00000020:00000080:2.0:1788684508.966461:0:22738:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x44bac02bd54ade2d 00000004:00100000:2.0:1788684508.966475:0:22738:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000001:00000004:2.0:1788684508.966480:0:22738:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 3, last_transno is 12884901888 00000004:00080000:2.0:1788684508.966599:0:23467:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0001: connect to lustre-MDT0001-osd (lustre-OST0000-osc-MDT0001) 00080000:01000000:2.0:1788684508.966606:0:23467:0:(osd_handler.c:8924:osd_obd_connect()) connect #4 00000020:00000080:2.0:1788684508.966612:0:23467:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x44bac02bd54ade34 00010000:00080000:2.0:1788684508.966640:0:23467:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8d6751b75000@lustre-OST0000-osc-MDT0001: add connection 192.168.206.144@tcp at head 00010000:00010000:2.0:1788684508.966855:0:23467:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0001-6 is initialized 00000100:00100000:3.0:1788684508.967398:0:22734:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085901824 00000100:00100000:3.0:1788684508.967406:0:22734:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085901824 00000100:00100000:3.0:1788684508.967445:0:22734:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788684508.967453:0:22734:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d677fa80a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3625:x1875571085901824:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788684508.967519:0:22734:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d677fa80a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3625:x1875571085901824:12345-0@lo:400:kworker.0 Request processed in 66us (2109us total) trans 0 rc 0/0 00000100:00100000:3.0:1788684508.967527:0:22734:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:3.0:1788684508.967569:0:3625:0:(ldlm_request.c:1670:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff8d677fa82a00 x1875571085901824/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788684524 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788684508.967596:0:3625:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d677fa82a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3625:1875571085901824:0@lo:400:kworker.0 00000040:01000000:1.0:1788684508.970253:0:23467:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:1.0:1788684508.970612:0:23467:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0001 ctxt 2 is initialized 00000040:00080000:1.0:1788684508.973704:0:23467:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788684508.975229:0:23467:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].3, 64 off8384 00000040:00080000:1.0:1788684508.975433:0:23467:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xc:0x0].1, 64 off8256 00000040:00080000:1.0:1788684508.975808:0:23472:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:1.0:1788684508.975813:0:23472:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xc:0x0] at index 3 of catalog [0x1:0x2:0x0] 00000020:00000080:2.0:1788684508.976914:0:23467:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:2.0:1788684508.976927:0:23467:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:2.0:1788684508.976974:0:23467:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:2.0:1788684508.976997:0:23467:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x44bac02bd54ade3b 00000100:00080000:2.0:1788684508.977007:0:23467:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1788684508.977013:0:23467:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff8d6751b75000 using connection 192.168.206.144@tcp/0@lo 00000100:00100000:2.0:1788684508.977061:0:23467:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8d677fa82d80 x1875571085901952/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788684508.977087:0:23467:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:2.0:1788684508.977144:0:23467:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788684508.977148:0:23467:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788684508.977150:0:23467:0:(obd_config.c:1563:class_process_config()) marker 23 (0x2) lustre-OST0000 add osc 00000020:01000000:2.0:1788684508.977153:0:23467:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:2.0:1788684508.977155:0:23467:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #25 00000020:01000000:2.0:1788684508.977157:0:23467:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1788684508.977158:0:23467:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1788684508.977159:0:23467:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:2.0:1788684508.977162:0:23467:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788684508.977163:0:23467:0:(obd_config.c:1563:class_process_config()) marker 25 (0x6) lustre sys.timeout 00000020:01000000:2.0:1788684508.977165:0:23467:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1788684508.977169:0:23467:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/mds2_flakey 00000020:00000080:2.0:1788684508.977172:0:23467:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788684508.977173:0:23467:0:(obd_config.c:1563:class_process_config()) marker 31 (0x1) lustre-OST0001 add osc 00000020:00000080:2.0:1788684508.977176:0:23467:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1788684508.977179:0:23467:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.206.144@tcp to nid 0x20000c0a8ce90 (192.168.206.144@tcp) 00000020:01000000:2.0:1788684508.977214:0:23467:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0001) 00000020:00000080:2.0:1788684508.977217:0:23467:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1788684508.977228:0:23467:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0001 (ffff8d6777218000) 00000020:00000080:2.0:1788684508.977240:0:23467:0:(obd_config.c:720:class_attach_name()) OBD: dev 18 attached type osp with refcount 2 00000020:00000080:2.0:1788684508.977244:0:23467:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:2.0:1788684508.977311:0:23467:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0001: connect to lustre-MDT0001-osd (lustre-OST0001-osc-MDT0001) 00080000:01000000:2.0:1788684508.977318:0:23467:0:(osd_handler.c:8924:osd_obd_connect()) connect #5 00000020:00000080:2.0:1788684508.977323:0:23467:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x44bac02bd54ade49 00010000:00080000:2.0:1788684508.977354:0:23467:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8d677cc6b000@lustre-OST0001-osc-MDT0001: add connection 192.168.206.144@tcp at head 00010000:00010000:2.0:1788684508.977581:0:23467:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0001-7 is initialized 00000040:01000000:2.0:1788684508.977640:0:23467:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:2.0:1788684508.977656:0:23467:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0001 ctxt 2 is initialized 00000100:00080000:0.0:1788684508.978064:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788684508.978069:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1788684508.978072:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788684508.978074:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1788684508.978392:0:3622:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d677fa82d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3622:1875571085901952:0@lo:8:llog_process_th.0 00000400:00000100:1.0:1788684508.978447:0:3622:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875571085901952 offset 0 length 520: 4 00000100:00080000:0.0:1788684508.980226:0:22738:0:(import.c:65:import_set_state_nolock()) ffff8d66484c8000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788684508.980307:0:22738:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d674698d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3622:x1875571085901568:12345-0@lo:38:llog_process_th.0 Request processed in 13911us (14282us total) trans 0 rc 0/0 00000100:00100000:0.0:1788684508.980316:0:22738:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788684508.980342:0:22738:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788684508.980348:0:22738:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d674698fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3622:x1875571085901696:12345-0@lo:38:kworker.0 00000100:00100000:0.0:1788684508.980424:0:22738:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d674698fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3622:x1875571085901696:12345-0@lo:38:kworker.0 Request processed in 74us (14335us total) trans 0 rc -11/-11 00000100:00100000:0.0:1788684508.980440:0:22738:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788684508.980990:0:3622:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:1.0:1788684508.981001:0:3622:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-MDT0000-osp-MDT0001: connect to target with instance 3 00000100:00080000:1.0:1788684508.981009:0:3622:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-MDT0000-osp-MDT0001: Resetting ns_connect_flags to server flags: 0xa2400010450010a0 00000100:00080000:1.0:1788684508.981014:0:3622:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:1.0:1788684508.981017:0:3622:0:(import.c:65:import_set_state_nolock()) ffff8d6775ee2800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1788684508.981038:0:3622:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d677fa83800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3622:1875571085901568:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1788684508.981056:0:3622:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1788684508.981068:0:3622:0:(import.c:65:import_set_state_nolock()) ffff8d6775fa3000 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788684508.981072:0:3622:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-11) 00000100:00100000:1.0:1788684508.981075:0:3622:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d677fa80000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3622:1875571085901696:0@lo:38:kworker.0 00000100:00100000:3.0:1788684508.981222:0:3625:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788684508.981237:0:3625:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d677fa83100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3625:1875571085902080:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788684508.981281:0:3625:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788684508.981352:0:22737:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085902080 00000100:00100000:2.0:1788684508.981359:0:22737:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085902080 00000100:00100000:2.0:1788684508.981424:0:22737:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788684508.981432:0:22737:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6647908a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3625:x1875571085902080:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1788684508.981456:0:22737:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446309888 avail 1300070400 00000100:00100000:2.0:1788684508.981499:0:22737:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6647908a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3625:x1875571085902080:12345-0@lo:41:osp-pre-0-1.0 Request processed in 67us (217us total) trans 0 rc 0/0 00000100:00100000:2.0:1788684508.981506:0:22737:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788684508.981590:0:3625:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d677fa83100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3625:1875571085902080:0@lo:41:osp-pre-0-1.0 00000040:00080000:2.0:1788684508.982056:0:23467:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788684508.982531:0:23467:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].3, 64 off8384 00000040:00080000:2.0:1788684508.982652:0:23467:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xe:0x0].1, 64 off8256 00000040:00080000:2.0:1788684508.983602:0:23474:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:2.0:1788684508.983608:0:23474:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 3 of catalog [0x1:0x5:0x0] 00000020:00000080:3.0:1788684508.984621:0:23467:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:3.0:1788684508.984634:0:23467:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:3.0:1788684508.984673:0:23467:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:3.0:1788684508.984694:0:23467:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x44bac02bd54ade50 00000100:00080000:3.0:1788684508.984705:0:23467:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1788684508.984710:0:23467:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff8d677cc6b000 using connection 192.168.206.144@tcp/0@lo 00000100:00100000:3.0:1788684508.984755:0:23467:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8d664790b480 x1875571085902208/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788684508.984782:0:23467:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:3.0:1788684508.984833:0:23467:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788684508.984837:0:23467:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788684508.984839:0:23467:0:(obd_config.c:1563:class_process_config()) marker 31 (0x2) lustre-OST0001 add osc 00000020:01000000:3.0:1788684508.984842:0:23467:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788684508.984846:0:23467:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788684508.984847:0:23467:0:(obd_config.c:1563:class_process_config()) marker 33 (0x1) lustre sys.timeout 00000020:00000080:3.0:1788684508.984850:0:23467:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1788684508.984851:0:23467:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:3.0:1788684508.984853:0:23467:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788684508.984855:0:23467:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788684508.984856:0:23467:0:(obd_config.c:1563:class_process_config()) marker 33 (0x2) lustre sys.timeout 00000020:01000000:3.0:1788684508.984859:0:23467:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788684508.984860:0:23467:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788684508.984861:0:23467:0:(obd_config.c:1563:class_process_config()) marker 38 (0x1) lustre sys.jobid_var 00000020:00000080:3.0:1788684508.984871:0:23467:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:3.0:1788684508.984895:0:23467:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788684508.984898:0:23467:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788684508.984900:0:23467:0:(obd_config.c:1563:class_process_config()) marker 38 (0x2) lustre sys.jobid_var 00000040:00080000:3.0:1788684508.984903:0:23467:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xe:0x0] index 46 count 46 00000020:01000000:3.0:1788684508.984970:0:23463:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 1-45 (rc=0) 10000000:01000000:3.0:1788684508.985005:0:23463:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.144@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:3.0:1788684508.985023:0:23463:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.144@tcp lock: ffff8d66479a0000/0x44bac02bd54addd2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x44bac02bd54addd9 expref: -99 pid: 23463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684508.985033:0:23463:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.144@tcp lock: ffff8d66479a0000/0x44bac02bd54addd2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x44bac02bd54addd9 expref: -99 pid: 23463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788684508.985040:0:23463:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8d6647429800 from 1 10000000:01000000:3.0:1788684508.985043:0:23463:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1788684508.985069:0:23463:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.144@tcp lock: ffff8d66479a0200/0x44bac02bd54ade57 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 23463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684508.985077:0:23463:0:(ldlm_request.c:1106:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.144@tcp lock: ffff8d66479a0200/0x44bac02bd54ade57 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 23463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684508.985088:0:23463:0:(ldlm_request.c:1193:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.144@tcp lock: ffff8d66479a0200/0x44bac02bd54ade57 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 23463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788684508.985107:0:23463:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d664790a300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cebd1789-51a4-46ff-b167-6b1633e930a1:23463:1875571085902336:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788684508.985169:0:23463:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788684508.985210:0:23463:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d6748205540 going to sleep for 11 seconds 00000100:00100000:1.0:1788684508.985397:0:3622:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d664790b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3622:1875571085902208:0@lo:8:llog_process_th.0 00000400:00000100:1.0:1788684508.985428:0:3622:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875571085902208 offset 0 length 520: 4 00000100:00100000:0.0:1788684508.985676:0:22726:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085902336 00000100:00100000:0.0:1788684508.985685:0:22726:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085902336 00000100:00100000:0.0:1788684508.985734:0:22726:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1788684508.985744:0:22726:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6746cae450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cebd1789-51a4-46ff-b167-6b1633e930a1+15:23463:x1875571085902336:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788684508.985759:0:22726:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788684508.985772:0:22726:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d6746d3e000/0x44bac02bd54ade5e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x44bac02bd54ade57 expref: -99 pid: 22726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684508.985795:0:22726:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d6746d3e000/0x44bac02bd54ade5e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x44bac02bd54ade57 expref: 16 pid: 22726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684508.985806:0:22726:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d6746d3e000/0x44bac02bd54ade5e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x44bac02bd54ade57 expref: 16 pid: 22726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684508.985816:0:22726:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d6746d3e000, rc 0) 00000100:00100000:0.0:1788684508.985866:0:22726:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6746cae450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cebd1789-51a4-46ff-b167-6b1633e930a1+16:23463:x1875571085902336:12345-0@lo:101:mount.lustre.0 Request processed in 123us (697us total) trans 0 rc 0/0 00000100:00100000:0.0:1788684508.985873:0:22726:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00080000:0.0:1788684508.985909:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788684508.985914:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1788684508.985916:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788684508.985919:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1788684508.986040:0:23463:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d664790a300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cebd1789-51a4-46ff-b167-6b1633e930a1:23463:1875571085902336:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788684508.986056:0:23463:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.144@tcp lock: ffff8d66479a0200/0x44bac02bd54ade57 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x44bac02bd54ade5e expref: -99 pid: 23463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684508.986064:0:23463:0:(ldlm_request.c:840:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.144@tcp lock: ffff8d66479a0200/0x44bac02bd54ade57 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x44bac02bd54ade5e expref: -99 pid: 23463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788684508.986649:0:23463:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d677fa81180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cebd1789-51a4-46ff-b167-6b1633e930a1:23463:1875571085902464:0@lo:256:mount.lustre.0 00000100:00100000:2.0:1788684508.986692:0:23463:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788684508.986709:0:23463:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d6743fd5b40 going to sleep for 11 seconds 00000100:00100000:3.0:1788684508.986885:0:22725:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085902464 00000100:00100000:3.0:1788684508.986891:0:22725:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085902464 00000100:00100000:3.0:1788684508.986921:0:22725:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1788684508.986930:0:22725:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6746caf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cebd1789-51a4-46ff-b167-6b1633e930a1+16:23463:x1875571085902464:12345-0@lo:256:mount.lustre.0 20000000:01000000:3.0:1788684508.986951:0:22725:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:3.0:1788684508.986965:0:22725:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:3.0:1788684508.986968:0:22725:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 11 00000100:00100000:3.0:1788684508.987068:0:22725:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6746caf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cebd1789-51a4-46ff-b167-6b1633e930a1+16:23463:x1875571085902464:12345-0@lo:256:mount.lustre.0 Request processed in 139us (375us total) trans 0 rc 0/0 00000100:00100000:3.0:1788684508.987075:0:22725:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1788684508.987283:0:23463:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d677fa81180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cebd1789-51a4-46ff-b167-6b1633e930a1:23463:1875571085902464:0@lo:256:mount.lustre.0 10000000:01000000:2.0:1788684508.987870:0:23463:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.144@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1788684508.987896:0:23463:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.144@tcp lock: ffff8d66479a0200/0x44bac02bd54ade57 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x44bac02bd54ade5e expref: -99 pid: 23463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684508.987906:0:23463:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.144@tcp lock: ffff8d66479a0200/0x44bac02bd54ade57 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x44bac02bd54ade5e expref: -99 pid: 23463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788684508.987915:0:23463:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8d6647429800 from 1 10000000:01000000:2.0:1788684508.987918:0:23463:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788684508.987944:0:23463:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.144@tcp lock: ffff8d66476d5000/0x44bac02bd54ade65 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 23463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684508.987952:0:23463:0:(ldlm_request.c:1106:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.144@tcp lock: ffff8d66476d5000/0x44bac02bd54ade65 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 23463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684508.987962:0:23463:0:(ldlm_request.c:1193:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.144@tcp lock: ffff8d66476d5000/0x44bac02bd54ade65 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 23463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788684508.987979:0:23463:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d677fa81180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cebd1789-51a4-46ff-b167-6b1633e930a1:23463:1875571085902592:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1788684508.988015:0:23463:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788684508.988159:0:23463:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d6743fd5b40 going to sleep for 11 seconds 00000100:00100000:0.0:1788684508.991207:0:22725:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085902592 00000100:00100000:0.0:1788684508.991220:0:22725:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085902592 00000100:00100000:0.0:1788684508.991322:0:22725:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1788684508.991333:0:22725:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6746cad450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cebd1789-51a4-46ff-b167-6b1633e930a1+16:23463:x1875571085902592:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788684508.991360:0:22725:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788684508.991401:0:22725:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d6746d3fa00/0x44bac02bd54ade6c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x44bac02bd54ade65 expref: -99 pid: 22725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684508.991430:0:22725:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d6746d3fa00/0x44bac02bd54ade6c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x44bac02bd54ade65 expref: 17 pid: 22725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684508.991441:0:22725:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d6746d3fa00/0x44bac02bd54ade6c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x44bac02bd54ade65 expref: 17 pid: 22725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684508.991451:0:22725:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d6746d3fa00, rc 0) 00000100:00100000:0.0:1788684508.991524:0:22725:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6746cad450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cebd1789-51a4-46ff-b167-6b1633e930a1+17:23463:x1875571085902592:12345-0@lo:101:mount.lustre.0 Request processed in 193us (3507us total) trans 0 rc 0/0 00000100:00100000:0.0:1788684508.991531:0:22725:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1788684508.991624:0:23463:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d677fa81180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cebd1789-51a4-46ff-b167-6b1633e930a1:23463:1875571085902592:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788684508.991642:0:23463:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.144@tcp lock: ffff8d66476d5000/0x44bac02bd54ade65 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x44bac02bd54ade6c expref: -99 pid: 23463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684508.991652:0:23463:0:(ldlm_request.c:840:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.144@tcp lock: ffff8d66476d5000/0x44bac02bd54ade65 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x44bac02bd54ade6c expref: -99 pid: 23463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788684508.993565:0:23463:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 13 count 13 00000040:00080000:2.0:1788684508.993814:0:23463:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788684508.993983:0:23463:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].1, 224 off8416 00000040:00080000:2.0:1788684508.994015:0:23463:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].2, 112 off8528 00000040:00080000:2.0:1788684508.994030:0:23463:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].3, 224 off8752 00000040:00080000:2.0:1788684508.994044:0:23463:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].4, 224 off8976 00000040:00080000:2.0:1788684508.994073:0:23463:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].5, 112 off9088 00000040:00080000:2.0:1788684508.994088:0:23463:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].6, 224 off9312 00000040:00080000:2.0:1788684508.994102:0:23463:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].7, 224 off9536 00000040:00080000:2.0:1788684508.994116:0:23463:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].8, 128 off9664 00000040:00080000:2.0:1788684508.994130:0:23463:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].9, 224 off9888 00000040:00080000:2.0:1788684508.994159:0:23463:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].10, 224 off10112 00000040:00080000:2.0:1788684508.994173:0:23463:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].11, 128 off10240 00000040:00080000:2.0:1788684508.994205:0:23463:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].12, 224 off10464 00000040:00080000:2.0:1788684508.994210:0:23463:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 12 count 13 00000100:00100000:2.0:1788684508.994279:0:23463:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d677fa81180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cebd1789-51a4-46ff-b167-6b1633e930a1:23463:1875571085902720:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788684508.994336:0:23463:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788684509.001152:0:23463:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d6743fd5cc0 going to sleep for 10 seconds 00000100:00100000:1.0:1788684509.001686:0:22726:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085902720 00000100:00100000:1.0:1788684509.001698:0:22726:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085902720 00000100:00100000:1.0:1788684509.001751:0:22726:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1788684509.001761:0:22726:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6750e72850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cebd1789-51a4-46ff-b167-6b1633e930a1+17:23463:x1875571085902720:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788684509.001926:0:22726:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6750e72850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cebd1789-51a4-46ff-b167-6b1633e930a1+17:23463:x1875571085902720:12345-0@lo:501:mount.lustre.0 Request processed in 166us (7589us total) trans 0 rc 0/0 00000100:00100000:1.0:1788684509.001934:0:22726:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1788684509.002040:0:23463:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d677fa81180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cebd1789-51a4-46ff-b167-6b1633e930a1:23463:1875571085902720:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788684509.002166:0:23463:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d677fa81180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cebd1789-51a4-46ff-b167-6b1633e930a1:23463:1875571085902848:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788684509.002220:0:23463:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788684509.002250:0:23463:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d6743fd5cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1788684509.002341:0:22726:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085902848 00000100:00100000:1.0:1788684509.002345:0:22726:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085902848 00000100:00100000:1.0:1788684509.002389:0:22726:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1788684509.002397:0:22726:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6750e72450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cebd1789-51a4-46ff-b167-6b1633e930a1+17:23463:x1875571085902848:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788684509.002466:0:22726:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6750e72450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cebd1789-51a4-46ff-b167-6b1633e930a1+17:23463:x1875571085902848:12345-0@lo:503:mount.lustre.0 Request processed in 70us (245us total) trans 0 rc 0/0 00000100:00100000:1.0:1788684509.002474:0:22726:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1788684509.002552:0:23463:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d677fa81180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cebd1789-51a4-46ff-b167-6b1633e930a1:23463:1875571085902848:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1788684509.002920:0:23463:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1788684509.002984:0:23463:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d677fa81180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cebd1789-51a4-46ff-b167-6b1633e930a1:23463:1875571085902976:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788684509.003019:0:23463:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788684509.003172:0:23463:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d6743fd5b40 going to sleep for 11 seconds 00000100:00100000:0.0:1788684509.005079:0:22725:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085902976 00000100:00100000:0.0:1788684509.005092:0:22725:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085902976 00000100:00100000:1.0:1788684509.005287:0:22726:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1788684509.005299:0:22726:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6750e73850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cebd1789-51a4-46ff-b167-6b1633e930a1+17:23463:x1875571085902976:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788684509.005596:0:22726:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6750e73850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cebd1789-51a4-46ff-b167-6b1633e930a1+17:23463:x1875571085902976:12345-0@lo:502:mount.lustre.0 Request processed in 299us (2575us total) trans 0 rc 0/0 00000100:00100000:1.0:1788684509.005604:0:22726:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1788684509.005781:0:23463:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d677fa81180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cebd1789-51a4-46ff-b167-6b1633e930a1:23463:1875571085902976:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1788684509.011855:0:23463:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].1, 224 off8416 00000040:00080000:2.0:1788684509.011918:0:23463:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].2, 112 off8528 00000040:00080000:2.0:1788684509.011947:0:23463:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].3, 224 off8752 00000040:00080000:2.0:1788684509.011962:0:23463:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].4, 224 off8976 00000040:00080000:2.0:1788684509.011975:0:23463:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].5, 112 off9088 00000040:00080000:2.0:1788684509.011987:0:23463:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].6, 224 off9312 00000040:00080000:2.0:1788684509.011999:0:23463:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].7, 224 off9536 00000040:00080000:2.0:1788684509.012011:0:23463:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].8, 128 off9664 00000040:00080000:2.0:1788684509.012023:0:23463:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].9, 224 off9888 00000040:00080000:2.0:1788684509.012036:0:23463:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].10, 224 off10112 00000040:00080000:2.0:1788684509.012455:0:23463:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].11, 128 off10240 00000100:00100000:2.0:1788684509.012517:0:23463:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d677fa81180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cebd1789-51a4-46ff-b167-6b1633e930a1:23463:1875571085903104:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788684509.012589:0:23463:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788684509.012623:0:23463:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d6743fd5b40 going to sleep for 11 seconds 00000100:00100000:1.0:1788684509.012696:0:22726:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085903104 00000100:00100000:1.0:1788684509.012710:0:22726:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085903104 00000100:00100000:1.0:1788684509.012762:0:22726:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1788684509.012771:0:22726:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6750e72c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cebd1789-51a4-46ff-b167-6b1633e930a1+17:23463:x1875571085903104:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788684509.012883:0:22726:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6750e72c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cebd1789-51a4-46ff-b167-6b1633e930a1+17:23463:x1875571085903104:12345-0@lo:502:mount.lustre.0 Request processed in 113us (293us total) trans 0 rc 0/0 00000100:00100000:1.0:1788684509.012891:0:22726:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1788684509.013319:0:23463:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d677fa81180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cebd1789-51a4-46ff-b167-6b1633e930a1:23463:1875571085903104:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1788684509.013403:0:23463:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].12, 224 off10464 00000040:00080000:2.0:1788684509.013413:0:23463:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 12 count 13 00000020:01000000:3.0:1788684509.018956:0:23476:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788684509.018970:0:23476:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788684509.018972:0:23476:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:3.0:1788684509.018981:0:23476:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8d6647429800 00000020:00000080:3.0:1788684509.018984:0:23476:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1788684509.018993:0:23476:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788684509.018995:0:23476:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788684509.018997:0:23476:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:3.0:1788684509.018999:0:23476:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788684509.019001:0:23476:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788684509.019003:0:23476:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:3.0:1788684509.019006:0:23476:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8d6647429800 00000020:00000080:3.0:1788684509.019008:0:23476:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1788684509.025534:0:23476:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788684509.025550:0:23476:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788684509.025552:0:23476:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:3.0:1788684509.025558:0:23476:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788684509.025562:0:23476:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788684509.025564:0:23476:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1788684509.025570:0:23476:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8d6647429800 00000020:00000080:3.0:1788684509.025572:0:23476:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1788684509.025616:0:23476:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788684509.025619:0:23476:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788684509.025620:0:23476:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1788684509.025623:0:23476:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788684509.025626:0:23476:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788684509.025638:0:23476:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:3.0:1788684509.025643:0:23476:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8d6647429800 00000020:00000080:3.0:1788684509.025646:0:23476:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1788684509.025684:0:23476:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788684509.025688:0:23476:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788684509.025689:0:23476:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:3.0:1788684509.025692:0:23476:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x10:0x0] index 13 count 13 00000020:01000000:1.0:1788684509.029682:0:23463:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:1.0:1788684509.029733:0:23463:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.144@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788684509.029762:0:23463:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.144@tcp lock: ffff8d66476d5000/0x44bac02bd54ade65 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x44bac02bd54ade6c expref: -99 pid: 23463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684509.029775:0:23463:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.144@tcp lock: ffff8d66476d5000/0x44bac02bd54ade65 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x44bac02bd54ade6c expref: -99 pid: 23463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788684509.029834:0:23463:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:1.0:1788684509.029837:0:23463:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff8d6647429800 10000000:01000000:1.0:1788684509.029840:0:23463:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff8d6647429800 10000000:01000000:1.0:1788684509.029844:0:23463:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1788684509.029850:0:23463:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8d6647429800 from 1 10000000:01000000:1.0:1788684509.029852:0:23463:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1788684509.029890:0:23463:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.144@tcp lock: ffff8d6746cb3000/0x44bac02bd54ade73 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 23463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684509.029898:0:23463:0:(ldlm_request.c:1106:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.144@tcp lock: ffff8d6746cb3000/0x44bac02bd54ade73 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 23463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684509.029918:0:23463:0:(ldlm_request.c:1193:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.144@tcp lock: ffff8d6746cb3000/0x44bac02bd54ade73 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 23463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788684509.029943:0:23463:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d674698c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cebd1789-51a4-46ff-b167-6b1633e930a1:23463:1875571085903232:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1788684509.030020:0:23463:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788684509.030067:0:23463:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d677e2ba3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788684509.031258:0:22727:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085903232 00000100:00100000:3.0:1788684509.031269:0:22727:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085903232 00000100:00100000:3.0:1788684509.031325:0:22727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1788684509.031335:0:22727:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6750e70050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cebd1789-51a4-46ff-b167-6b1633e930a1+17:23463:x1875571085903232:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788684509.031349:0:22727:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788684509.031388:0:22727:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d66479a1200/0x44bac02bd54ade7a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x44bac02bd54ade73 expref: -99 pid: 22727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684509.031415:0:22727:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d66479a1200/0x44bac02bd54ade7a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x44bac02bd54ade73 expref: 18 pid: 22727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684509.031426:0:22727:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d66479a1200/0x44bac02bd54ade7a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x44bac02bd54ade73 expref: 18 pid: 22727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684509.031434:0:22727:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d66479a1200, rc 0) 00000100:00100000:3.0:1788684509.031487:0:22727:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6750e70050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cebd1789-51a4-46ff-b167-6b1633e930a1+18:23463:x1875571085903232:12345-0@lo:101:mount.lustre.0 Request processed in 154us (1466us total) trans 0 rc 0/0 00000100:00100000:3.0:1788684509.031494:0:22727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1788684509.037974:0:23463:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d674698c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cebd1789-51a4-46ff-b167-6b1633e930a1:23463:1875571085903232:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788684509.038005:0:23463:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.144@tcp lock: ffff8d6746cb3000/0x44bac02bd54ade73 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x44bac02bd54ade7a expref: -99 pid: 23463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684509.038018:0:23463:0:(ldlm_request.c:840:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.144@tcp lock: ffff8d6746cb3000/0x44bac02bd54ade73 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x44bac02bd54ade7a expref: -99 pid: 23463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788684509.040408:0:23463:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xc:0x0] index 52 count 51 00000040:00080000:1.0:1788684509.040682:0:23463:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788684509.040856:0:23463:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].1, 224 off8416 00000040:00080000:1.0:1788684509.040881:0:23463:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].2, 120 off8536 00000040:00080000:1.0:1788684509.040895:0:23463:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].3, 168 off8704 00000040:00080000:1.0:1788684509.043397:0:23463:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].4, 224 off8928 00000040:00080000:1.0:1788684509.043423:0:23463:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].5, 224 off9152 00000040:00080000:1.0:1788684509.043437:0:23463:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].6, 120 off9272 00000040:00080000:1.0:1788684509.043450:0:23463:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].7, 168 off9440 00000040:00080000:1.0:1788684509.043462:0:23463:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].8, 224 off9664 00000040:00080000:1.0:1788684509.043476:0:23463:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].9, 224 off9888 00000040:00080000:1.0:1788684509.043488:0:23463:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].10, 120 off10008 00000040:00080000:1.0:1788684509.043501:0:23463:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].11, 224 off10232 00000040:00080000:1.0:1788684509.043514:0:23463:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].12, 224 off10456 00000040:00080000:1.0:1788684509.043528:0:23463:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].13, 88 off10544 00000040:00080000:1.0:1788684509.043564:0:23463:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].14, 128 off10672 00000040:00080000:1.0:1788684509.043580:0:23463:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].15, 144 off10816 00000040:00080000:1.0:1788684509.043593:0:23463:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].16, 160 off10976 00000040:00080000:1.0:1788684509.043605:0:23463:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].17, 224 off11200 00000040:00080000:1.0:1788684509.043618:0:23463:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].18, 224 off11424 00000040:00080000:1.0:1788684509.043631:0:23463:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].19, 80 off11504 00000040:00080000:1.0:1788684509.043644:0:23463:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].20, 224 off11728 00000040:00080000:1.0:1788684509.043668:0:23463:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].21, 224 off11952 00000040:00080000:1.0:1788684509.043681:0:23463:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].22, 88 off12040 00000040:00080000:1.0:1788684509.043694:0:23463:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].23, 128 off12168 00000040:00080000:1.0:1788684509.043708:0:23463:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].24, 144 off12312 00000040:00080000:1.0:1788684509.043721:0:23463:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].25, 160 off12472 00000040:00080000:1.0:1788684509.043734:0:23463:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].26, 224 off12696 00000040:00080000:1.0:1788684509.043747:0:23463:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].27, 224 off12920 00000040:00080000:1.0:1788684509.043759:0:23463:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].28, 80 off13000 00000040:00080000:1.0:1788684509.043770:0:23463:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].29, 224 off13224 00000040:00080000:1.0:1788684509.043794:0:23463:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].30, 224 off13448 00000040:00080000:1.0:1788684509.043808:0:23463:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].31, 88 off13536 00000040:00080000:1.0:1788684509.043821:0:23463:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].32, 128 off13664 00000040:00080000:1.0:1788684509.043833:0:23463:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].33, 144 off13808 00000040:00080000:1.0:1788684509.043844:0:23463:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].34, 128 off13936 00000040:00080000:1.0:1788684509.043857:0:23463:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].35, 224 off14160 00000040:00080000:1.0:1788684509.043869:0:23463:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].36, 224 off14384 00000040:00080000:1.0:1788684509.043882:0:23463:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].37, 80 off14464 00000040:00080000:1.0:1788684509.043895:0:23463:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].38, 224 off14688 00000040:00080000:1.0:1788684509.045694:0:23463:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].39, 224 off14912 00000040:00080000:1.0:1788684509.045719:0:23463:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].40, 88 off15000 00000040:00080000:1.0:1788684509.045734:0:23463:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].41, 128 off15128 00000040:00080000:1.0:1788684509.045746:0:23463:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].42, 144 off15272 00000040:00080000:1.0:1788684509.045759:0:23463:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].43, 128 off15400 00000040:00080000:1.0:1788684509.045771:0:23463:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].44, 224 off15624 00000040:00080000:1.0:1788684509.045785:0:23463:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].45, 224 off15848 00000040:00080000:1.0:1788684509.045818:0:23463:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].46, 80 off15928 00000040:00080000:1.0:1788684509.045834:0:23463:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].47, 224 off16152 00000040:00080000:1.0:1788684509.045847:0:23463:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].48, 232 off16384 00000040:00080000:1.0:1788684509.048139:0:23463:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].49, 224 off16608 00000040:00080000:1.0:1788684509.051277:0:23463:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].50, 120 off16728 00000040:00080000:1.0:1788684509.051311:0:23463:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].51, 224 off16952 00000040:00080000:1.0:1788684509.051318:0:23463:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xc:0x0] index 51 count 51 00000100:00100000:1.0:1788684509.051440:0:23463:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d674698c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cebd1789-51a4-46ff-b167-6b1633e930a1:23463:1875571085903360:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788684509.051511:0:23463:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788684509.051558:0:23463:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d674330db40 going to sleep for 11 seconds 00000100:00100000:2.0:1788684509.052260:0:22725:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085903360 00000100:00100000:2.0:1788684509.052270:0:22725:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085903360 00000100:00100000:2.0:1788684509.052314:0:22725:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1788684509.052323:0:22725:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6750e73c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cebd1789-51a4-46ff-b167-6b1633e930a1+18:23463:x1875571085903360:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788684509.052470:0:22725:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6750e73c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cebd1789-51a4-46ff-b167-6b1633e930a1+18:23463:x1875571085903360:12345-0@lo:501:mount.lustre.0 Request processed in 148us (958us total) trans 0 rc 0/0 00000100:00100000:2.0:1788684509.052479:0:22725:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1788684509.052604:0:23463:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d674698c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cebd1789-51a4-46ff-b167-6b1633e930a1:23463:1875571085903360:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788684509.052645:0:23463:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d674698c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cebd1789-51a4-46ff-b167-6b1633e930a1:23463:1875571085903488:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788684509.052691:0:23463:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788684509.052724:0:23463:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d674330db40 going to sleep for 11 seconds 00000100:00100000:2.0:1788684509.054244:0:22726:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085903488 00000100:00100000:2.0:1788684509.054255:0:22726:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085903488 00000100:00100000:2.0:1788684509.054299:0:22726:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1788684509.054307:0:22726:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6750e71c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cebd1789-51a4-46ff-b167-6b1633e930a1+18:23463:x1875571085903488:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788684509.054454:0:22726:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6750e71c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cebd1789-51a4-46ff-b167-6b1633e930a1+18:23463:x1875571085903488:12345-0@lo:503:mount.lustre.0 Request processed in 148us (1763us total) trans 0 rc 0/0 00000100:00100000:2.0:1788684509.054471:0:22726:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1788684509.058214:0:23463:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d674698c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cebd1789-51a4-46ff-b167-6b1633e930a1:23463:1875571085903488:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1788684509.058682:0:23463:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1788684509.058763:0:23463:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d674698c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cebd1789-51a4-46ff-b167-6b1633e930a1:23463:1875571085903616:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788684509.058831:0:23463:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788684509.058877:0:23463:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d674330db40 going to sleep for 11 seconds 00000100:00100000:2.0:1788684509.059074:0:22727:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085903616 00000100:00100000:2.0:1788684509.059082:0:22727:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085903616 00000100:00100000:2.0:1788684509.059123:0:22727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1788684509.059132:0:22727:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67511ad850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cebd1789-51a4-46ff-b167-6b1633e930a1+18:23463:x1875571085903616:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788684509.059255:0:22727:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67511ad850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cebd1789-51a4-46ff-b167-6b1633e930a1+18:23463:x1875571085903616:12345-0@lo:502:mount.lustre.0 Request processed in 123us (423us total) trans 0 rc 0/0 00000100:00100000:2.0:1788684509.059263:0:22727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1788684509.063254:0:23463:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d674698c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cebd1789-51a4-46ff-b167-6b1633e930a1:23463:1875571085903616:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1788684509.063508:0:23463:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].1, 224 off8416 00000040:00080000:1.0:1788684509.063539:0:23463:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].2, 120 off8536 00000040:00080000:1.0:1788684509.063556:0:23463:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].3, 168 off8704 00000040:00080000:1.0:1788684509.063570:0:23463:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].4, 224 off8928 00000040:00080000:1.0:1788684509.063582:0:23463:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].5, 224 off9152 00000040:00080000:1.0:1788684509.063595:0:23463:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].6, 120 off9272 00000040:00080000:1.0:1788684509.063608:0:23463:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].7, 168 off9440 00000040:00080000:1.0:1788684509.063637:0:23463:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].8, 224 off9664 00000040:00080000:1.0:1788684509.063651:0:23463:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].9, 224 off9888 00000040:00080000:1.0:1788684509.063663:0:23463:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].10, 120 off10008 00000040:00080000:1.0:1788684509.063675:0:23463:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].11, 224 off10232 00000040:00080000:1.0:1788684509.063687:0:23463:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].12, 224 off10456 00000040:00080000:1.0:1788684509.063700:0:23463:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].13, 88 off10544 00000040:00080000:1.0:1788684509.063713:0:23463:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].14, 128 off10672 00000040:00080000:1.0:1788684509.063725:0:23463:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].15, 144 off10816 00000040:00080000:1.0:1788684509.063747:0:23463:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].16, 160 off10976 00000040:00080000:1.0:1788684509.063760:0:23463:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].17, 224 off11200 00000040:00080000:1.0:1788684509.063772:0:23463:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].18, 224 off11424 00000040:00080000:1.0:1788684509.063785:0:23463:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].19, 80 off11504 00000040:00080000:1.0:1788684509.063799:0:23463:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].20, 224 off11728 00000040:00080000:1.0:1788684509.063811:0:23463:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].21, 224 off11952 00000040:00080000:1.0:1788684509.063824:0:23463:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].22, 88 off12040 00000040:00080000:1.0:1788684509.063835:0:23463:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].23, 128 off12168 00000040:00080000:1.0:1788684509.063858:0:23463:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].24, 144 off12312 00000040:00080000:1.0:1788684509.063874:0:23463:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].25, 160 off12472 00000040:00080000:1.0:1788684509.063886:0:23463:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].26, 224 off12696 00000040:00080000:1.0:1788684509.065541:0:23463:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].27, 224 off12920 00000040:00080000:1.0:1788684509.065593:0:23463:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].28, 80 off13000 00000040:00080000:1.0:1788684509.065608:0:23463:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].29, 224 off13224 00000040:00080000:1.0:1788684509.065622:0:23463:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].30, 224 off13448 00000040:00080000:1.0:1788684509.065635:0:23463:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].31, 88 off13536 00000040:00080000:1.0:1788684509.065648:0:23463:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].32, 128 off13664 00000040:00080000:1.0:1788684509.065660:0:23463:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].33, 144 off13808 00000040:00080000:1.0:1788684509.065672:0:23463:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].34, 128 off13936 00000040:00080000:1.0:1788684509.065685:0:23463:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].35, 224 off14160 00000040:00080000:1.0:1788684509.065698:0:23463:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].36, 224 off14384 00000040:00080000:1.0:1788684509.065710:0:23463:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].37, 80 off14464 00000040:00080000:1.0:1788684509.065723:0:23463:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].38, 224 off14688 00000040:00080000:1.0:1788684509.065735:0:23463:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].39, 224 off14912 00000040:00080000:1.0:1788684509.065763:0:23463:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].40, 88 off15000 00000040:00080000:1.0:1788684509.065779:0:23463:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].41, 128 off15128 00000040:00080000:1.0:1788684509.065793:0:23463:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].42, 144 off15272 00000040:00080000:1.0:1788684509.065806:0:23463:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].43, 128 off15400 00000040:00080000:1.0:1788684509.065819:0:23463:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].44, 224 off15624 00000040:00080000:1.0:1788684509.065831:0:23463:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].45, 224 off15848 00000040:00080000:1.0:1788684509.065843:0:23463:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].46, 80 off15928 00000040:00080000:1.0:1788684509.065857:0:23463:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].47, 224 off16152 00000040:00080000:1.0:1788684509.065870:0:23463:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].48, 232 off16384 00000100:00100000:1.0:1788684509.067330:0:23463:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d674698c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cebd1789-51a4-46ff-b167-6b1633e930a1:23463:1875571085903744:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788684509.067422:0:23463:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788684509.067471:0:22725:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085903744 00000100:00100000:1.0:1788684509.067478:0:22725:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085903744 00000100:00100000:1.0:1788684509.067522:0:22725:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1788684509.067531:0:22725:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67511af450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cebd1789-51a4-46ff-b167-6b1633e930a1+18:23463:x1875571085903744:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788684509.067647:0:22725:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67511af450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cebd1789-51a4-46ff-b167-6b1633e930a1+18:23463:x1875571085903744:12345-0@lo:502:mount.lustre.0 Request processed in 117us (224us total) trans 0 rc 0/0 00000100:00100000:1.0:1788684509.067655:0:22725:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1788684509.067711:0:23463:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d674330db40 going to sleep for 11 seconds 00000100:00100000:1.0:1788684509.067733:0:23463:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d674698c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cebd1789-51a4-46ff-b167-6b1633e930a1:23463:1875571085903744:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1788684509.071607:0:23463:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].49, 224 off16608 00000040:00080000:1.0:1788684509.074286:0:23463:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].50, 120 off16728 00000100:00100000:1.0:1788684509.074378:0:23463:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d674698c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cebd1789-51a4-46ff-b167-6b1633e930a1:23463:1875571085903872:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788684509.074462:0:23463:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788684509.074507:0:23463:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d674330db40 going to sleep for 11 seconds 00000100:00100000:3.0:1788684509.076087:0:22726:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085903872 00000100:00100000:3.0:1788684509.076099:0:22726:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085903872 00000100:00100000:3.0:1788684509.076160:0:22726:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1788684509.076170:0:22726:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67511ac050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cebd1789-51a4-46ff-b167-6b1633e930a1+18:23463:x1875571085903872:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788684509.076333:0:22726:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67511ac050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cebd1789-51a4-46ff-b167-6b1633e930a1+18:23463:x1875571085903872:12345-0@lo:502:mount.lustre.0 Request processed in 163us (1870us total) trans 0 rc 0/0 00000100:00100000:3.0:1788684509.076348:0:22726:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1788684509.077283:0:23463:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d674698c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cebd1789-51a4-46ff-b167-6b1633e930a1:23463:1875571085903872:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1788684509.077396:0:23463:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].51, 224 off16952 00000040:00080000:1.0:1788684509.077410:0:23463:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 51 count 51 00000020:01000004:3.0:1788684509.083425:0:23481:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0001 (typ=lwp) 00000020:00000080:3.0:1788684509.083442:0:23481:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0001 (ffff8d677e1419c0) 00000020:00000080:3.0:1788684509.083464:0:23481:0:(obd_config.c:720:class_attach_name()) OBD: dev 19 attached type lwp with refcount 2 00000020:01000004:3.0:1788684509.083544:0:23481:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8d6647429800 from lustre-MDT0001, refs=3 00000020:01000004:3.0:1788684509.083548:0:23481:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8d6647429800 from lustre-MDT0001, refs=3 00000020:01000004:3.0:1788684509.083551:0:23481:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8d6647429800 3 00010000:00080000:3.0:1788684509.083600:0:23481:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8d6647917800@lustre-MDT0000-lwp-MDT0001: add connection 192.168.206.144@tcp at head 00010000:00010000:3.0:1788684509.087506:0:23481:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0001-8 is initialized 00000020:00000080:3.0:1788684509.087722:0:23481:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0001 (uuid lustre-MDT0000-lwp-MDT0001_UUID) 00000010:01000000:3.0:1788684509.087769:0:23481:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1788684509.087784:0:23481:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0001, cookie 0x44bac02bd54ade88 00000100:00080000:3.0:1788684509.087795:0:23481:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1788684509.087801:0:23481:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff8d6647917800 using connection 192.168.206.144@tcp/0@lo 00000100:00100000:3.0:1788684509.087838:0:23481:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8d664790bb80 x1875571085904000/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788684509.087865:0:23481:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID 00000100:00080000:0.0:1788684509.087995:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:0.0:1788684509.088000:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:0.0:1788684509.088003:0:36:0:(import.c:65:import_set_state_nolock()) ffff8d6775fa3000 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788684509.088009:0:36:0:(import.c:665:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff8d6775fa3000 using connection 192.168.206.144@tcp/0@lo 00000100:00100000:0.0:1788684509.088027:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8d677fb45180 x1875571085904128/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788684509.088037:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788684509.088041:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1788684509.088044:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788684509.088057:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1788684509.088104:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788684509.088107:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1788684509.088110:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788684509.088113:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1788684509.088133:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d677fb45f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3623:1875571085904256:0@lo:400:kworker.0 00000100:00100000:0.0:1788684509.088527:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788684509.088563:0:3623:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788684509.088570:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d677fb46d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3623:1875571085904384:0@lo:400:kworker.0 00000100:00100000:0.0:1788684509.088599:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788684509.088632:0:22732:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085904256 00000100:00100000:0.0:1788684509.088639:0:22732:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085904256 00000100:00100000:0.0:1788684509.088678:0:22732:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788684509.088686:0:22732:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d677fb46680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3623:x1875571085904256:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788684509.088732:0:22732:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d677fb46680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3623:x1875571085904256:12345-0@lo:400:kworker.0 Request processed in 47us (207us total) trans 0 rc 0/0 00000100:00100000:0.0:1788684509.088740:0:22732:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788684509.088758:0:22737:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085904384 00000100:00100000:0.0:1788684509.088762:0:22737:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085904384 00000100:00100000:0.0:1788684509.088797:0:22737:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788684509.088804:0:22737:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d677fb44a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3623:x1875571085904384:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788684509.088833:0:22737:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d677fb44a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3623:x1875571085904384:12345-0@lo:400:kworker.0 Request processed in 30us (233us total) trans 0 rc 0/0 00000100:00100000:0.0:1788684509.088840:0:22737:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788684509.088878:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d677fb46d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3623:1875571085904384:0@lo:400:kworker.0 00010000:00080000:0.0:1788684509.088890:0:3623:0:(ldlm_request.c:1670:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff8d677fb45f80 x1875571085904256/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788684525 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788684509.088920:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d677fb45f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3623:1875571085904256:0@lo:400:kworker.0 00000100:00100000:1.0:1788684509.089913:0:3622:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d664790bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3622:1875571085904000:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1788684509.089959:0:3622:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788684509.089991:0:3622:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d677fb45180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3622:1875571085904128:0@lo:38:kworker.0 00000100:00100000:1.0:1788684509.090013:0:3622:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788684509.090059:0:22733:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085904000 00000100:00100000:1.0:1788684509.090065:0:22733:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085904000 00000100:00100000:1.0:1788684509.090093:0:22733:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788684509.090105:0:22733:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d674698c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3622:x1875571085904000:12345-0@lo:38:llog_process_th.0 00010000:00080000:1.0:1788684509.090131:0:22733:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0001_UUID@0@lo t0 exp 0000000000000000 cur 590 last 0 00000020:00000080:1.0:1788684509.090435:0:22733:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0001_UUID, cookie 0x44bac02bd54ade8f 00000004:00100000:1.0:1788684509.090452:0:22733:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1788684509.090486:0:22733:0:(import.c:65:import_set_state_nolock()) ffff8d664740b000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788684509.090535:0:22733:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d674698c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3622:x1875571085904000:12345-0@lo:38:llog_process_th.0 Request processed in 428us (574us total) trans 0 rc 0/0 00000100:00100000:1.0:1788684509.090542:0:22733:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788684509.090674:0:22737:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085904128 00000100:00100000:1.0:1788684509.090678:0:22737:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085904128 00000100:00100000:1.0:1788684509.090711:0:22737:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1788684509.090716:0:22737:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d674698c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3622:x1875571085904128:12345-0@lo:38:kworker.0 00000100:00100000:1.0:1788684509.090752:0:22737:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d674698c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3622:x1875571085904128:12345-0@lo:38:kworker.0 Request processed in 35us (737us total) trans 0 rc -11/-11 00000100:00100000:1.0:1788684509.090758:0:22737:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:1.0:1788684509.090809:0:3622:0:(ldlm_request.c:1670:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff8d664790bb80 x1875571085904000/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788684519 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788684509.090818:0:3622:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:1.0:1788684509.090826:0:3622:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0001: connect to target with instance 3 00000100:00080000:1.0:1788684509.090834:0:3622:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0001: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:1.0:1788684509.090838:0:3622:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:1.0:1788684509.090840:0:3622:0:(import.c:65:import_set_state_nolock()) ffff8d6647917800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1788684509.090846:0:3622:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d664790bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3622:1875571085904000:0@lo:38:llog_process_th.0 00000100:00080000:1.0:1788684509.090857:0:3622:0:(import.c:65:import_set_state_nolock()) ffff8d6775fa3000 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788684509.090861:0:3622:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-11) 00000100:00100000:1.0:1788684509.090863:0:3622:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d677fb45180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3622:1875571085904128:0@lo:38:kworker.0 00000040:00080000:1.0:1788684509.093277:0:23481:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x12:0x0] index 52 count 51 00000020:01000000:1.0:1788684509.093402:0:23463:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:1.0:1788684509.093434:0:23463:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.144@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1788684509.093451:0:23463:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.144@tcp lock: ffff8d6746cb3000/0x44bac02bd54ade73 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x44bac02bd54ade7a expref: -99 pid: 23463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684509.093461:0:23463:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.144@tcp lock: ffff8d6746cb3000/0x44bac02bd54ade73 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x44bac02bd54ade7a expref: -99 pid: 23463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:1.0:1788684509.093506:0:23463:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:1.0:1788684509.093509:0:23463:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:1.0:1788684509.093510:0:23463:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788684509.093511:0:23463:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788684509.093512:0:23463:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788684509.093513:0:23463:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788684509.093515:0:23463:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1788684509.093516:0:23463:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788684509.093518:0:23463:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1788684509.093521:0:23463:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0001 0x40020001 00000020:01000004:1.0:1788684509.093524:0:23463:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1788684509.093525:0:23463:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:1.0:1788684509.093526:0:23463:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788684509.093527:0:23463:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788684509.093528:0:23463:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788684509.093529:0:23463:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788684509.093530:0:23463:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1788684509.093531:0:23463:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788684509.093532:0:23463:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1788684509.093556:0:23463:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0001 00000100:00100000:1.0:1788684509.093575:0:23463:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d674698dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cebd1789-51a4-46ff-b167-6b1633e930a1:23463:1875571085904512:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1788684509.093636:0:23463:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788684509.093675:0:22727:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085904512 00000100:00100000:1.0:1788684509.093683:0:22727:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085904512 00000100:00100000:1.0:1788684509.093724:0:22727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1788684509.093740:0:22727:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67511aec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cebd1789-51a4-46ff-b167-6b1633e930a1+18:23463:x1875571085904512:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1788684509.093764:0:22727:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:1.0:1788684509.093777:0:22727:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00100000:1.0:1788684509.097720:0:23463:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d674330db40 going to sleep for 11 seconds 00000001:00100000:3.0:1788684509.103566:0:22711:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 20000000:01000000:1.0:1788684509.103993:0:22727:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:1.0:1788684509.104012:0:22727:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0001, index=1, rc=0 20000000:01000000:3.0:1788684509.104028:0:22748:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:3.0:1788684509.104032:0:22748:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:3.0:1788684509.104062:0:22748:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8d66479a1e00/0x44bac02bd54ade96 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 22748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684509.104080:0:22748:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8d6746cb3c00/0x44bac02bd54add9a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x44bac02bd54add93 expref: 18 pid: 22727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684509.104087:0:22748:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8d6746d3e000/0x44bac02bd54ade5e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x44bac02bd54ade57 expref: 18 pid: 22726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684509.104112:0:22748:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8d66479a1e00/0x44bac02bd54ade96 lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 22748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684509.104152:0:22748:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8d6746d3e000/0x44bac02bd54ade5e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x44bac02bd54ade57 expref: 18 pid: 22726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684509.104168:0:22748:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8d6746d3e000/0x44bac02bd54ade5e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x44bac02bd54ade57 expref: 18 pid: 22726 timeout: 690 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788684509.104194:0:22748:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6647909c00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22748:1875571085904640:0@lo:104: 00000100:00100000:3.0:1788684509.104256:0:22748:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788684509.104310:0:22748:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8d6746cb3c00/0x44bac02bd54add9a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x44bac02bd54add93 expref: 18 pid: 22727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684509.104318:0:22748:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8d6746cb3c00/0x44bac02bd54add9a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x44bac02bd54add93 expref: 18 pid: 22727 timeout: 690 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788684509.104326:0:22748:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d664790b800 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22748:1875571085904768:0@lo:104: 00000100:00100000:3.0:1788684509.104349:0:22748:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788684509.104394:0:22748:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d677724d3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788684509.104397:0:22716:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085904640 00000100:00100000:0.0:1788684509.104405:0:22716:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085904640 00000100:00100000:3.0:1788684509.104412:0:22715:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085904768 00000100:00100000:3.0:1788684509.104414:0:22715:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085904768 00000100:00100000:0.0:1788684509.104437:0:22716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788684509.104451:0:22716:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6647908700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:cebd1789-51a4-46ff-b167-6b1633e930a1+4:22748:x1875571085904640:12345-0@lo:104: 00010000:00010000:0.0:1788684509.104466:0:22716:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.144@tcp lock: ffff8d66479a0200/0x44bac02bd54ade57 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x44bac02bd54ade5e expref: -99 pid: 23463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684509.104519:0:22716:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788684509.104525:0:22716:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6647908700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:cebd1789-51a4-46ff-b167-6b1633e930a1+4:22748:x1875571085904640:12345-0@lo:104: Request processed in 81us (271us total) trans 0 rc 0/0 00000100:00100000:1.0:1788684509.106207:0:22727:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67511aec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cebd1789-51a4-46ff-b167-6b1633e930a1+18:23463:x1875571085904512:12345-0@lo:253:mount.lustre.0 Request processed in 12463us (12564us total) trans 0 rc 0/0 00000100:00100000:1.0:1788684509.106219:0:22727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1788684509.106282:0:23463:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d674698dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cebd1789-51a4-46ff-b167-6b1633e930a1:23463:1875571085904512:0@lo:253:mount.lustre.0 10000000:01000000:1.0:1788684509.106296:0:23463:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0001 got index = 1 00000020:01000004:1.0:1788684509.106299:0:23463:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1788684509.106301:0:23463:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:1.0:1788684509.106303:0:23463:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788684509.106304:0:23463:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788684509.106306:0:23463:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788684509.106307:0:23463:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788684509.106309:0:23463:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1788684509.106310:0:23463:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788684509.106312:0:23463:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:1.0:1788684509.106325:0:23463:0:(tgt_mount.c:2698:server_calc_timeout()) lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 00000100:00100000:3.0:1788684509.106942:0:22748:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6647909c00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22748:1875571085904640:0@lo:104: 00010000:00010000:1.0:1788684509.111459:0:22721:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788684509.111470:0:22721:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.144@tcp lock: ffff8d66479a0200/0x44bac02bd54ade57 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x44bac02bd54ade5e expref: -99 pid: 23463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684509.111480:0:22721:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d66479a0200 already unused, calling callback (ffffffffc1297c20) 10000000:00010000:1.0:1788684509.111485:0:22721:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.144@tcp lock: ffff8d66479a0200/0x44bac02bd54ade57 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x44bac02bd54ade5e expref: -99 pid: 23463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684509.111495:0:22721:0:(ldlm_request.c:1390:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.144@tcp lock: ffff8d66479a0200/0x44bac02bd54ade57 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x44bac02bd54ade5e expref: -99 pid: 23463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788684509.111520:0:22721:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.144@tcp lock: ffff8d66479a0200/0x44bac02bd54ade57 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x44bac02bd54ade5e expref: -99 pid: 23463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788684509.111525:0:22721:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1788684509.111574:0:22721:0:(ldlm_request.c:1438:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.144@tcp lock: ffff8d66479a0200/0x44bac02bd54ade57 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x44bac02bd54ade5e expref: -99 pid: 23463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684509.111581:0:22721:0:(ldlm_request.c:1497:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788684509.111608:0:22721:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.144@tcp lock: ffff8d66479a0200/0x44bac02bd54ade57 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x44bac02bd54ade5e expref: -99 pid: 23463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684509.111615:0:22721:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.144@tcp lock: ffff8d66479a0200/0x44bac02bd54ade57 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x44bac02bd54ade5e expref: -99 pid: 23463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684509.111630:0:22721:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788684509.111631:0:22721:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788684509.111633:0:22721:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788684509.112297:0:3625:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d674698dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:cebd1789-51a4-46ff-b167-6b1633e930a1:3625:1875571085904896:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788684509.112362:0:3625:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788684509.116446:0:22717:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085904896 00000100:00100000:1.0:1788684509.116461:0:22717:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085904896 00010000:00010000:1.0:1788684509.116504:0:22717:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8d6746d3e000/0x44bac02bd54ade5e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x44bac02bd54ade57 expref: 18 pid: 22726 timeout: 690 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788684509.116546:0:22717:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788684509.116557:0:22717:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d664790a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cebd1789-51a4-46ff-b167-6b1633e930a1+18:3625:x1875571085904896:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788684509.116571:0:22717:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788684509.116577:0:22717:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8d6746d3e000/0x44bac02bd54ade5e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x44bac02bd54ade57 expref: 18 pid: 22726 timeout: 690 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684509.116590:0:22717:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8d6746d3e000/0x44bac02bd54ade5e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x44bac02bd54ade57 expref: 18 pid: 22726 timeout: 690 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684509.116624:0:22717:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d6746d3e000/0x44bac02bd54ade5e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x44bac02bd54ade57 expref: 18 pid: 22726 timeout: 690 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684509.116640:0:22717:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788684509.116716:0:22717:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d664790a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cebd1789-51a4-46ff-b167-6b1633e930a1+17:3625:x1875571085904896:12345-0@lo:103:ldlm_bl.0 Request processed in 161us (4353us total) trans 0 rc 0/0 00000100:00100000:1.0:1788684509.116724:0:22717:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788684509.116889:0:3625:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d674698dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:cebd1789-51a4-46ff-b167-6b1633e930a1:3625:1875571085904896:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788684509.120408:0:22716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788684509.120596:0:22716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788684509.120610:0:22716:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d664790bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:cebd1789-51a4-46ff-b167-6b1633e930a1+3:22748:x1875571085904768:12345-0@lo:104: 00010000:00010000:0.0:1788684509.120629:0:22716:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.144@tcp lock: ffff8d6746d3f600/0x44bac02bd54add93 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x44bac02bd54add9a expref: -99 pid: 22729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788684509.120733:0:22748:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d664790b800 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22748:1875571085904768:0@lo:104: 00010000:00010000:0.0:1788684509.120759:0:22748:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8d66479a1e00/0x44bac02bd54ade96 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 22748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684509.120782:0:22716:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788684509.120788:0:22716:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d664790bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:cebd1789-51a4-46ff-b167-6b1633e930a1+3:22748:x1875571085904768:12345-0@lo:104: Request processed in 184us (16439us total) trans 0 rc 0/0 00000100:00100000:0.0:1788684509.120795:0:22716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00010000:0.0:1788684509.120814:0:22720:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788684509.120825:0:22720:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.144@tcp lock: ffff8d6746d3f600/0x44bac02bd54add93 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x44bac02bd54add9a expref: -99 pid: 22729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684509.120832:0:22720:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d6746d3f600 already unused, calling callback (ffffffffc1297c20) 10000000:00010000:0.0:1788684509.120836:0:22720:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.144@tcp lock: ffff8d6746d3f600/0x44bac02bd54add93 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x44bac02bd54add9a expref: -99 pid: 22729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684509.120846:0:22720:0:(ldlm_request.c:1390:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.144@tcp lock: ffff8d6746d3f600/0x44bac02bd54add93 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x44bac02bd54add9a expref: -99 pid: 22729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788684509.120853:0:22720:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.144@tcp lock: ffff8d6746d3f600/0x44bac02bd54add93 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x44bac02bd54add9a expref: -99 pid: 22729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788684509.120858:0:22720:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1788684509.120891:0:22720:0:(ldlm_request.c:1438:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.144@tcp lock: ffff8d6746d3f600/0x44bac02bd54add93 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x44bac02bd54add9a expref: -99 pid: 22729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684509.124782:0:22720:0:(ldlm_request.c:1497:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788684509.124823:0:22720:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.144@tcp lock: ffff8d6746d3f600/0x44bac02bd54add93 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x44bac02bd54add9a expref: -99 pid: 22729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684509.124834:0:22720:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.144@tcp lock: ffff8d6746d3f600/0x44bac02bd54add93 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x44bac02bd54add9a expref: -99 pid: 22729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684509.124853:0:22720:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788684509.124855:0:22720:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788684509.124857:0:22720:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788684509.125254:0:3626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d677fb45f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:cebd1789-51a4-46ff-b167-6b1633e930a1:3626:1875571085905024:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788684509.125326:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000040:01000000:1.0:1788684509.127818:0:23463:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0001-osd ctxt 16 is initialized 00000100:00100000:1.0:1788684509.127907:0:22719:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085905024 00000100:00100000:1.0:1788684509.127917:0:22719:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085905024 00010000:00010000:1.0:1788684509.127949:0:22719:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8d6746cb3c00/0x44bac02bd54add9a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x44bac02bd54add93 expref: 17 pid: 22727 timeout: 690 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788684509.127983:0:22719:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788684509.127992:0:22719:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6647908000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:cebd1789-51a4-46ff-b167-6b1633e930a1+17:3626:x1875571085905024:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788684509.128007:0:22719:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788684509.128013:0:22719:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8d6746cb3c00/0x44bac02bd54add9a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x44bac02bd54add93 expref: 17 pid: 22727 timeout: 690 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684509.128025:0:22719:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8d6746cb3c00/0x44bac02bd54add9a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x44bac02bd54add93 expref: 17 pid: 22727 timeout: 690 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684509.128156:0:22719:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d6746cb3c00/0x44bac02bd54add9a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x44bac02bd54add93 expref: 17 pid: 22727 timeout: 690 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684509.128176:0:22719:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8d66479a1e00/0x44bac02bd54ade96 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 22748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684509.128194:0:22719:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d66479a1e00/0x44bac02bd54ade96 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 22748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1788684509.128219:0:22719:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.024186502s 00010000:00010000:1.0:1788684509.128224:0:22719:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8d66479a1e00/0x44bac02bd54ade96 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 22748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684509.128232:0:22719:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8d66479a1e00/0x44bac02bd54ade96 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 22748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684509.128238:0:22719:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8d66479a1e00/0x44bac02bd54ade96 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 22748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684509.128246:0:22719:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8d66479a1e00/0x44bac02bd54ade96 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 22748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684509.128252:0:22719:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d66479a1e00 already unused, calling callback (ffffffffc0cae340) 00010000:00010000:1.0:1788684509.128257:0:22719:0:(ldlm_request.c:377:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8d66479a1e00/0x44bac02bd54ade96 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 22748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684509.128265:0:22719:0:(ldlm_request.c:1415:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8d66479a1e00/0x44bac02bd54ade96 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 22748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684509.128279:0:22719:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8d66479a1e00/0x44bac02bd54ade96 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684509.128289:0:22719:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788684509.128357:0:22719:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6647908000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:cebd1789-51a4-46ff-b167-6b1633e930a1+16:3626:x1875571085905024:12345-0@lo:103:ldlm_bl.0 Request processed in 365us (3029us total) trans 0 rc 0/0 00000100:00100000:1.0:1788684509.128383:0:22719:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788684509.128551:0:3626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d677fb45f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:cebd1789-51a4-46ff-b167-6b1633e930a1:3626:1875571085905024:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788684509.128639:0:22748:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8d66479a1e00/0x44bac02bd54ade96 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684509.128649:0:22748:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8d66479a1e00/0x44bac02bd54ade96 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684509.128662:0:22748:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d66479a1e00/0x44bac02bd54ade96 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00080000:2.0:1788684509.131846:0:23486:0:(update_trans.c:1538:distribute_txn_commit_thread()) lustre-MDT0001: start commit thread committed batchid 0 00000020:00080000:2.0:1788684509.131856:0:23486:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 0 00000040:01000000:2.0:1788684509.132835:0:23487:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:1.0:1788684509.133083:0:23463:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osp-MDT0001 ctxt 16 is initialized 00000100:00100000:0.0:1788684509.133749:0:23488:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d677fb46d80 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:23488:1875571085905152:0@lo:1000:lod0001_rec0000.0 00000100:00100000:0.0:1788684509.133823:0:23488:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788684509.133862:0:22737:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085905152 00000100:00100000:0.0:1788684509.133869:0:22737:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085905152 00000100:00100000:0.0:1788684509.133909:0:22737:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1788684509.133918:0:22737:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d677fb46a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:23488:x1875571085905152:12345-0@lo:1000:lod0001_rec0000.0 00000100:00100000:0.0:1788684509.133987:0:22737:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d677fb46a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:23488:x1875571085905152:12345-0@lo:1000:lod0001_rec0000.0 Request processed in 69us (163us total) trans 0 rc 0/0 00000100:00100000:0.0:1788684509.133994:0:22737:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1788684509.134018:0:23488:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d6750869240 going to sleep for 11 seconds 00000100:00100000:0.0:1788684509.134041:0:23488:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d677fb46d80 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:23488:1875571085905152:0@lo:1000:lod0001_rec0000.0 00000040:01000000:0.0:1788684509.134081:0:23488:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000100:00100000:0.0:1788684509.134105:0:23488:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d677fb46d80 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:23488:1875571085905280:0@lo:1000:lod0001_rec0000.0 00000100:00100000:0.0:1788684509.134133:0:23488:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788684509.134152:0:22737:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085905280 00000100:00100000:0.0:1788684509.134156:0:22737:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085905280 00000100:00100000:0.0:1788684509.134175:0:22737:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1788684509.134192:0:22737:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d677fb44380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:23488:x1875571085905280:12345-0@lo:1000:lod0001_rec0000.0 00000100:00100000:0.0:1788684509.134278:0:22737:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d677fb44380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:23488:x1875571085905280:12345-0@lo:1000:lod0001_rec0000.0 Request processed in 96us (144us total) trans 0 rc 0/0 00000100:00100000:0.0:1788684509.134285:0:22737:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1788684509.134301:0:23488:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d6750869240 going to sleep for 11 seconds 00000100:00100000:0.0:1788684509.134319:0:23488:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d677fb46d80 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:23488:1875571085905280:0@lo:1000:lod0001_rec0000.0 00000100:00100000:0.0:1788684509.134387:0:23488:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d677fb46d80 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0000-lwp-MDT0001_UUID:23488:1875571085905408:0@lo:900:lod0001_rec0000.0 00000100:00100000:0.0:1788684509.134416:0:23488:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788684509.134446:0:22743:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085905408 00000100:00100000:0.0:1788684509.134450:0:22743:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085905408 00000100:00100000:0.0:1788684509.134474:0:22743:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788684509.134480:0:22743:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d677fb45f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:23488:x1875571085905408:12345-0@lo:900:lod0001_rec0000.0 00000100:00100000:0.0:1788684509.134513:0:22743:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d677fb45f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:23488:x1875571085905408:12345-0@lo:900:lod0001_rec0000.0 Request processed in 33us (96us total) trans 0 rc 0/0 00000100:00100000:0.0:1788684509.134519:0:22743:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788684509.134535:0:23488:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d6750869000 going to sleep for 11 seconds 00010000:00080000:0.0:1788684509.134550:0:23488:0:(ldlm_request.c:1670:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff8d677fb46d80 x1875571085905408/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1788684525 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'lod0001_rec0000.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788684509.134560:0:23488:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d677fb46d80 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0000-lwp-MDT0001_UUID:23488:1875571085905408:0@lo:900:lod0001_rec0000.0 00000100:00100000:0.0:1788684509.134591:0:23488:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d677fb46d80 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:23488:1875571085905536:0@lo:1000:lod0001_rec0000.0 00000100:00100000:0.0:1788684509.134626:0:23488:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788684509.134643:0:22737:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085905536 00000100:00100000:0.0:1788684509.134646:0:22737:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085905536 00000100:00100000:0.0:1788684509.134665:0:22737:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1788684509.134670:0:22737:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d677fb45180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:23488:x1875571085905536:12345-0@lo:1000:lod0001_rec0000.0 00000100:00100000:0.0:1788684509.134708:0:22737:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d677fb45180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:23488:x1875571085905536:12345-0@lo:1000:lod0001_rec0000.0 Request processed in 38us (82us total) trans 0 rc 0/0 00000100:00100000:0.0:1788684509.134714:0:22737:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1788684509.134729:0:23488:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d6750869240 going to sleep for 11 seconds 00000100:00100000:0.0:1788684509.134741:0:23488:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d677fb46d80 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:23488:1875571085905536:0@lo:1000:lod0001_rec0000.0 00000040:00080000:0.0:1788684509.134780:0:23488:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:01000000:1.0:1788684509.136946:0:23463:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 12 is initialized 00000040:00080000:1.0:1788684509.136990:0:23463:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:1.0:1788684509.137507:0:23463:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:1.0:1788684509.137515:0:23463:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 14 is initialized 00000040:00080000:1.0:1788684509.137554:0:23463:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788684509.138567:0:23463:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:1.0:1788684509.139091:0:23463:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:1.0:1788684509.139124:0:23463:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 15 is initialized 00000040:00080000:1.0:1788684509.139257:0:23463:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788684509.143493:0:23487:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788684509.145641:0:23487:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x240000400:0x1:0x0] index 261376 count 1 00000004:00080000:2.0:1788684509.145721:0:23487:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0001-osd retrieved update log, duration 0, retries 0 00000040:00080000:0.0:1788684509.149653:0:23488:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000401:0x1:0x0] index 261376 count 1 00000004:00080000:0.0:1788684509.149741:0:23488:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osp-MDT0001 retrieved update log, duration 0, retries 0 00000004:00080000:0.0:1788684509.149746:0:23488:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0001 got update logs from all MDTs. 00080000:10000000:1.0:1788684509.151966:0:23463:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x30:0x0] (8/32) registered 00000001:00000004:1.0:1788684509.155282:0:23463:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 3, last_transno is 12884901888 00000001:00080000:1.0:1788684509.158144:0:23463:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0001: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:1.0:1788684509.158204:0:23463:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0001: cmd=c00866e6 len=0 karg=ffffb81ec1993988 00100000:10000000:1.0:1788684509.158212:0:23463:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0001-osd: start master thread 00000020:01000004:1.0:1788684509.178624:0:23463:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:1.0:1788684509.178656:0:23463:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.206.144@tcp: cl_mgc_mutex unlock 00000020:01000004:1.0:1788684509.178674:0:23463:0:(tgt_mount.c:2464:server_fill_super_common()) Server sb, dev=48 00000080:00000004:1.0:1788684509.178696:0:23463:0:(super25.c:182:lustre_fill_super()) /dev/mapper/mds2_flakey: Mount complete 00000020:00000004:2.0:1788684509.187553:0:23463:0:(tgt_mount.c:2350:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1788684509.187793:0:23463:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:1.0:1788684509.565506:0:22774:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d6750acac00 going to sleep for 0 seconds 00010000:00010000:1.0:1788684509.887533:0:22721:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788684510.150158:0:23489:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 10000000:01000000:0.0:1788684510.589435:0:22729:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1788684510.589443:0:22729:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8d6647429800 from 12 10000000:01000000:0.0:1788684510.589447:0:22729:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1788684510.589495:0:22729:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.144@tcp lock: ffff8d6746d3f200/0x44bac02bd54ade9d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684510.589507:0:22729:0:(ldlm_request.c:1106:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.144@tcp lock: ffff8d6746d3f200/0x44bac02bd54ade9d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684510.589518:0:22729:0:(ldlm_request.c:1193:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.144@tcp lock: ffff8d6746d3f200/0x44bac02bd54ade9d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788684510.589545:0:22729:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d677fb46d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cebd1789-51a4-46ff-b167-6b1633e930a1:22729:1875571085905664:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788684510.589626:0:22729:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788684510.589671:0:22729:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d6750869300 going to sleep for 11 seconds 00000100:00100000:2.0:1788684510.589882:0:22725:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085905664 00000100:00100000:2.0:1788684510.589902:0:22725:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085905664 00000100:00100000:2.0:1788684510.589957:0:22725:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1788684510.589967:0:22725:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67511ad050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cebd1789-51a4-46ff-b167-6b1633e930a1+16:22729:x1875571085905664:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788684510.589979:0:22725:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788684510.589994:0:22725:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d66476d4800/0x44bac02bd54adea4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x44bac02bd54ade9d expref: -99 pid: 22725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684510.590016:0:22725:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d66476d4800/0x44bac02bd54adea4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x44bac02bd54ade9d expref: 17 pid: 22725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684510.590026:0:22725:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d66476d4800/0x44bac02bd54adea4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x44bac02bd54ade9d expref: 17 pid: 22725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684510.590053:0:22725:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d66476d4800, rc 0) 00000100:00100000:2.0:1788684510.590092:0:22725:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67511ad050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cebd1789-51a4-46ff-b167-6b1633e930a1+17:22729:x1875571085905664:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 126us (466us total) trans 0 rc 0/0 00000100:00100000:2.0:1788684510.590099:0:22725:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1788684510.590272:0:22729:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d677fb46d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cebd1789-51a4-46ff-b167-6b1633e930a1:22729:1875571085905664:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788684510.590287:0:22729:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.144@tcp lock: ffff8d6746d3f200/0x44bac02bd54ade9d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x44bac02bd54adea4 expref: -99 pid: 22729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684510.590295:0:22729:0:(ldlm_request.c:840:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.144@tcp lock: ffff8d6746d3f200/0x44bac02bd54ade9d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x44bac02bd54adea4 expref: -99 pid: 22729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788684510.590342:0:22729:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d677fb46d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cebd1789-51a4-46ff-b167-6b1633e930a1:22729:1875571085905792:0@lo:256:ll_cfg_requeue.0 00000100:00100000:0.0:1788684510.590410:0:22729:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788684510.590434:0:22729:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d6750869300 going to sleep for 11 seconds 00000100:00100000:2.0:1788684510.591995:0:22727:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085905792 00000100:00100000:2.0:1788684510.592006:0:22727:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085905792 00000100:00100000:2.0:1788684510.592062:0:22727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1788684510.592071:0:22727:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67511af050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cebd1789-51a4-46ff-b167-6b1633e930a1+17:22729:x1875571085905792:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:2.0:1788684510.592090:0:22727:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1788684510.592112:0:22727:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1788684510.592116:0:22727:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 12 00000100:00100000:2.0:1788684510.592231:0:22727:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67511af050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cebd1789-51a4-46ff-b167-6b1633e930a1+17:22729:x1875571085905792:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 161us (1820us total) trans 0 rc 0/0 00000100:00100000:2.0:1788684510.592238:0:22727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1788684510.592560:0:22729:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d677fb46d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cebd1789-51a4-46ff-b167-6b1633e930a1:22729:1875571085905792:0@lo:256:ll_cfg_requeue.0 10000000:01000000:0.0:1788684510.592613:0:22729:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.144@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1788684510.592622:0:22729:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.144@tcp lock: ffff8d6746d3f200/0x44bac02bd54ade9d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x44bac02bd54adea4 expref: -99 pid: 22729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684510.592632:0:22729:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.144@tcp lock: ffff8d6746d3f200/0x44bac02bd54ade9d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x44bac02bd54adea4 expref: -99 pid: 22729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788684510.592642:0:22729:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1788684510.592644:0:22729:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8d677cb59000 from 12 10000000:01000000:0.0:1788684510.592646:0:22729:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1788684510.592673:0:22729:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.144@tcp lock: ffff8d6746d3e800/0x44bac02bd54adeab lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684510.592680:0:22729:0:(ldlm_request.c:1106:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.144@tcp lock: ffff8d6746d3e800/0x44bac02bd54adeab lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684510.592698:0:22729:0:(ldlm_request.c:1193:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.144@tcp lock: ffff8d6746d3e800/0x44bac02bd54adeab lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788684510.592716:0:22729:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d677fb46d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cebd1789-51a4-46ff-b167-6b1633e930a1:22729:1875571085905920:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788684510.592751:0:22729:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788684510.592781:0:22729:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d6750869300 going to sleep for 11 seconds 00000100:00100000:2.0:1788684510.593863:0:22726:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085905920 00000100:00100000:2.0:1788684510.593872:0:22726:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085905920 00000100:00100000:2.0:1788684510.593930:0:22726:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1788684510.593939:0:22726:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67511ae050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cebd1789-51a4-46ff-b167-6b1633e930a1+17:22729:x1875571085905920:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788684510.593951:0:22726:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788684510.593966:0:22726:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d66476d4200/0x44bac02bd54adeb2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x44bac02bd54adeab expref: -99 pid: 22726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684510.593988:0:22726:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d66476d4200/0x44bac02bd54adeb2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x44bac02bd54adeab expref: 18 pid: 22726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684510.594000:0:22726:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d66476d4200/0x44bac02bd54adeb2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x44bac02bd54adeab expref: 18 pid: 22726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684510.594036:0:22726:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d66476d4200, rc 0) 00000100:00100000:2.0:1788684510.594093:0:22726:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67511ae050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cebd1789-51a4-46ff-b167-6b1633e930a1+18:22729:x1875571085905920:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 155us (1340us total) trans 0 rc 0/0 00000100:00100000:2.0:1788684510.594100:0:22726:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1788684510.594306:0:22729:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d677fb46d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cebd1789-51a4-46ff-b167-6b1633e930a1:22729:1875571085905920:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788684510.594323:0:22729:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.144@tcp lock: ffff8d6746d3e800/0x44bac02bd54adeab lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x44bac02bd54adeb2 expref: -99 pid: 22729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684510.594342:0:22729:0:(ldlm_request.c:840:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.144@tcp lock: ffff8d6746d3e800/0x44bac02bd54adeab lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x44bac02bd54adeb2 expref: -99 pid: 22729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788684510.594421:0:22729:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d677fb46d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cebd1789-51a4-46ff-b167-6b1633e930a1:22729:1875571085906048:0@lo:256:ll_cfg_requeue.0 00000100:00100000:0.0:1788684510.594457:0:22729:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788684510.594483:0:22729:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d6750869300 going to sleep for 11 seconds 00000100:00100000:0.0:1788684510.595185:0:22774:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d6750acac00 going to sleep for 0 seconds 00000100:00100000:2.0:1788684510.595801:0:22725:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085906048 00000100:00100000:2.0:1788684510.595809:0:22725:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085906048 00000100:00100000:2.0:1788684510.595859:0:22725:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1788684510.595869:0:22725:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67511af850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cebd1789-51a4-46ff-b167-6b1633e930a1+18:22729:x1875571085906048:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:2.0:1788684510.595887:0:22725:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1788684510.595914:0:22725:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1788684510.595918:0:22725:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 12 00000100:00100000:2.0:1788684510.596036:0:22725:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67511af850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cebd1789-51a4-46ff-b167-6b1633e930a1+18:22729:x1875571085906048:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 168us (1577us total) trans 0 rc 0/0 00000100:00100000:2.0:1788684510.596360:0:22725:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1788684510.599869:0:22729:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d677fb46d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cebd1789-51a4-46ff-b167-6b1633e930a1:22729:1875571085906048:0@lo:256:ll_cfg_requeue.0 10000000:01000000:0.0:1788684510.599945:0:22729:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.144@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1788684510.599957:0:22729:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.144@tcp lock: ffff8d6746d3e800/0x44bac02bd54adeab lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x44bac02bd54adeb2 expref: -99 pid: 22729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684510.599968:0:22729:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.144@tcp lock: ffff8d6746d3e800/0x44bac02bd54adeab lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x44bac02bd54adeb2 expref: -99 pid: 22729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684510.912571:0:22720:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788684511.166285:0:23489:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:0.0:1788684511.613461:0:22774:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d6750acac00 going to sleep for 0 seconds 00010000:00010000:1.0:1788684511.933812:0:22721:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788684512.637519:0:22774:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d6750acac00 going to sleep for 0 seconds 00010000:00010000:2.0:1788684512.958458:0:22720:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788684513.665808:0:22774:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d6750acac00 going to sleep for 0 seconds 00000001:02000400:2.0:1788684513.760620:0:23732:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg644-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:1.0:1788684513.983225:0:22721:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1788684514.429686:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:2.0:1788684514.429693:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:2.0:1788684514.429696:0:36:0:(import.c:65:import_set_state_nolock()) ffff8d6775fa3000 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788684514.429707:0:36:0:(import.c:665:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff8d6775fa3000 using connection 192.168.206.144@tcp/0@lo 00000100:00100000:2.0:1788684514.429734:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8d677fa83100 x1875571085906304/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788684514.429758:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788684514.429774:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1788684514.429777:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788684514.429780:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1788684514.429811:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788684514.429815:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1788684514.429818:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788684514.429821:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1788684514.429849:0:3626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d677fa82a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3626:1875571085906688:0@lo:400:kworker.0 00000100:00100000:2.0:1788684514.429912:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788684514.429946:0:3626:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788684514.429952:0:3626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d677fa83800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3626:1875571085906560:0@lo:400:kworker.0 00000100:00100000:2.0:1788684514.429977:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788684514.430048:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d677fa81180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:cebd1789-51a4-46ff-b167-6b1633e930a1:3623:1875571085906176:0@lo:400:kworker.0 00000100:00100000:0.0:1788684514.430081:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788684514.430113:0:3623:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788684514.430119:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d677fa80000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3623:1875571085906432:0@lo:400:kworker.0 00000100:00100000:0.0:1788684514.430141:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788684514.430185:0:22734:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085906688 00000100:00100000:0.0:1788684514.430193:0:22734:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085906688 00000100:00100000:0.0:1788684514.430238:0:22734:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085906432 00000100:00100000:0.0:1788684514.430247:0:22734:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085906432 00000100:00100000:0.0:1788684514.430265:0:22734:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788684514.430271:0:22734:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d677fa83b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3626:x1875571085906688:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788684514.430319:0:22732:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:3.0:1788684514.430330:0:22732:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_003' 00000100:00100000:0.0:1788684514.430337:0:22734:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d677fa83b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3626:x1875571085906688:12345-0@lo:400:kworker.0 Request processed in 65us (423us total) trans 0 rc 0/0 00000100:00100000:0.0:1788684514.430345:0:22734:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788684514.430361:0:22734:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788684514.430397:0:22734:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d677fb46d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3623:x1875571085906432:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788684514.430432:0:22734:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d677fb46d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3623:x1875571085906432:12345-0@lo:400:kworker.0 Request processed in 66us (291us total) trans 0 rc 0/0 00000100:00100000:0.0:1788684514.430439:0:22734:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788684514.430459:0:22737:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085906560 00000100:00100000:0.0:1788684514.430463:0:22737:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085906560 00000100:00100000:0.0:1788684514.430492:0:22737:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1788684514.430499:0:22737:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d677fa80700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3626:x1875571085906560:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788684514.430533:0:22737:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d677fa80700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3626:x1875571085906560:12345-0@lo:400:kworker.0 Request processed in 35us (555us total) trans 0 rc 0/0 00000100:00100000:0.0:1788684514.430539:0:22737:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00080000:0.0:1788684514.430576:0:3623:0:(ldlm_request.c:1670:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8d677fa80000 x1875571085906432/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788684530 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788684514.430589:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d677fa80000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3623:1875571085906432:0@lo:400:kworker.0 00000100:00100000:0.0:1788684514.430619:0:3626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d677fa83800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3626:1875571085906560:0@lo:400:kworker.0 00010000:00080000:0.0:1788684514.430629:0:3626:0:(ldlm_request.c:1670:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8d677fa82a00 x1875571085906688/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788684530 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788684514.430636:0:3626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d677fa82a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3626:1875571085906688:0@lo:400:kworker.0 00000100:00100000:1.0:1788684514.430845:0:3622:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d677fa83100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3622:1875571085906304:0@lo:38:kworker.0 00000100:00100000:1.0:1788684514.430877:0:3622:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788684514.430958:0:22727:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085906176 00000100:00100000:2.0:1788684514.430962:0:22727:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085906176 00000100:00100000:2.0:1788684514.430996:0:22727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1788684514.431003:0:22727:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d677fb5d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cebd1789-51a4-46ff-b167-6b1633e930a1+18:3623:x1875571085906176:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788684514.431045:0:22727:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d677fb5d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cebd1789-51a4-46ff-b167-6b1633e930a1+18:3623:x1875571085906176:12345-0@lo:400:kworker.0 Request processed in 43us (963us total) trans 0 rc 0/0 00000100:00100000:2.0:1788684514.431052:0:22727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1788684514.431100:0:3624:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788684514.431108:0:3624:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d677fa81c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3624:1875571085906816:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788684514.431130:0:3624:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788684514.431199:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d677fa81180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:cebd1789-51a4-46ff-b167-6b1633e930a1:3623:1875571085906176:0@lo:400:kworker.0 00000100:00100000:0.0:1788684514.431236:0:22738:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085906304 00000100:00100000:0.0:1788684514.431240:0:22738:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085906304 00000100:00100000:0.0:1788684514.431252:0:22738:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085906816 00000100:00100000:0.0:1788684514.431254:0:22738:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085906816 00000100:00100000:0.0:1788684514.431267:0:22738:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1788684514.431272:0:22738:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d674698d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3622:x1875571085906304:12345-0@lo:38:kworker.0 00010000:00080000:0.0:1788684514.431295:0:22738:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 595 last 0 00000020:00000080:0.0:1788684514.431325:0:22738:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x44bac02bd54adeb9 00000004:00100000:0.0:1788684514.431352:0:22738:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000001:00000004:0.0:1788684514.431358:0:22738:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 3, last_transno is 12884901888 00000100:00080000:0.0:1788684514.443289:0:22738:0:(import.c:65:import_set_state_nolock()) ffff8d664789e800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788684514.443423:0:22738:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d674698d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3622:x1875571085906304:12345-0@lo:38:kworker.0 Request processed in 12148us (12543us total) trans 0 rc 0/0 00000100:00100000:0.0:1788684514.443434:0:22738:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1788684514.443461:0:22738:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1788684514.443470:0:22738:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d677fa81500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3624:x1875571085906816:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1788684514.443497:0:22738:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446309888 avail 1300070400 00000100:00100000:0.0:1788684514.443540:0:22738:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d677fa81500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3624:x1875571085906816:12345-0@lo:41:osp-pre-0-1.0 Request processed in 72us (12409us total) trans 0 rc 0/0 00000100:00100000:0.0:1788684514.443546:0:22738:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00080000:1.0:1788684514.443648:0:3622:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-MDT0001-osp-MDT0000: connect to target with instance 3 00000100:00080000:1.0:1788684514.443658:0:3622:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-MDT0001-osp-MDT0000: Resetting ns_connect_flags to server flags: 0xa2400010450010a0 00000100:00080000:1.0:1788684514.443664:0:3622:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:1.0:1788684514.443666:0:3622:0:(import.c:65:import_set_state_nolock()) ffff8d6775fa3000 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00080000:1.0:1788684514.443688:0:3622:0:(recover.c:191:ptlrpc_wake_delayed()) @@@ waking (set 0000000046a02bb2): req@ffff8d664790b100 x1875571085899008/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 304/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'lod0000_rec0001.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788684514.443728:0:3622:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d677fa83100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3622:1875571085906304:0@lo:38:kworker.0 00000100:00100000:2.0:1788684514.443820:0:3624:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d677fa81c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3624:1875571085906816:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788684514.444055:0:22774:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788684514.444085:0:22774:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d6750acac00 going to sleep for 11 seconds 00000100:00100000:1.0:1788684514.444140:0:22737:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085899008 00000100:00100000:1.0:1788684514.444146:0:22737:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085899008 00000100:00100000:1.0:1788684514.444202:0:22737:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1788684514.444212:0:22737:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d677fb44000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:22774:x1875571085899008:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:1.0:1788684514.444281:0:22737:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d677fb44000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:22774:x1875571085899008:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 72us (226us total) trans 0 rc 0/0 00000100:00100000:1.0:1788684514.444288:0:22737:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1788684514.444350:0:22774:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d664790b100 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:22774:1875571085899008:0@lo:1000:lod0000_rec0001.0 00000040:01000000:2.0:1788684514.444408:0:22774:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000100:00100000:2.0:1788684514.444449:0:22774:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d677fa81c00 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:22774:1875571085906944:0@lo:1000:lod0000_rec0001.0 00000100:00100000:2.0:1788684514.444482:0:22774:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788684514.444493:0:22774:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d6746044480 going to sleep for 11 seconds 00000100:00100000:1.0:1788684514.444541:0:22737:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085906944 00000100:00100000:1.0:1788684514.444546:0:22737:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085906944 00000100:00100000:1.0:1788684514.444563:0:22737:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1788684514.444569:0:22737:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d677fa82300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:22774:x1875571085906944:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:1.0:1788684514.444668:0:22737:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d677fa82300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:22774:x1875571085906944:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 98us (185us total) trans 0 rc 0/0 00000100:00100000:1.0:1788684514.444674:0:22737:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1788684514.444737:0:22774:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d677fa81c00 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:22774:1875571085906944:0@lo:1000:lod0000_rec0001.0 00000100:00100000:2.0:1788684514.444799:0:22774:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d677fa81c00 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:22774:1875571085907072:0@lo:1000:lod0000_rec0001.0 00000100:00100000:2.0:1788684514.444821:0:22774:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788684514.444842:0:22774:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d67460443c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788684514.444941:0:22738:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085907072 00000100:00100000:0.0:1788684514.444946:0:22738:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085907072 00000100:00100000:0.0:1788684514.444964:0:22738:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1788684514.444970:0:22738:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d677fa80e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:22774:x1875571085907072:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:0.0:1788684514.445030:0:22738:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d677fa80e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:22774:x1875571085907072:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 59us (208us total) trans 0 rc 0/0 00000100:00100000:0.0:1788684514.445045:0:22738:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1788684514.445150:0:22774:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d677fa81c00 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:22774:1875571085907072:0@lo:1000:lod0000_rec0001.0 00000040:00080000:2.0:1788684514.445196:0:22774:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788684514.447240:0:22774:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x240000401:0x1:0x0] index 261376 count 1 00000004:00080000:2.0:1788684514.447324:0:22774:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0001-osp-MDT0000 retrieved update log, duration 18, retries 0 00000004:00080000:2.0:1788684514.447328:0:22774:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00000100:00100000:0.0:1788684514.448444:0:3623:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788684514.448462:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6647908380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3623:1875571085907200:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788684514.448524:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788684514.448622:0:22738:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085907200 00000100:00100000:1.0:1788684514.448630:0:22738:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085907200 00000100:00100000:1.0:1788684514.448677:0:22738:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1788684514.448688:0:22738:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d677fb47480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3623:x1875571085907200:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1788684514.448719:0:22738:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:1.0:1788684514.448767:0:22738:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d677fb47480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3623:x1875571085907200:12345-0@lo:41:osp-pre-1-0.0 Request processed in 82us (243us total) trans 0 rc 0/0 00000100:00100000:1.0:1788684514.448774:0:22738:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1788684514.449454:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6647908380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3623:1875571085907200:0@lo:41:osp-pre-1-0.0 00000020:00000004:3.0:1788684514.562956:0:23785:0:(tgt_mount.c:2350:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1788684514.563234:0:23785:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:2.0:1788684515.006206:0:22720:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:3.0:1788684515.358006:0:23835:0:(tgt_mount.c:2350:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1788684515.359126:0:23835:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1788684516.030969:0:22721:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1788684516.371696:0:23883:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffd9e9398a0 20000000:00000080:3.0:1788684516.371713:0:23883:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff8d6647a86800 uarg=0000000000000000 20000000:01000000:3.0:1788684516.371757:0:23883:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:3.0:1788684516.371765:0:23883:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:3.0:1788684516.371770:0:23883:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:3.0:1788684516.375786:0:23884:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 2 count 13 20000000:00000400:0.0:1788684516.376301:0:23883:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/debug_raw_pointers=Y (mode = 0) failed: rc = -17 10000000:01000000:0.0:1788684516.383896:0:23883:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:2.0:1788684516.384090:0:23883:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8d66476d5e00/0x44bac02bd54adec0 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 23883 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684516.384110:0:23883:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8d66479a1400/0x44bac02bd54add69 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x44bac02bd54add62 expref: 17 pid: 22726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684516.384117:0:23883:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8d6746d3fa00/0x44bac02bd54ade6c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x44bac02bd54ade65 expref: 17 pid: 22725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684516.384124:0:23883:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8d66476d5e00/0x44bac02bd54adec0 lrc: 5/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 23883 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684516.384198:0:23883:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8d6746d3fa00/0x44bac02bd54ade6c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x44bac02bd54ade65 expref: 17 pid: 22725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684516.384214:0:23883:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8d6746d3fa00/0x44bac02bd54ade6c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x44bac02bd54ade65 expref: 17 pid: 22725 timeout: 697 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788684516.384228:0:23883:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d677fa81c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:23883:1875571085907328:0@lo:104: 00000100:00100000:2.0:1788684516.384290:0:23883:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788684516.384415:0:23883:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8d66479a1400/0x44bac02bd54add69 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x44bac02bd54add62 expref: 17 pid: 22726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684516.384424:0:23883:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8d66479a1400/0x44bac02bd54add69 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x44bac02bd54add62 expref: 17 pid: 22726 timeout: 697 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788684516.384433:0:23883:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d677fa83100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:23883:1875571085907456:0@lo:104: 00000100:00100000:2.0:1788684516.384455:0:23883:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788684516.384838:0:23883:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d6746044cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1788684516.388171:0:22716:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085907328 00000100:00100000:0.0:1788684516.388185:0:22716:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085907328 00000100:00100000:2.0:1788684516.388292:0:22716:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085907456 00000100:00100000:2.0:1788684516.388296:0:22716:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085907456 00000100:00100000:2.0:1788684516.388320:0:22716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788684516.388330:0:22716:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d677fa82680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:cebd1789-51a4-46ff-b167-6b1633e930a1+4:23883:x1875571085907328:12345-0@lo:104: 00010000:00010000:2.0:1788684516.388349:0:22716:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.144@tcp lock: ffff8d66476d5000/0x44bac02bd54ade65 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x44bac02bd54ade6c expref: -99 pid: 23463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684516.388471:0:22716:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1788684516.388478:0:22716:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d677fa82680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:cebd1789-51a4-46ff-b167-6b1633e930a1+4:23883:x1875571085907328:12345-0@lo:104: Request processed in 150us (4188us total) trans 0 rc 0/0 00000100:00100000:2.0:1788684516.388486:0:22716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788684516.388514:0:22716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788684516.388519:0:22716:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d677fa81180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:cebd1789-51a4-46ff-b167-6b1633e930a1+3:23883:x1875571085907456:12345-0@lo:104: 00010000:00010000:2.0:1788684516.388527:0:22716:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.144@tcp lock: ffff8d66476d5400/0x44bac02bd54add62 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x44bac02bd54add69 expref: -99 pid: 22710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684516.388565:0:22716:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1788684516.388570:0:22716:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d677fa81180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:cebd1789-51a4-46ff-b167-6b1633e930a1+3:23883:x1875571085907456:12345-0@lo:104: Request processed in 52us (4115us total) trans 0 rc 0/0 00000100:00100000:2.0:1788684516.388576:0:22716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788684516.388740:0:23883:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d677fa81c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:23883:1875571085907328:0@lo:104: 00000100:00100000:3.0:1788684516.388749:0:23883:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d677fa83100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:23883:1875571085907456:0@lo:104: 00010000:00010000:3.0:1788684516.388776:0:23883:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8d66476d5e00/0x44bac02bd54adec0 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 23883 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684516.388832:0:22720:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788684516.388840:0:22720:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.144@tcp lock: ffff8d66476d5000/0x44bac02bd54ade65 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x44bac02bd54ade6c expref: -99 pid: 23463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684516.388847:0:22720:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d66476d5000 already unused, calling callback (ffffffffc1297c20) 10000000:00010000:0.0:1788684516.388851:0:22720:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.144@tcp lock: ffff8d66476d5000/0x44bac02bd54ade65 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x44bac02bd54ade6c expref: -99 pid: 23463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684516.388860:0:22720:0:(ldlm_request.c:1390:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.144@tcp lock: ffff8d66476d5000/0x44bac02bd54ade65 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x44bac02bd54ade6c expref: -99 pid: 23463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788684516.388868:0:22720:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.144@tcp lock: ffff8d66476d5000/0x44bac02bd54ade65 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x44bac02bd54ade6c expref: -99 pid: 23463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788684516.388873:0:22720:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1788684516.388917:0:22720:0:(ldlm_request.c:1438:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.144@tcp lock: ffff8d66476d5000/0x44bac02bd54ade65 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x44bac02bd54ade6c expref: -99 pid: 23463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684516.388924:0:22720:0:(ldlm_request.c:1497:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788684516.388952:0:22720:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.144@tcp lock: ffff8d66476d5000/0x44bac02bd54ade65 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x44bac02bd54ade6c expref: -99 pid: 23463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684516.388973:0:22720:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.144@tcp lock: ffff8d66476d5000/0x44bac02bd54ade65 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x44bac02bd54ade6c expref: -99 pid: 23463 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684516.388985:0:22720:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788684516.388988:0:22720:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.144@tcp lock: ffff8d66476d5400/0x44bac02bd54add62 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x44bac02bd54add69 expref: -99 pid: 22710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684516.388994:0:22720:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d66476d5400 already unused, calling callback (ffffffffc1297c20) 10000000:00010000:0.0:1788684516.388997:0:22720:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.144@tcp lock: ffff8d66476d5400/0x44bac02bd54add62 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x44bac02bd54add69 expref: -99 pid: 22710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684516.389004:0:22720:0:(ldlm_request.c:1390:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.144@tcp lock: ffff8d66476d5400/0x44bac02bd54add62 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x44bac02bd54add69 expref: -99 pid: 22710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788684516.389022:0:22720:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.144@tcp lock: ffff8d66476d5400/0x44bac02bd54add62 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x44bac02bd54add69 expref: -99 pid: 22710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788684516.389028:0:22720:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1788684516.389042:0:22720:0:(ldlm_request.c:1438:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.144@tcp lock: ffff8d66476d5400/0x44bac02bd54add62 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x44bac02bd54add69 expref: -99 pid: 22710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684516.389048:0:22720:0:(ldlm_request.c:1497:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788684516.389054:0:22720:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.144@tcp lock: ffff8d66476d5400/0x44bac02bd54add62 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x44bac02bd54add69 expref: -99 pid: 22710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684516.389060:0:22720:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.144@tcp lock: ffff8d66476d5400/0x44bac02bd54add62 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x44bac02bd54add69 expref: -99 pid: 22710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684516.389074:0:22720:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788684516.389081:0:22720:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788684516.389082:0:22720:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788684516.389098:0:3626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d677fb45880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:cebd1789-51a4-46ff-b167-6b1633e930a1:3626:1875571085907712:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788684516.389139:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788684516.389187:0:3626:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788684516.389192:0:3626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d677fb47b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:cebd1789-51a4-46ff-b167-6b1633e930a1:3626:1875571085907584:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788684516.389213:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788684516.389640:0:22719:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085907712 00000100:00100000:0.0:1788684516.389647:0:22719:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085907712 00010000:00010000:0.0:1788684516.389669:0:22719:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8d66479a1400/0x44bac02bd54add69 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x44bac02bd54add62 expref: 18 pid: 22726 timeout: 697 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788684516.389690:0:22719:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085907584 00000100:00100000:0.0:1788684516.389693:0:22719:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085907584 00010000:00010000:0.0:1788684516.389704:0:22719:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8d6746d3fa00/0x44bac02bd54ade6c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x44bac02bd54ade65 expref: 19 pid: 22725 timeout: 697 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788684516.389715:0:22719:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788684516.389722:0:22719:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d677fb44e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:cebd1789-51a4-46ff-b167-6b1633e930a1+19:3626:x1875571085907712:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788684516.389732:0:22719:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788684516.389737:0:22719:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8d66479a1400/0x44bac02bd54add69 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x44bac02bd54add62 expref: 19 pid: 22726 timeout: 697 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684516.389747:0:22719:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8d66479a1400/0x44bac02bd54add69 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x44bac02bd54add62 expref: 19 pid: 22726 timeout: 697 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684516.389760:0:22719:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d66479a1400/0x44bac02bd54add69 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x44bac02bd54add62 expref: 19 pid: 22726 timeout: 697 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684516.389772:0:22719:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788684516.389808:0:22719:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d677fb44e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:cebd1789-51a4-46ff-b167-6b1633e930a1+18:3626:x1875571085907712:12345-0@lo:103:ldlm_bl.0 Request processed in 86us (668us total) trans 0 rc 0/0 00000100:00100000:0.0:1788684516.389815:0:22719:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788684516.389830:0:22719:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788684516.389836:0:22719:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d677fb47100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:cebd1789-51a4-46ff-b167-6b1633e930a1+17:3626:x1875571085907584:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788684516.389843:0:22719:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788684516.389848:0:22719:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8d6746d3fa00/0x44bac02bd54ade6c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x44bac02bd54ade65 expref: 17 pid: 22725 timeout: 697 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684516.389857:0:22719:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8d6746d3fa00/0x44bac02bd54ade6c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x44bac02bd54ade65 expref: 17 pid: 22725 timeout: 697 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684516.389866:0:22719:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d6746d3fa00/0x44bac02bd54ade6c lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x44bac02bd54ade65 expref: 17 pid: 22725 timeout: 697 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684516.389877:0:22719:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8d66476d5e00/0x44bac02bd54adec0 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 23883 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684516.389884:0:22719:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d66476d5e00/0x44bac02bd54adec0 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 23883 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684516.389897:0:22719:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8d66476d5e00/0x44bac02bd54adec0 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 23883 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684516.389903:0:22719:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8d66476d5e00/0x44bac02bd54adec0 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 23883 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684516.389909:0:22719:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8d66476d5e00/0x44bac02bd54adec0 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 23883 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684516.389915:0:22719:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8d66476d5e00/0x44bac02bd54adec0 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 23883 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684516.389927:0:22719:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d66476d5e00 already unused, calling callback (ffffffffc0cae340) 00010000:00010000:0.0:1788684516.389931:0:22719:0:(ldlm_request.c:377:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8d66476d5e00/0x44bac02bd54adec0 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 23883 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684516.389939:0:22719:0:(ldlm_request.c:1415:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8d66476d5e00/0x44bac02bd54adec0 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 23883 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684516.389951:0:22719:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8d66476d5e00/0x44bac02bd54adec0 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 23883 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684516.389960:0:22719:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788684516.389987:0:22719:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d677fb47100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:cebd1789-51a4-46ff-b167-6b1633e930a1+16:3626:x1875571085907584:12345-0@lo:103:ldlm_bl.0 Request processed in 151us (772us total) trans 0 rc 0/0 00000100:00100000:0.0:1788684516.389993:0:22719:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00010000:0.0:1788684516.390025:0:22721:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788684516.390046:0:3626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d677fb47b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:cebd1789-51a4-46ff-b167-6b1633e930a1:3626:1875571085907584:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788684516.390055:0:3626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d677fb45880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:cebd1789-51a4-46ff-b167-6b1633e930a1:3626:1875571085907712:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788684516.390182:0:23883:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8d66476d5e00/0x44bac02bd54adec0 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 23883 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684516.390191:0:23883:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8d66476d5e00/0x44bac02bd54adec0 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 23883 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684516.390197:0:23883:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d66476d5e00/0x44bac02bd54adec0 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 23883 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684517.053608:0:22720:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1788684517.693509:0:22729:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1788684517.693516:0:22729:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8d6647429800 from 13 10000000:01000000:2.0:1788684517.693522:0:22729:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788684517.693574:0:22729:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.144@tcp lock: ffff8d66476d5e00/0x44bac02bd54adec7 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684517.693584:0:22729:0:(ldlm_request.c:1106:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.144@tcp lock: ffff8d66476d5e00/0x44bac02bd54adec7 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684517.693594:0:22729:0:(ldlm_request.c:1193:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.144@tcp lock: ffff8d66476d5e00/0x44bac02bd54adec7 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788684517.693619:0:22729:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d677fa82a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cebd1789-51a4-46ff-b167-6b1633e930a1:22729:1875571085907840:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788684517.693685:0:22729:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788684517.693730:0:22729:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d67461e2a80 going to sleep for 11 seconds 00000100:00100000:0.0:1788684517.697073:0:22725:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085907840 00000100:00100000:0.0:1788684517.697089:0:22725:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085907840 00000100:00100000:0.0:1788684517.697163:0:22725:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1788684517.697174:0:22725:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d677fb5ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cebd1789-51a4-46ff-b167-6b1633e930a1+16:22729:x1875571085907840:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788684517.697191:0:22725:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788684517.697212:0:22725:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d6746d3f600/0x44bac02bd54adece lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x44bac02bd54adec7 expref: -99 pid: 22725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684517.697238:0:22725:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d6746d3f600/0x44bac02bd54adece lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x44bac02bd54adec7 expref: 17 pid: 22725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684517.697262:0:22725:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d6746d3f600/0x44bac02bd54adece lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x44bac02bd54adec7 expref: 17 pid: 22725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684517.697271:0:22725:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d6746d3f600, rc 0) 00000100:00100000:0.0:1788684517.697345:0:22725:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d677fb5ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cebd1789-51a4-46ff-b167-6b1633e930a1+17:22729:x1875571085907840:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 173us (3658us total) trans 0 rc 0/0 00000100:00100000:0.0:1788684517.697352:0:22725:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1788684517.697431:0:22729:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d677fa82a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cebd1789-51a4-46ff-b167-6b1633e930a1:22729:1875571085907840:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788684517.697450:0:22729:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.144@tcp lock: ffff8d66476d5e00/0x44bac02bd54adec7 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x44bac02bd54adece expref: -99 pid: 22729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684517.697460:0:22729:0:(ldlm_request.c:840:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.144@tcp lock: ffff8d66476d5e00/0x44bac02bd54adec7 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x44bac02bd54adece expref: -99 pid: 22729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788684517.697533:0:22729:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d677fb45880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cebd1789-51a4-46ff-b167-6b1633e930a1:22729:1875571085907968:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788684517.697565:0:22729:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788684517.697594:0:22729:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d6750869840 going to sleep for 11 seconds 00000100:00100000:0.0:1788684517.697607:0:22726:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085907968 00000100:00100000:0.0:1788684517.697611:0:22726:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085907968 00000100:00100000:0.0:1788684517.697632:0:22726:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1788684517.697637:0:22726:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d677fb5f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cebd1789-51a4-46ff-b167-6b1633e930a1+17:22729:x1875571085907968:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788684517.697729:0:22726:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d677fb5f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cebd1789-51a4-46ff-b167-6b1633e930a1+17:22729:x1875571085907968:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 92us (163us total) trans 0 rc 0/0 00000100:00100000:0.0:1788684517.697736:0:22726:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1788684517.697764:0:22729:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d677fb45880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cebd1789-51a4-46ff-b167-6b1633e930a1:22729:1875571085907968:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788684517.697795:0:22729:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d677fb45880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cebd1789-51a4-46ff-b167-6b1633e930a1:22729:1875571085908096:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788684517.697844:0:22729:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788684517.697856:0:22729:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d6750869840 going to sleep for 11 seconds 00000100:00100000:0.0:1788684517.697866:0:22726:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085908096 00000100:00100000:0.0:1788684517.697869:0:22726:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085908096 00000100:00100000:0.0:1788684517.697888:0:22726:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1788684517.697893:0:22726:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d677fb5c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cebd1789-51a4-46ff-b167-6b1633e930a1+17:22729:x1875571085908096:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788684517.697964:0:22726:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d677fb5c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cebd1789-51a4-46ff-b167-6b1633e930a1+17:22729:x1875571085908096:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 70us (119us total) trans 0 rc 0/0 00000100:00100000:0.0:1788684517.697971:0:22726:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1788684517.698007:0:22729:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d677fb45880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cebd1789-51a4-46ff-b167-6b1633e930a1:22729:1875571085908096:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1788684517.699003:0:23945:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:0.0:1788684517.699239:0:22729:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:0.0:1788684517.699260:0:22729:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.144@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788684517.699269:0:22729:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.144@tcp lock: ffff8d66476d5e00/0x44bac02bd54adec7 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x44bac02bd54adece expref: -99 pid: 22729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684517.699280:0:22729:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.144@tcp lock: ffff8d66476d5e00/0x44bac02bd54adec7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x44bac02bd54adece expref: -99 pid: 22729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788684517.699290:0:22729:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1788684517.699292:0:22729:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8d677cb59000 from 13 10000000:01000000:0.0:1788684517.699295:0:22729:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788684517.699323:0:22729:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.144@tcp lock: ffff8d6746d3f000/0x44bac02bd54aded5 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684517.699331:0:22729:0:(ldlm_request.c:1106:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.144@tcp lock: ffff8d6746d3f000/0x44bac02bd54aded5 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684517.699351:0:22729:0:(ldlm_request.c:1193:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.144@tcp lock: ffff8d6746d3f000/0x44bac02bd54aded5 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788684517.699395:0:22729:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d677fb45880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cebd1789-51a4-46ff-b167-6b1633e930a1:22729:1875571085908224:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788684517.699443:0:22729:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788684517.699474:0:22729:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d6750869180 going to sleep for 11 seconds 00000100:00100000:1.0:1788684517.699638:0:22726:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085908224 00000100:00100000:1.0:1788684517.699644:0:22726:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085908224 00000100:00100000:1.0:1788684517.699686:0:22726:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1788684517.699696:0:22726:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d677fad8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cebd1789-51a4-46ff-b167-6b1633e930a1+17:22729:x1875571085908224:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788684517.699706:0:22726:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788684517.699719:0:22726:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d6746cb2c00/0x44bac02bd54adedc lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x44bac02bd54aded5 expref: -99 pid: 22726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684517.699738:0:22726:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d6746cb2c00/0x44bac02bd54adedc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x44bac02bd54aded5 expref: 18 pid: 22726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684517.699748:0:22726:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d6746cb2c00/0x44bac02bd54adedc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x44bac02bd54aded5 expref: 18 pid: 22726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684517.699756:0:22726:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d6746cb2c00, rc 0) 00000100:00100000:1.0:1788684517.700025:0:22726:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d677fad8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cebd1789-51a4-46ff-b167-6b1633e930a1+18:22729:x1875571085908224:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 330us (580us total) trans 0 rc 0/0 00000100:00100000:1.0:1788684517.700032:0:22726:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1788684517.700288:0:22729:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d677fb45880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cebd1789-51a4-46ff-b167-6b1633e930a1:22729:1875571085908224:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788684517.700305:0:22729:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.144@tcp lock: ffff8d6746d3f000/0x44bac02bd54aded5 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x44bac02bd54adedc expref: -99 pid: 22729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684517.700315:0:22729:0:(ldlm_request.c:840:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.144@tcp lock: ffff8d6746d3f000/0x44bac02bd54aded5 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x44bac02bd54adedc expref: -99 pid: 22729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788684517.700539:0:22729:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d677fa83800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cebd1789-51a4-46ff-b167-6b1633e930a1:22729:1875571085908352:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788684517.700573:0:22729:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788684517.700605:0:22729:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d67461e2900 going to sleep for 11 seconds 00000100:00100000:1.0:1788684517.700652:0:22727:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085908352 00000100:00100000:1.0:1788684517.700658:0:22727:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085908352 00000100:00100000:1.0:1788684517.700693:0:22727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1788684517.700700:0:22727:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d677fad9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cebd1789-51a4-46ff-b167-6b1633e930a1+18:22729:x1875571085908352:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788684517.700815:0:22727:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d677fad9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cebd1789-51a4-46ff-b167-6b1633e930a1+18:22729:x1875571085908352:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 114us (240us total) trans 0 rc 0/0 00000100:00100000:1.0:1788684517.700822:0:22727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1788684517.700996:0:22729:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d677fa83800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cebd1789-51a4-46ff-b167-6b1633e930a1:22729:1875571085908352:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788684517.701028:0:22729:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6647908380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cebd1789-51a4-46ff-b167-6b1633e930a1:22729:1875571085908480:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788684517.701069:0:22729:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788684517.701091:0:22729:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d674a7c1a80 going to sleep for 11 seconds 00000100:00100000:1.0:1788684517.701152:0:22726:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085908480 00000100:00100000:1.0:1788684517.701157:0:22726:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085908480 00000100:00100000:1.0:1788684517.701184:0:22726:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1788684517.701190:0:22726:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d677fad8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cebd1789-51a4-46ff-b167-6b1633e930a1+18:22729:x1875571085908480:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788684517.701283:0:22726:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d677fad8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cebd1789-51a4-46ff-b167-6b1633e930a1+18:22729:x1875571085908480:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 92us (214us total) trans 0 rc 0/0 00000100:00100000:1.0:1788684517.701289:0:22726:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1788684517.701385:0:22729:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6647908380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cebd1789-51a4-46ff-b167-6b1633e930a1:22729:1875571085908480:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1788684517.702275:0:23946:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:3.0:1788684517.702462:0:22729:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:3.0:1788684517.702481:0:22729:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.144@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788684517.702491:0:22729:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.144@tcp lock: ffff8d6746d3f000/0x44bac02bd54aded5 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x44bac02bd54adedc expref: -99 pid: 22729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684517.702501:0:22729:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.144@tcp lock: ffff8d6746d3f000/0x44bac02bd54aded5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x44bac02bd54adedc expref: -99 pid: 22729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684518.078624:0:22721:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788684518.528502:0:3622:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788684508/real 1788684508] req@ffff8d664790b480 x1875571085902208/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788684518 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788684518.528532:0:3622:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8d664790b480 x1875571085902208/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788684518 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788684518.528543:0:3622:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788684508/real 1788684508] req@ffff8d677fa82d80 x1875571085901952/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788684518 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788684518.528555:0:3622:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8d677fa82d80 x1875571085901952/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788684518 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1788684518.528575:0:3622:0:(import.c:65:import_set_state_nolock()) ffff8d677cc6b000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788684518.528603:0:3622:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:1.0:1788684518.528607:0:3622:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d664790b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3622:1875571085902208:0@lo:8:llog_process_th.0 00000100:00080000:1.0:1788684518.528613:0:3622:0:(import.c:65:import_set_state_nolock()) ffff8d6751b75000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788684518.528617:0:3622:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:1.0:1788684518.528620:0:3622:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d677fa82d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3622:1875571085901952:0@lo:8:llog_process_th.0 00000100:00080000:0.0:1788684518.528836:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788684518.528841:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1788684518.528844:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788684518.528847:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1788684518.528876:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788684518.528879:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:0.0:1788684518.528881:0:36:0:(import.c:65:import_set_state_nolock()) ffff8d6751b75000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788684518.528897:0:36:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 589 00000100:00080000:0.0:1788684518.528903:0:36:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1788684518.528909:0:36:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff8d6751b75000 using connection 192.168.206.144@tcp/0@lo 00000100:00100000:0.0:1788684518.528939:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8d677fb45880 x1875571085909120/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788684518.528953:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788684518.528956:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1788684518.528958:0:36:0:(import.c:65:import_set_state_nolock()) ffff8d677cc6b000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788684518.528961:0:36:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 589 00000100:00080000:0.0:1788684518.528975:0:36:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1788684518.528980:0:36:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff8d677cc6b000 using connection 192.168.206.144@tcp/0@lo 00000100:00100000:0.0:1788684518.528995:0:36:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8d67450b0e00 x1875571085909248/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788684518.529027:0:3624:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d677fb46300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3624:1875571085908736:0@lo:400:kworker.0 00000100:00100000:0.0:1788684518.529088:0:3624:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788684518.529116:0:3624:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:0.0:1788684518.529122:0:3624:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d677fb47b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:cebd1789-51a4-46ff-b167-6b1633e930a1:3624:1875571085908608:0@lo:400:kworker.0 00000100:00100000:0.0:1788684518.529162:0:3624:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788684518.529189:0:3624:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d67450b2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3624:1875571085909376:0@lo:400:kworker.0 00000100:00100000:0.0:1788684518.529211:0:3624:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788684518.529234:0:3626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d677fb45500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3626:1875571085908992:0@lo:400:kworker.0 00000100:00100000:0.0:1788684518.529256:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788684518.529278:0:3626:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788684518.529284:0:3626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d677fb47800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3626:1875571085908864:0@lo:400:kworker.0 00000100:00100000:0.0:1788684518.529307:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788684518.529424:0:22738:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085908736 00000100:00100000:1.0:1788684518.529433:0:22738:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085908736 00000100:00100000:1.0:1788684518.529467:0:22738:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085908992 00000100:00100000:1.0:1788684518.529470:0:22738:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085908992 00000100:00100000:1.0:1788684518.529486:0:22738:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1788684518.529495:0:22738:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67450b0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3624:x1875571085908736:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788684518.529562:0:22738:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67450b0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3624:x1875571085908736:12345-0@lo:400:kworker.0 Request processed in 65us (472us total) trans 0 rc 0/0 00000100:00100000:1.0:1788684518.529578:0:22738:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1788684518.529610:0:22732:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085909376 00000100:00100000:1.0:1788684518.529610:0:22738:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1788684518.529623:0:22738:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67450b2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3626:x1875571085908992:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788684518.529638:0:22732:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085909376 00000100:00100000:3.0:1788684518.530235:0:22732:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085908864 00000100:00100000:3.0:1788684518.530242:0:22732:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085908864 00000100:00100000:3.0:1788684518.530269:0:22732:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788684518.530278:0:22732:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67450b2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3624:x1875571085909376:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788684518.532037:0:22732:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67450b2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3624:x1875571085909376:12345-0@lo:400:kworker.0 Request processed in 1749us (2813us total) trans 0 rc 0/0 00000100:00100000:3.0:1788684518.532053:0:22732:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788684518.532108:0:22732:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788684518.532124:0:22732:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67450b3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3626:x1875571085908864:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788684518.532143:0:22725:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085908608 00000100:00100000:0.0:1788684518.532215:0:22725:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085908608 00000100:00100000:0.0:1788684518.532271:0:22725:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1788684518.532280:0:22725:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d664108c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cebd1789-51a4-46ff-b167-6b1633e930a1+18:3624:x1875571085908608:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788684518.532351:0:22725:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d664108c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cebd1789-51a4-46ff-b167-6b1633e930a1+18:3624:x1875571085908608:12345-0@lo:400:kworker.0 Request processed in 72us (3188us total) trans 0 rc 0/0 00000100:00100000:0.0:1788684518.532358:0:22725:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1788684518.533485:0:3624:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d677fb47b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:cebd1789-51a4-46ff-b167-6b1633e930a1:3624:1875571085908608:0@lo:400:kworker.0 00010000:00080000:0.0:1788684518.533507:0:3624:0:(ldlm_request.c:1670:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8d67450b2a00 x1875571085909376/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788684534 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788684518.533534:0:3624:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d67450b2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3624:1875571085909376:0@lo:400:kworker.0 00000100:00100000:0.0:1788684518.533549:0:3624:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d677fb46300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3624:1875571085908736:0@lo:400:kworker.0 00000100:00100000:0.0:1788684518.533597:0:3622:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d677fb45880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3622:1875571085909120:0@lo:8:kworker.0 00000400:00000100:0.0:1788684518.533639:0:3622:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875571085909120 offset 0 length 520: 4 00000100:00100000:0.0:1788684518.533669:0:3622:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d67450b0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3622:1875571085909248:0@lo:8:kworker.0 00000400:00000100:0.0:1788684518.533688:0:3622:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875571085909248 offset 0 length 520: 4 00000100:00100000:1.0:1788684518.534106:0:22738:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67450b2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3626:x1875571085908992:12345-0@lo:400:kworker.0 Request processed in 4481us (4845us total) trans 0 rc 0/0 00000100:00100000:3.0:1788684518.534291:0:22732:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67450b3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3626:x1875571085908864:12345-0@lo:400:kworker.0 Request processed in 2166us (4974us total) trans 0 rc 0/0 00000100:00100000:3.0:1788684518.534497:0:22732:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788684518.535330:0:22738:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00010000:00080000:1.0:1788684518.535428:0:3626:0:(ldlm_request.c:1670:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8d677fb47800 x1875571085908864/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788684534 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788684518.535442:0:3626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d677fb47800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3626:1875571085908864:0@lo:400:kworker.0 00000100:00100000:1.0:1788684518.535456:0:3626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d677fb45500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3626:1875571085908992:0@lo:400:kworker.0 00000040:00080000:1.0:1788684518.721762:0:22768:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1788684519.104942:0:22720:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788684519.550197:0:3623:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788684519.550215:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6647908380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3623:1875571085909504:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788684519.550281:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788684519.550327:0:22737:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085909504 00000100:00100000:3.0:1788684519.550335:0:22737:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085909504 00000100:00100000:3.0:1788684519.550410:0:22737:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1788684519.550418:0:22737:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6647909f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3623:x1875571085909504:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1788684519.550449:0:22737:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:3.0:1788684519.550507:0:22737:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6647909f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3623:x1875571085909504:12345-0@lo:41:osp-pre-1-0.0 Request processed in 89us (225us total) trans 0 rc 0/0 00000100:00100000:3.0:1788684519.550515:0:22737:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1788684519.550562:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6647908380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3623:1875571085909504:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788684519.552754:0:3626:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788684519.552781:0:3626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6647908380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3626:1875571085909632:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788684519.552980:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788684519.553212:0:22737:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085909632 00000100:00100000:0.0:1788684519.553220:0:22737:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085909632 00000100:00100000:0.0:1788684519.553272:0:22737:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1788684519.553281:0:22737:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67450b2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3626:x1875571085909632:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1788684519.553312:0:22737:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446309888 avail 1300070400 00000100:00100000:0.0:1788684519.553360:0:22737:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67450b2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3626:x1875571085909632:12345-0@lo:41:osp-pre-0-1.0 Request processed in 79us (379us total) trans 0 rc 0/0 00000100:00100000:0.0:1788684519.553386:0:22737:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1788684519.553444:0:3626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6647908380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3626:1875571085909632:0@lo:41:osp-pre-0-1.0 00000001:00100000:2.0:1788684520.074068:0:23464:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00010000:00010000:0.0:1788684520.127605:0:22721:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788684521.152250:0:22720:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1788684521.406132:0:23489:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:0.0:1788684521.597501:0:3622:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788684506/real 1788684506] req@ffff8d674698e680 x1875571085900032/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788684521 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788684521.597540:0:3622:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8d674698e680 x1875571085900032/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788684521 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788684521.597572:0:3622:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788684506/real 1788684506] req@ffff8d674698ed80 x1875571085900160/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788684521 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788684521.597586:0:3622:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8d674698ed80 x1875571085900160/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788684521 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788684521.597607:0:3622:0:(import.c:65:import_set_state_nolock()) ffff8d677fab9000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788684521.597707:0:3622:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:0.0:1788684521.597712:0:3622:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d674698e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3622:1875571085900032:0@lo:8:kworker.0 00000100:00080000:0.0:1788684521.597718:0:3622:0:(import.c:65:import_set_state_nolock()) ffff8d6775fa5800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788684521.603224:0:3622:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:0.0:1788684521.603236:0:3622:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d674698ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3622:1875571085900160:0@lo:8:kworker.0 00000100:00100000:1.0:1788684521.603480:0:3626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d677fa80000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:cebd1789-51a4-46ff-b167-6b1633e930a1:3626:1875571085909760:0@lo:400:kworker.0 00000100:00100000:1.0:1788684521.603545:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1788684521.603639:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788684521.603644:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:2.0:1788684521.603647:0:38:0:(import.c:65:import_set_state_nolock()) ffff8d677fab9000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788684521.603652:0:38:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 587 00000100:00080000:2.0:1788684521.603658:0:38:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:2.0:1788684521.603664:0:38:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff8d677fab9000 using connection 192.168.206.144@tcp/0@lo 00000100:00100000:2.0:1788684521.603684:0:38:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8d677fa83800 x1875571085910016/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788684521.603697:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788684521.603700:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1788684521.603702:0:38:0:(import.c:65:import_set_state_nolock()) ffff8d6775fa5800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788684521.603705:0:38:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 587 00000100:00080000:2.0:1788684521.603707:0:38:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:2.0:1788684521.603711:0:38:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff8d6775fa5800 using connection 192.168.206.144@tcp/0@lo 00000100:00100000:2.0:1788684521.603720:0:38:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8d677fa82a00 x1875571085910144/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788684521.603782:0:3625:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d677fa81c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3625:1875571085910400:0@lo:400:kworker.0 00000100:00100000:0.0:1788684521.603827:0:3625:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788684521.603865:0:22737:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085910400 00000100:00100000:0.0:1788684521.603873:0:22737:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085910400 00000100:00100000:0.0:1788684521.603914:0:22737:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1788684521.603922:0:22737:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67450b3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3625:x1875571085910400:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788684521.605818:0:22727:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085909760 00000100:00100000:3.0:1788684521.605833:0:22727:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085909760 00000100:00100000:3.0:1788684521.605896:0:22727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1788684521.605907:0:22727:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6746d87450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cebd1789-51a4-46ff-b167-6b1633e930a1+18:3626:x1875571085909760:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788684521.606001:0:22727:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6746d87450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cebd1789-51a4-46ff-b167-6b1633e930a1+18:3626:x1875571085909760:12345-0@lo:400:kworker.0 Request processed in 96us (2455us total) trans 0 rc 0/0 00000100:00100000:3.0:1788684521.606009:0:22727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1788684521.606054:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d677fa82d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3623:1875571085909888:0@lo:400:kworker.0 00000100:00100000:3.0:1788684521.606090:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788684521.606097:0:3626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d677fa80000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:cebd1789-51a4-46ff-b167-6b1633e930a1:3626:1875571085909760:0@lo:400:kworker.0 00000100:00100000:3.0:1788684521.606126:0:3623:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788684521.606135:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d677fa83100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3623:1875571085910272:0@lo:400:kworker.0 00000100:00100000:3.0:1788684521.606165:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788684521.606167:0:22738:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 2 min 2 max 116 00000100:00100000:1.0:1788684521.606177:0:22738:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_002' 00000100:00100000:3.0:1788684521.606217:0:22734:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085910272 00000100:00100000:3.0:1788684521.606222:0:22734:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085910272 00000100:00100000:3.0:1788684521.606254:0:22734:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788684521.606262:0:22734:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d664790aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3623:x1875571085910272:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788684521.606286:0:3622:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d677fa83800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3622:1875571085910016:0@lo:8:kworker.0 00000100:00100000:3.0:1788684521.606306:0:22734:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d664790aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3623:x1875571085910272:12345-0@lo:400:kworker.0 Request processed in 44us (141us total) trans 0 rc 0/0 00000100:00100000:3.0:1788684521.606314:0:22734:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000400:00000100:1.0:1788684521.606328:0:3622:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875571085910016 offset 0 length 520: 4 00000100:00100000:0.0:1788684521.606380:0:22737:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67450b3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3625:x1875571085910400:12345-0@lo:400:kworker.0 Request processed in 56us (151us total) trans 0 rc 0/0 00000100:00100000:0.0:1788684521.606392:0:22737:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1788684521.606407:0:22737:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085909888 00000100:00100000:0.0:1788684521.606409:0:22737:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085909888 00000100:00100000:0.0:1788684521.606426:0:22737:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1788684521.606431:0:22737:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6647909880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3623:x1875571085909888:12345-0@lo:400:kworker.0 00010000:00080000:3.0:1788684521.606493:0:3623:0:(ldlm_request.c:1670:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8d677fa83100 x1875571085910272/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788684537 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788684521.606507:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d677fa83100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3623:1875571085910272:0@lo:400:kworker.0 00000100:00100000:1.0:1788684521.606742:0:3622:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d677fa82a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3622:1875571085910144:0@lo:8:kworker.0 00000400:00000100:1.0:1788684521.606769:0:3622:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875571085910144 offset 0 length 520: 4 00000100:00100000:1.0:1788684521.606828:0:3625:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d677fa81c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3625:1875571085910400:0@lo:400:kworker.0 00000100:00080000:2.0:1788684521.608148:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788684521.608168:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1788684521.608172:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788684521.608175:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1788684521.608252:0:3626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d677fa81c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3626:1875571085910528:0@lo:400:kworker.0 00000100:00100000:3.0:1788684521.608307:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788684521.608355:0:22733:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085910528 00000100:00100000:3.0:1788684521.608362:0:22733:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085910528 00000100:00100000:3.0:1788684521.608420:0:22733:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1788684521.608429:0:22733:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d664790ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3626:x1875571085910528:12345-0@lo:400:kworker.0 00000100:00080000:2.0:1788684521.608437:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788684521.608442:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1788684521.608444:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788684521.608447:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1788684521.608482:0:22733:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d664790ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3626:x1875571085910528:12345-0@lo:400:kworker.0 Request processed in 53us (173us total) trans 0 rc 0/0 00000100:00100000:3.0:1788684521.608490:0:22733:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00080000:2.0:1788684521.608511:0:3626:0:(ldlm_request.c:1670:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8d677fa81c00 x1875571085910528/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788684537 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788684521.608525:0:3626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d677fa81c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3626:1875571085910528:0@lo:400:kworker.0 00000100:00100000:0.0:1788684521.612548:0:22737:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6647909880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3623:x1875571085909888:12345-0@lo:400:kworker.0 Request processed in 6106us (6447us total) trans 0 rc 0/0 00000100:00100000:0.0:1788684521.612575:0:22737:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1788684521.612768:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d677fa82d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3623:1875571085909888:0@lo:400:kworker.0 00010000:00010000:1.0:1788684522.174296:0:22721:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1788684522.741476:0:24234:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:3.0:1788684522.741480:0:24234:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/ost1_flakey 00000020:01000004:3.0:1788684522.741482:0:24234:0:(obd_mount.c:929:lmd_print()) options: errors=remount-ro 00000080:01200004:3.0:1788684522.741598:0:24234:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff8d6647988800 00000020:01000004:3.0:1788684522.741612:0:24234:0:(tgt_mount.c:2506:osd_start()) Attempting to start lustre-OST0000, type=osd-ldiskfs, lsifl=200002, mountfl=0 00000020:01000004:3.0:1788684522.741625:0:24234:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-ldiskfs) 00000020:00000080:3.0:1788684522.741638:0:24234:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (ffff8d6746c03380) 00000020:00000080:3.0:1788684522.742298:0:24234:0:(obd_config.c:720:class_attach_name()) OBD: dev 20 attached type osd-ldiskfs with refcount 2 00100000:10000000:0.0:1788684522.815228:0:24234:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:0.0:1788684522.816043:0:24234:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:0.0:1788684522.816564:0:24234:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000003:0x4:0x0] (8/32) registered 00100000:10000000:0.0:1788684522.816789:0:24234:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/32) registered 00100000:10000000:0.0:1788684522.817161:0:24234:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:0.0:1788684522.817390:0:24234:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/32) registered 00100000:10000000:0.0:1788684522.817687:0:24234:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8) registered 00080000:01000000:0.0:1788684522.820819:0:24234:0:(osd_lproc.c:911:osd_procfs_init()) lustre-OST0000: register osd-ldiskfs tunable parameters 00000020:00000080:0.0:1788684522.821228:0:24234:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:0.0:1788684522.821242:0:24234:0:(osd_handler.c:8924:osd_obd_connect()) connect #0 00000020:00000080:0.0:1788684522.821254:0:24234:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x44bac02bd54adeea 00000020:01000004:0.0:1788684522.821261:0:24234:0:(tgt_mount.c:2591:server_fill_super()) Found service lustre-OST0000 on device /dev/mapper/ost1_flakey 00000020:01000004:0.0:1788684522.821283:0:24234:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.206.144@tcp:Set MGC reconnect 1 10000000:01000000:0.0:1788684522.821287:0:24234:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.206.144@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:0.0:1788684522.821294:0:24234:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-OST0000 00000020:01000004:0.0:1788684522.821299:0:24234:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:0.0:1788684522.821310:0:24234:0:(genops.c:413:class_newdev()) Allocate new device OSS (ffff8d67482e4d40) 00000020:00000080:0.0:1788684522.821321:0:24234:0:(obd_config.c:720:class_attach_name()) OBD: dev 21 attached type ost with refcount 2 00000100:00100000:0.0:1788684522.822672:0:24234:0:(service.c:155:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788684522.822827:0:24234:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:0.0:1788684522.822833:0:24234:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:3.0:1788684522.833475:0:24234:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:3.0:1788684522.833495:0:24234:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:3.0:1788684522.837206:0:24234:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:3.0:1788684522.837221:0:24234:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:1.0:1788684522.838823:0:24234:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788684522.840619:0:24234:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:1.0:1788684522.840627:0:24234:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:1.0:1788684522.847456:0:24234:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:1.0:1788684522.847471:0:24234:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00000100:00100000:2.0:1788684522.873259:0:24234:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788684522.873715:0:24234:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:2.0:1788684522.873722:0:24234:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:2.0:1788684522.886997:0:24234:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:2.0:1788684522.887014:0:24234:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:2.0:1788684522.889848:0:24234:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:2.0:1788684522.889868:0:24234:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:2.0:1788684522.896068:0:24234:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788684522.896263:0:24234:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:2.0:1788684522.896271:0:24234:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:2.0:1788684522.897028:0:24234:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:2.0:1788684522.897036:0:24234:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00000100:00100000:2.0:1788684522.934854:0:24234:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788684522.935057:0:24234:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:2.0:1788684522.935064:0:24234:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:2.0:1788684522.937238:0:24234:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:2.0:1788684522.937257:0:24234:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:2.0:1788684522.938987:0:24234:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:2.0:1788684522.939019:0:24234:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/ost1_flakey 10000000:01000000:2.0:1788684522.939025:0:24234:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.206.144@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000040:01000000:3.0:1788684522.958857:0:24234:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.206.144@tcp ctxt 0 is initialized 00000020:01000004:3.0:1788684522.958902:0:24234:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.206.144@tcp, index=0000, flags=0x20002 00000020:01000004:3.0:1788684522.958906:0:24234:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:3.0:1788684522.958909:0:24234:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1788684522.958910:0:24234:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788684522.958911:0:24234:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788684522.958913:0:24234:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788684522.958914:0:24234:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788684522.958915:0:24234:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788684522.958917:0:24234:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788684522.958918:0:24234:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1788684522.958921:0:24234:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020002 00000020:01000004:3.0:1788684522.958923:0:24234:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1788684522.958925:0:24234:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1788684522.958926:0:24234:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788684522.958927:0:24234:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788684522.958928:0:24234:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788684522.958929:0:24234:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788684522.958930:0:24234:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788684522.958931:0:24234:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788684522.958932:0:24234:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1788684522.958957:0:24234:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:3.0:1788684522.958986:0:24234:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d664790a680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cebd1789-51a4-46ff-b167-6b1633e930a1:24234:1875571085910656:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1788684522.959060:0:24234:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788684522.959164:0:24234:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d677e2b6540 going to sleep for 11 seconds 00000100:00100000:1.0:1788684522.959967:0:22726:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085910656 00000100:00100000:1.0:1788684522.959987:0:22726:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085910656 00000100:00100000:1.0:1788684522.960052:0:22726:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1788684522.960062:0:22726:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6746d86850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cebd1789-51a4-46ff-b167-6b1633e930a1+18:24234:x1875571085910656:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1788684522.960272:0:22726:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:1.0:1788684522.960276:0:22726:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0000 is running on 0@lo 20000000:01000000:1.0:1788684522.960280:0:22726:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:1.0:1788684522.960801:0:22726:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6746d86850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cebd1789-51a4-46ff-b167-6b1633e930a1+18:24234:x1875571085910656:12345-0@lo:253:mount.lustre.0 Request processed in 738us (1738us total) trans 0 rc 0/0 00000100:00100000:1.0:1788684522.960811:0:22726:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1788684522.960920:0:24234:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d664790a680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cebd1789-51a4-46ff-b167-6b1633e930a1:24234:1875571085910656:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1788684522.960933:0:24234:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:3.0:1788684522.960936:0:24234:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1788684522.960938:0:24234:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1788684522.960939:0:24234:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788684522.960952:0:24234:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788684522.960953:0:24234:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788684522.960954:0:24234:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788684522.960956:0:24234:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788684522.960957:0:24234:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788684522.960959:0:24234:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:3.0:1788684522.960991:0:24234:0:(tgt_mount.c:101:server_register_mount()) register mount ffff8d6647988800 from lustre-OST0000 10000000:01000000:3.0:1788684522.961019:0:24234:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:3.0:1788684522.961022:0:24234:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:3.0:1788684522.961030:0:24234:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff8d677e3e8000 local copy 00010000:00010000:3.0:1788684522.961040:0:24234:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.144@tcp lock: ffff8d6746d3ea00/0x44bac02bd54adca5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x44bac02bd54adcac expref: -99 pid: 22710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788684522.961696:0:24234:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d664790a680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cebd1789-51a4-46ff-b167-6b1633e930a1:24234:1875571085910784:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788684522.961744:0:24234:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788684522.961777:0:24234:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d677e2b6b40 going to sleep for 11 seconds 00000100:00100000:1.0:1788684522.961966:0:22725:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085910784 00000100:00100000:1.0:1788684522.961984:0:22725:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085910784 00000100:00100000:1.0:1788684522.962033:0:22725:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1788684522.962043:0:22725:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6746d84850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cebd1789-51a4-46ff-b167-6b1633e930a1+18:24234:x1875571085910784:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788684522.962225:0:22725:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6746d84850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cebd1789-51a4-46ff-b167-6b1633e930a1+18:24234:x1875571085910784:12345-0@lo:501:mount.lustre.0 Request processed in 184us (480us total) trans 0 rc -2/-2 00000100:00100000:1.0:1788684522.962233:0:22725:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1788684522.962406:0:24234:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d664790a680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cebd1789-51a4-46ff-b167-6b1633e930a1:24234:1875571085910784:0@lo:501:mount.lustre.0 10000000:01000000:0.0:1788684522.962425:0:24234:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.206.144@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:0.0:1788684522.962447:0:24234:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.206.144@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:0.0:1788684522.962455:0:24234:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.144@tcp lock: ffff8d6746d3ea00/0x44bac02bd54adca5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x44bac02bd54adcac expref: -99 pid: 22710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684522.962482:0:24234:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.144@tcp lock: ffff8d6746d3ea00/0x44bac02bd54adca5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x44bac02bd54adcac expref: -99 pid: 22710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788684522.962512:0:24234:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff8d6647988800 10000000:01000000:0.0:1788684522.962517:0:24234:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:0.0:1788684522.962534:0:24234:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:0.0:1788684522.962538:0:24234:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1788684522.962542:0:24234:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:0.0:1788684522.962545:0:24234:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:0.0:1788684522.962570:0:24234:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.144@tcp lock: ffff8d6746d3fc00/0x44bac02bd54adef8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 24234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684522.962578:0:24234:0:(ldlm_request.c:1106:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.144@tcp lock: ffff8d6746d3fc00/0x44bac02bd54adef8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 24234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684522.962587:0:24234:0:(ldlm_request.c:1193:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.144@tcp lock: ffff8d6746d3fc00/0x44bac02bd54adef8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 24234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788684522.962602:0:24234:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d67450b1180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cebd1789-51a4-46ff-b167-6b1633e930a1:24234:1875571085910912:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1788684522.962634:0:24234:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788684522.962654:0:24234:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d67460446c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788684522.962778:0:22726:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085910912 00000100:00100000:2.0:1788684522.962783:0:22726:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085910912 00000100:00100000:2.0:1788684522.962811:0:22726:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1788684522.962818:0:22726:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6746d84450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cebd1789-51a4-46ff-b167-6b1633e930a1+18:24234:x1875571085910912:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788684522.962826:0:22726:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788684522.962839:0:22726:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d66476d5000/0x44bac02bd54adeff lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x44bac02bd54adef8 expref: -99 pid: 22726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684522.962861:0:22726:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d66476d5000/0x44bac02bd54adeff lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x44bac02bd54adef8 expref: 19 pid: 22726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684522.962870:0:22726:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d66476d5000/0x44bac02bd54adeff lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x44bac02bd54adef8 expref: 19 pid: 22726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684522.962878:0:22726:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d66476d5000, rc 0) 00000100:00100000:2.0:1788684522.962909:0:22726:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6746d84450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cebd1789-51a4-46ff-b167-6b1633e930a1+19:24234:x1875571085910912:12345-0@lo:101:mount.lustre.0 Request processed in 92us (273us total) trans 0 rc 0/0 00000100:00100000:2.0:1788684522.962914:0:22726:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1788684522.962993:0:24234:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d67450b1180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cebd1789-51a4-46ff-b167-6b1633e930a1:24234:1875571085910912:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788684522.963005:0:24234:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.144@tcp lock: ffff8d6746d3fc00/0x44bac02bd54adef8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x44bac02bd54adeff expref: -99 pid: 24234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684522.963014:0:24234:0:(ldlm_request.c:840:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.144@tcp lock: ffff8d6746d3fc00/0x44bac02bd54adef8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x44bac02bd54adeff expref: -99 pid: 24234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788684522.967813:0:24234:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 14 count 14 00000040:00080000:0.0:1788684522.970507:0:24234:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788684522.974711:0:24234:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].1, 224 off8416 00000040:00080000:1.0:1788684522.974771:0:24234:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].2, 128 off8544 00000040:00080000:1.0:1788684522.974788:0:24234:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].3, 112 off8656 00000040:00080000:1.0:1788684522.974801:0:24234:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].4, 224 off8880 00000040:00080000:1.0:1788684522.974815:0:24234:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].5, 224 off9104 00000040:00080000:1.0:1788684522.974827:0:24234:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].6, 80 off9184 00000040:00080000:1.0:1788684522.974856:0:24234:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].7, 224 off9408 00000040:00080000:1.0:1788684522.974868:0:24234:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].8, 224 off9632 00000040:00080000:1.0:1788684522.974881:0:24234:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].9, 80 off9712 00000040:00080000:1.0:1788684522.974893:0:24234:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].10, 224 off9936 00000040:00080000:1.0:1788684522.974905:0:24234:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].11, 224 off10160 00000040:00080000:1.0:1788684522.974919:0:24234:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].12, 120 off10280 00000040:00080000:1.0:1788684522.974943:0:24234:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].13, 224 off10504 00000040:00080000:1.0:1788684522.974947:0:24234:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 13 count 14 00000100:00100000:1.0:1788684522.975073:0:24234:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d674698ea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cebd1789-51a4-46ff-b167-6b1633e930a1:24234:1875571085911040:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788684522.975284:0:24234:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788684522.975392:0:24234:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d6748270900 going to sleep for 11 seconds 00000100:00100000:2.0:1788684522.975739:0:22726:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085911040 00000100:00100000:2.0:1788684522.975747:0:22726:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085911040 00000100:00100000:2.0:1788684522.975833:0:22726:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1788684522.975842:0:22726:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6746d85450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cebd1789-51a4-46ff-b167-6b1633e930a1+19:24234:x1875571085911040:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788684522.976024:0:22726:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6746d85450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cebd1789-51a4-46ff-b167-6b1633e930a1+19:24234:x1875571085911040:12345-0@lo:501:mount.lustre.0 Request processed in 183us (740us total) trans 0 rc 0/0 00000100:00100000:2.0:1788684522.976032:0:22726:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1788684522.976140:0:24234:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d674698ea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cebd1789-51a4-46ff-b167-6b1633e930a1:24234:1875571085911040:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788684522.976191:0:24234:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d674698ea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cebd1789-51a4-46ff-b167-6b1633e930a1:24234:1875571085911168:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788684522.976234:0:24234:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788684522.976609:0:24234:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d6748270900 going to sleep for 11 seconds 00000100:00100000:0.0:1788684522.976755:0:22725:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085911168 00000100:00100000:0.0:1788684522.976761:0:22725:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085911168 00000100:00100000:0.0:1788684522.976791:0:22725:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1788684522.976799:0:22725:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6746d86c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cebd1789-51a4-46ff-b167-6b1633e930a1+19:24234:x1875571085911168:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788684522.979970:0:22725:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6746d86c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cebd1789-51a4-46ff-b167-6b1633e930a1+19:24234:x1875571085911168:12345-0@lo:503:mount.lustre.0 Request processed in 3163us (3727us total) trans 0 rc 0/0 00000100:00100000:1.0:1788684522.980102:0:24234:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d674698ea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cebd1789-51a4-46ff-b167-6b1633e930a1:24234:1875571085911168:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1788684522.980611:0:24234:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1788684522.980718:0:24234:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d674698ea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cebd1789-51a4-46ff-b167-6b1633e930a1:24234:1875571085911296:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788684522.980769:0:24234:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788684522.980795:0:24234:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d6748270900 going to sleep for 11 seconds 00000100:00100000:0.0:1788684522.981136:0:22725:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1788684522.981189:0:22725:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085911296 00000100:00100000:0.0:1788684522.981197:0:22725:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085911296 00000100:00100000:0.0:1788684522.981226:0:22725:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1788684522.981234:0:22725:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6746d85050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cebd1789-51a4-46ff-b167-6b1633e930a1+19:24234:x1875571085911296:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788684522.981955:0:22725:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6746d85050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cebd1789-51a4-46ff-b167-6b1633e930a1+19:24234:x1875571085911296:12345-0@lo:502:mount.lustre.0 Request processed in 718us (1182us total) trans 0 rc 0/0 00000100:00100000:0.0:1788684522.981964:0:22725:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1788684522.982069:0:24234:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d674698ea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cebd1789-51a4-46ff-b167-6b1633e930a1:24234:1875571085911296:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1788684522.982311:0:24234:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].1, 224 off8416 00000040:00080000:1.0:1788684522.982341:0:24234:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].2, 128 off8544 00000040:00080000:1.0:1788684522.982353:0:24234:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].3, 112 off8656 00000040:00080000:1.0:1788684522.982386:0:24234:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].4, 224 off8880 00000040:00080000:1.0:1788684522.982404:0:24234:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].5, 224 off9104 00000040:00080000:1.0:1788684522.982417:0:24234:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].6, 80 off9184 00000040:00080000:1.0:1788684522.982440:0:24234:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].7, 224 off9408 00000040:00080000:1.0:1788684522.982453:0:24234:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].8, 224 off9632 00000040:00080000:1.0:1788684522.982465:0:24234:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].9, 80 off9712 00000040:00080000:1.0:1788684522.982477:0:24234:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].10, 224 off9936 00000040:00080000:1.0:1788684522.982489:0:24234:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].11, 224 off10160 00000040:00080000:1.0:1788684522.982502:0:24234:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].12, 120 off10280 00000100:00100000:1.0:1788684522.982718:0:24234:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d674698ea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cebd1789-51a4-46ff-b167-6b1633e930a1:24234:1875571085911424:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788684522.982772:0:24234:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788684522.982798:0:24234:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d6748270900 going to sleep for 11 seconds 00000100:00100000:0.0:1788684522.982885:0:22725:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085911424 00000100:00100000:0.0:1788684522.982891:0:22725:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085911424 00000100:00100000:0.0:1788684522.982919:0:22725:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1788684522.982927:0:22725:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6746d86450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cebd1789-51a4-46ff-b167-6b1633e930a1+19:24234:x1875571085911424:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788684522.983172:0:22725:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6746d86450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cebd1789-51a4-46ff-b167-6b1633e930a1+19:24234:x1875571085911424:12345-0@lo:502:mount.lustre.0 Request processed in 244us (398us total) trans 0 rc 0/0 00000100:00100000:0.0:1788684522.983336:0:22725:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1788684522.983458:0:24234:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d674698ea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cebd1789-51a4-46ff-b167-6b1633e930a1:24234:1875571085911424:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1788684522.983516:0:24234:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].13, 224 off10504 00000040:00080000:1.0:1788684522.983597:0:24234:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 13 count 14 00000020:01000000:1.0:1788684522.985419:0:24251:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1788684522.985431:0:24251:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/ost1_flakey 00000020:00000080:1.0:1788684522.985437:0:24251:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788684522.985439:0:24251:0:(obd_config.c:1563:class_process_config()) marker 21 (0x1) lustre-OST0000 add ost 00000020:00000080:1.0:1788684522.985444:0:24251:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1788684522.985459:0:24251:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (ffff8d677e3e99c0) 00000020:00000080:1.0:1788684522.985484:0:24251:0:(obd_config.c:720:class_attach_name()) OBD: dev 22 attached type obdfilter with refcount 2 00000020:00000080:1.0:1788684522.985490:0:24251:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:1.0:1788684522.985735:0:24251:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8d6647988800 from lustre-OST0000, refs=2 00080000:01000000:1.0:1788684522.985744:0:24251:0:(osd_handler.c:8924:osd_obd_connect()) connect #1 00000020:00000080:1.0:1788684522.985751:0:24251:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x44bac02bd54adf0d 00010000:00010000:1.0:1788684522.992342:0:24251:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-3 is initialized 00000001:00000004:1.0:1788684522.992844:0:24251:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 3, last_transno is 8589934594 00080000:10000000:1.0:1788684522.994287:0:24251:0:(osd_handler.c:5580:osd_index_try()) lustre-OST0000: index object [0x200000003:0xb:0x0] (8/32) registered 00000020:00000080:1.0:1788684522.995963:0:24251:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:1.0:1788684522.995990:0:24251:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788684522.995997:0:24251:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788684522.996000:0:24251:0:(obd_config.c:1563:class_process_config()) marker 21 (0x2) lustre-OST0000 add ost 00000020:01000000:1.0:1788684522.996004:0:24251:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:1.0:1788684522.996012:0:24251:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #27 00000020:01000000:1.0:1788684522.996014:0:24251:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1788684522.996016:0:24251:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1788684522.996018:0:24251:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:1.0:1788684522.996021:0:24251:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788684522.996022:0:24251:0:(obd_config.c:1563:class_process_config()) marker 27 (0x6) lustre sys.timeout 00000020:01000000:1.0:1788684522.996025:0:24251:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788684522.996028:0:24251:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788684522.996029:0:24251:0:(obd_config.c:1563:class_process_config()) marker 35 (0x1) lustre sys.timeout 00000020:00000080:1.0:1788684522.996032:0:24251:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1788684522.996034:0:24251:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:1.0:1788684522.996037:0:24251:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788684522.996039:0:24251:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788684522.996040:0:24251:0:(obd_config.c:1563:class_process_config()) marker 35 (0x2) lustre sys.timeout 00000020:01000000:1.0:1788684522.996042:0:24251:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788684522.996045:0:24251:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788684522.996046:0:24251:0:(obd_config.c:1563:class_process_config()) marker 40 (0x1) lustre sys.jobid_var 00000020:00000080:1.0:1788684522.996049:0:24251:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:1.0:1788684522.996077:0:24251:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788684522.996080:0:24251:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788684522.996082:0:24251:0:(obd_config.c:1563:class_process_config()) marker 40 (0x2) lustre sys.jobid_var 00000040:00080000:1.0:1788684522.996085:0:24251:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xc:0x0] index 14 count 14 00000020:01000000:2.0:1788684522.996337:0:24234:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-13 (rc=0) 10000000:01000000:2.0:1788684522.996398:0:24234:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.144@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:2.0:1788684522.996421:0:24234:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.144@tcp lock: ffff8d6746d3fc00/0x44bac02bd54adef8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x44bac02bd54adeff expref: -99 pid: 24234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684522.996434:0:24234:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.144@tcp lock: ffff8d6746d3fc00/0x44bac02bd54adef8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x44bac02bd54adeff expref: -99 pid: 24234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788684522.996441:0:24234:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8d6647988800 from 1 10000000:01000000:2.0:1788684522.996444:0:24234:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788684522.996481:0:24234:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.144@tcp lock: ffff8d66476d5c00/0x44bac02bd54adf14 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 24234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684522.996490:0:24234:0:(ldlm_request.c:1106:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.144@tcp lock: ffff8d66476d5c00/0x44bac02bd54adf14 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 24234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684522.996499:0:24234:0:(ldlm_request.c:1193:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.144@tcp lock: ffff8d66476d5c00/0x44bac02bd54adf14 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 24234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788684522.996523:0:24234:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d677fa81c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cebd1789-51a4-46ff-b167-6b1633e930a1:24234:1875571085911552:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1788684522.996588:0:24234:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788684522.996628:0:24234:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d674890bc00 going to sleep for 11 seconds 00000100:00100000:1.0:1788684522.996825:0:22725:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085911552 00000100:00100000:1.0:1788684522.996833:0:22725:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085911552 00000100:00100000:1.0:1788684522.996878:0:22725:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1788684522.996888:0:22725:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6746d87050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cebd1789-51a4-46ff-b167-6b1633e930a1+19:24234:x1875571085911552:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788684522.996900:0:22725:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788684522.996913:0:22725:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d6746cb2a00/0x44bac02bd54adf1b lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x44bac02bd54adf14 expref: -99 pid: 22725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684522.996935:0:22725:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d6746cb2a00/0x44bac02bd54adf1b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x44bac02bd54adf14 expref: 20 pid: 22725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684522.996945:0:22725:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d6746cb2a00/0x44bac02bd54adf1b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x44bac02bd54adf14 expref: 20 pid: 22725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684522.996961:0:22725:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d6746cb2a00, rc 0) 00000100:00100000:1.0:1788684522.997069:0:22725:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6746d87050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cebd1789-51a4-46ff-b167-6b1633e930a1+20:24234:x1875571085911552:12345-0@lo:101:mount.lustre.0 Request processed in 182us (480us total) trans 0 rc 0/0 00000100:00100000:1.0:1788684522.997077:0:22725:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1788684522.998550:0:24234:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d677fa81c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cebd1789-51a4-46ff-b167-6b1633e930a1:24234:1875571085911552:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788684522.998577:0:24234:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.144@tcp lock: ffff8d66476d5c00/0x44bac02bd54adf14 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x44bac02bd54adf1b expref: -99 pid: 24234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684522.998588:0:24234:0:(ldlm_request.c:840:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.144@tcp lock: ffff8d66476d5c00/0x44bac02bd54adf14 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x44bac02bd54adf1b expref: -99 pid: 24234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788684523.008175:0:24234:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 13 count 13 00000040:00080000:3.0:1788684523.008510:0:24234:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788684523.008736:0:24234:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].1, 224 off8416 00000040:00080000:3.0:1788684523.008759:0:24234:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].2, 112 off8528 00000040:00080000:3.0:1788684523.008770:0:24234:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].3, 224 off8752 00000040:00080000:3.0:1788684523.008781:0:24234:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].4, 224 off8976 00000040:00080000:3.0:1788684523.008792:0:24234:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].5, 112 off9088 00000040:00080000:3.0:1788684523.008803:0:24234:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].6, 224 off9312 00000040:00080000:3.0:1788684523.008814:0:24234:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].7, 224 off9536 00000040:00080000:3.0:1788684523.008832:0:24234:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].8, 128 off9664 00000040:00080000:3.0:1788684523.008843:0:24234:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].9, 224 off9888 00000040:00080000:3.0:1788684523.008853:0:24234:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].10, 224 off10112 00000040:00080000:3.0:1788684523.008864:0:24234:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].11, 128 off10240 00000040:00080000:3.0:1788684523.008878:0:24234:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].12, 224 off10464 00000040:00080000:3.0:1788684523.008882:0:24234:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 12 count 13 00000100:00100000:3.0:1788684523.008947:0:24234:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6647909180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cebd1789-51a4-46ff-b167-6b1633e930a1:24234:1875571085911680:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788684523.013234:0:24234:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788684523.013322:0:24234:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d677e2b6b40 going to sleep for 11 seconds 00000100:00100000:3.0:1788684523.013516:0:22727:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085911680 00000100:00100000:3.0:1788684523.013525:0:22727:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085911680 00000100:00100000:2.0:1788684523.013647:0:22727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1788684523.013657:0:22727:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6746d84050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cebd1789-51a4-46ff-b167-6b1633e930a1+20:24234:x1875571085911680:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788684523.013795:0:22727:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6746d84050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cebd1789-51a4-46ff-b167-6b1633e930a1+20:24234:x1875571085911680:12345-0@lo:501:mount.lustre.0 Request processed in 139us (613us total) trans 0 rc 0/0 00000100:00100000:2.0:1788684523.013803:0:22727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1788684523.013889:0:24234:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6647909180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cebd1789-51a4-46ff-b167-6b1633e930a1:24234:1875571085911680:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788684523.013933:0:24234:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6647909180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cebd1789-51a4-46ff-b167-6b1633e930a1:24234:1875571085911808:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788684523.013972:0:24234:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788684523.014057:0:24234:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d677e2b6b40 going to sleep for 11 seconds 00000100:00100000:1.0:1788684523.014140:0:22725:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085911808 00000100:00100000:1.0:1788684523.014145:0:22725:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085911808 00000100:00100000:1.0:1788684523.014167:0:22725:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1788684523.014173:0:22725:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6746d84c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cebd1789-51a4-46ff-b167-6b1633e930a1+20:24234:x1875571085911808:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788684523.014282:0:22725:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6746d84c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cebd1789-51a4-46ff-b167-6b1633e930a1+20:24234:x1875571085911808:12345-0@lo:503:mount.lustre.0 Request processed in 108us (308us total) trans 0 rc 0/0 00000100:00100000:1.0:1788684523.014288:0:22725:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1788684523.014563:0:24234:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6647909180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cebd1789-51a4-46ff-b167-6b1633e930a1:24234:1875571085911808:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1788684523.014942:0:24234:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1788684523.015036:0:24234:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6647909180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cebd1789-51a4-46ff-b167-6b1633e930a1:24234:1875571085911936:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788684523.015086:0:24234:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788684523.015140:0:24234:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d677e2b6240 going to sleep for 11 seconds 00000100:00100000:1.0:1788684523.015783:0:22725:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085911936 00000100:00100000:1.0:1788684523.015790:0:22725:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085911936 00000100:00100000:1.0:1788684523.015823:0:22725:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1788684523.015831:0:22725:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6746d87850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cebd1789-51a4-46ff-b167-6b1633e930a1+20:24234:x1875571085911936:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788684523.015933:0:22725:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6746d87850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cebd1789-51a4-46ff-b167-6b1633e930a1+20:24234:x1875571085911936:12345-0@lo:502:mount.lustre.0 Request processed in 102us (846us total) trans 0 rc 0/0 00000100:00100000:1.0:1788684523.015941:0:22725:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1788684523.016022:0:24234:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6647909180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cebd1789-51a4-46ff-b167-6b1633e930a1:24234:1875571085911936:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1788684523.016233:0:24234:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].1, 224 off8416 00000040:00080000:3.0:1788684523.016258:0:24234:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].2, 112 off8528 00000040:00080000:3.0:1788684523.016269:0:24234:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].3, 224 off8752 00000040:00080000:3.0:1788684523.016280:0:24234:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].4, 224 off8976 00000040:00080000:3.0:1788684523.016291:0:24234:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].5, 112 off9088 00000040:00080000:3.0:1788684523.016302:0:24234:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].6, 224 off9312 00000040:00080000:3.0:1788684523.016313:0:24234:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].7, 224 off9536 00000040:00080000:3.0:1788684523.016324:0:24234:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].8, 128 off9664 00000040:00080000:3.0:1788684523.016344:0:24234:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].9, 224 off9888 00000040:00080000:3.0:1788684523.016355:0:24234:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].10, 224 off10112 00000040:00080000:3.0:1788684523.016402:0:24234:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].11, 128 off10240 00000100:00100000:3.0:1788684523.016430:0:24234:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6647909180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cebd1789-51a4-46ff-b167-6b1633e930a1:24234:1875571085912064:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788684523.016469:0:24234:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788684523.016494:0:24234:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d677e2b6240 going to sleep for 11 seconds 00000100:00100000:1.0:1788684523.016732:0:22725:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085912064 00000100:00100000:1.0:1788684523.016737:0:22725:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085912064 00000100:00100000:1.0:1788684523.016762:0:22725:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1788684523.016768:0:22725:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d677ccdd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cebd1789-51a4-46ff-b167-6b1633e930a1+20:24234:x1875571085912064:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788684523.016853:0:22725:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d677ccdd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cebd1789-51a4-46ff-b167-6b1633e930a1+20:24234:x1875571085912064:12345-0@lo:502:mount.lustre.0 Request processed in 84us (382us total) trans 0 rc 0/0 00000100:00100000:1.0:1788684523.016859:0:22725:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:3.0:1788684523.016937:0:24234:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6647909180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cebd1789-51a4-46ff-b167-6b1633e930a1:24234:1875571085912064:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1788684523.016978:0:24234:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].12, 224 off10464 00000040:00080000:3.0:1788684523.016986:0:24234:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 12 count 13 00000020:01000000:0.0:1788684523.017954:0:24255:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788684523.017964:0:24255:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788684523.017972:0:24255:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:0.0:1788684523.017979:0:24255:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8d6647988800 00000020:00000080:0.0:1788684523.017982:0:24255:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1788684523.017989:0:24255:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788684523.017992:0:24255:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788684523.017993:0:24255:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:0.0:1788684523.017996:0:24255:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788684523.017998:0:24255:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788684523.017999:0:24255:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:0.0:1788684523.018002:0:24255:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8d6647988800 00000020:00000080:0.0:1788684523.018004:0:24255:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1788684523.019016:0:24255:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788684523.019025:0:24255:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788684523.019027:0:24255:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:0.0:1788684523.019030:0:24255:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788684523.019033:0:24255:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788684523.019035:0:24255:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1788684523.019039:0:24255:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8d6647988800 00000020:00000080:0.0:1788684523.019041:0:24255:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1788684523.028298:0:24255:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788684523.028312:0:24255:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788684523.028314:0:24255:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1788684523.028319:0:24255:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788684523.028323:0:24255:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788684523.028324:0:24255:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:0.0:1788684523.028329:0:24255:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8d6647988800 00000020:00000080:0.0:1788684523.028331:0:24255:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1788684523.028406:0:24255:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788684523.028411:0:24255:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788684523.028412:0:24255:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:0.0:1788684523.028415:0:24255:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xe:0x0] index 13 count 13 00000020:01000000:3.0:1788684523.028635:0:24234:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:3.0:1788684523.028663:0:24234:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.144@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788684523.028692:0:24234:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.144@tcp lock: ffff8d66476d5c00/0x44bac02bd54adf14 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x44bac02bd54adf1b expref: -99 pid: 24234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684523.028703:0:24234:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.144@tcp lock: ffff8d66476d5c00/0x44bac02bd54adf14 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x44bac02bd54adf1b expref: -99 pid: 24234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788684523.028753:0:24234:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:3.0:1788684523.028756:0:24234:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff8d6647988800 10000000:01000000:3.0:1788684523.028759:0:24234:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff8d6647988800 10000000:01000000:3.0:1788684523.028763:0:24234:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1788684523.028769:0:24234:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8d6647988800 from 1 10000000:01000000:3.0:1788684523.028772:0:24234:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1788684523.028811:0:24234:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.144@tcp lock: ffff8d66479a0200/0x44bac02bd54adf22 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 24234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684523.028821:0:24234:0:(ldlm_request.c:1106:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.144@tcp lock: ffff8d66479a0200/0x44bac02bd54adf22 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 24234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684523.028832:0:24234:0:(ldlm_request.c:1193:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.144@tcp lock: ffff8d66479a0200/0x44bac02bd54adf22 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 24234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788684523.028865:0:24234:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6647909180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cebd1789-51a4-46ff-b167-6b1633e930a1:24234:1875571085912192:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788684523.028935:0:24234:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788684523.028983:0:24234:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d67482056c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788684523.029187:0:22725:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085912192 00000100:00100000:1.0:1788684523.029196:0:22725:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085912192 00000100:00100000:1.0:1788684523.029246:0:22725:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:1.0:1788684523.029255:0:22725:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d677ccde450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cebd1789-51a4-46ff-b167-6b1633e930a1+20:24234:x1875571085912192:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788684523.029269:0:22725:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788684523.029282:0:22725:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d6746cb3a00/0x44bac02bd54adf29 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x44bac02bd54adf22 expref: -99 pid: 22725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684523.029304:0:22725:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d6746cb3a00/0x44bac02bd54adf29 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x44bac02bd54adf22 expref: 21 pid: 22725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684523.029315:0:22725:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d6746cb3a00/0x44bac02bd54adf29 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x44bac02bd54adf22 expref: 21 pid: 22725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684523.029324:0:22725:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d6746cb3a00, rc 0) 00000100:00100000:1.0:1788684523.029396:0:22725:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d677ccde450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cebd1789-51a4-46ff-b167-6b1633e930a1+21:24234:x1875571085912192:12345-0@lo:101:mount.lustre.0 Request processed in 141us (460us total) trans 0 rc 0/0 00000100:00100000:1.0:1788684523.029402:0:22725:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:0.0:1788684523.032281:0:24234:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6647909180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cebd1789-51a4-46ff-b167-6b1633e930a1:24234:1875571085912192:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788684523.032312:0:24234:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.144@tcp lock: ffff8d66479a0200/0x44bac02bd54adf22 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x44bac02bd54adf29 expref: -99 pid: 24234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684523.032333:0:24234:0:(ldlm_request.c:840:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.144@tcp lock: ffff8d66479a0200/0x44bac02bd54adf22 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x44bac02bd54adf29 expref: -99 pid: 24234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788684523.033828:0:24234:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 52 count 51 00000040:00080000:0.0:1788684523.034086:0:24234:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788684523.036326:0:24234:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].1, 224 off8416 00000040:00080000:0.0:1788684523.036509:0:24234:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].2, 120 off8536 00000040:00080000:0.0:1788684523.036542:0:24234:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].3, 168 off8704 00000040:00080000:0.0:1788684523.036562:0:24234:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].4, 224 off8928 00000040:00080000:0.0:1788684523.036591:0:24234:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].5, 224 off9152 00000040:00080000:0.0:1788684523.036607:0:24234:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].6, 120 off9272 00000040:00080000:0.0:1788684523.036621:0:24234:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].7, 168 off9440 00000040:00080000:0.0:1788684523.036636:0:24234:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].8, 224 off9664 00000040:00080000:0.0:1788684523.036650:0:24234:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].9, 224 off9888 00000040:00080000:0.0:1788684523.036663:0:24234:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].10, 120 off10008 00000040:00080000:0.0:1788684523.036677:0:24234:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].11, 224 off10232 00000040:00080000:0.0:1788684523.036690:0:24234:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].12, 224 off10456 00000040:00080000:0.0:1788684523.036704:0:24234:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].13, 88 off10544 00000040:00080000:0.0:1788684523.036716:0:24234:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].14, 128 off10672 00000040:00080000:0.0:1788684523.036727:0:24234:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].15, 144 off10816 00000040:00080000:0.0:1788684523.036740:0:24234:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].16, 160 off10976 00000040:00080000:0.0:1788684523.036753:0:24234:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].17, 224 off11200 00000040:00080000:0.0:1788684523.036767:0:24234:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].18, 224 off11424 00000040:00080000:0.0:1788684523.036780:0:24234:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].19, 80 off11504 00000040:00080000:0.0:1788684523.036791:0:24234:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].20, 224 off11728 00000040:00080000:0.0:1788684523.036817:0:24234:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].21, 224 off11952 00000040:00080000:0.0:1788684523.036831:0:24234:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].22, 88 off12040 00000040:00080000:0.0:1788684523.036842:0:24234:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].23, 128 off12168 00000040:00080000:0.0:1788684523.036855:0:24234:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].24, 144 off12312 00000040:00080000:0.0:1788684523.036866:0:24234:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].25, 160 off12472 00000040:00080000:0.0:1788684523.036878:0:24234:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].26, 224 off12696 00000040:00080000:0.0:1788684523.036902:0:24234:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].27, 224 off12920 00000040:00080000:0.0:1788684523.042610:0:24234:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].28, 80 off13000 00000040:00080000:0.0:1788684523.042665:0:24234:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].29, 224 off13224 00000040:00080000:0.0:1788684523.042683:0:24234:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].30, 224 off13448 00000040:00080000:0.0:1788684523.042697:0:24234:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].31, 88 off13536 00000040:00080000:0.0:1788684523.042709:0:24234:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].32, 128 off13664 00000040:00080000:0.0:1788684523.042721:0:24234:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].33, 144 off13808 00000040:00080000:0.0:1788684523.042734:0:24234:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].34, 128 off13936 00000040:00080000:0.0:1788684523.042747:0:24234:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].35, 224 off14160 00000040:00080000:0.0:1788684523.042761:0:24234:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].36, 224 off14384 00000040:00080000:0.0:1788684523.042793:0:24234:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].37, 80 off14464 00000040:00080000:0.0:1788684523.042809:0:24234:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].38, 224 off14688 00000040:00080000:0.0:1788684523.042821:0:24234:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].39, 224 off14912 00000040:00080000:0.0:1788684523.042834:0:24234:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].40, 88 off15000 00000040:00080000:0.0:1788684523.042848:0:24234:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].41, 128 off15128 00000040:00080000:0.0:1788684523.042862:0:24234:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].42, 144 off15272 00000040:00080000:0.0:1788684523.042877:0:24234:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].43, 128 off15400 00000040:00080000:0.0:1788684523.042889:0:24234:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].44, 224 off15624 00000040:00080000:0.0:1788684523.042900:0:24234:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].45, 224 off15848 00000040:00080000:0.0:1788684523.042910:0:24234:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].46, 80 off15928 00000040:00080000:0.0:1788684523.042920:0:24234:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].47, 224 off16152 00000040:00080000:0.0:1788684523.042931:0:24234:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].48, 232 off16384 00000040:00080000:0.0:1788684523.043088:0:24234:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].49, 224 off16608 00000040:00080000:0.0:1788684523.043129:0:24234:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].50, 120 off16728 00000040:00080000:0.0:1788684523.043148:0:24234:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].51, 224 off16952 00000040:00080000:0.0:1788684523.043154:0:24234:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 51 count 51 00000100:00100000:0.0:1788684523.043271:0:24234:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d67450b1180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cebd1789-51a4-46ff-b167-6b1633e930a1:24234:1875571085912320:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788684523.043332:0:24234:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788684523.043403:0:24234:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d664646f840 going to sleep for 11 seconds 00000100:00100000:1.0:1788684523.043706:0:22726:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085912320 00000100:00100000:1.0:1788684523.043715:0:22726:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085912320 00000100:00100000:1.0:1788684523.043769:0:22726:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:1.0:1788684523.043780:0:22726:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6746d86050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cebd1789-51a4-46ff-b167-6b1633e930a1+21:24234:x1875571085912320:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788684523.043904:0:22726:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6746d86050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cebd1789-51a4-46ff-b167-6b1633e930a1+21:24234:x1875571085912320:12345-0@lo:501:mount.lustre.0 Request processed in 125us (570us total) trans 0 rc 0/0 00000100:00100000:1.0:1788684523.043912:0:22726:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:0.0:1788684523.045625:0:24234:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d67450b1180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cebd1789-51a4-46ff-b167-6b1633e930a1:24234:1875571085912320:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788684523.045683:0:24234:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d67450b1180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cebd1789-51a4-46ff-b167-6b1633e930a1:24234:1875571085912448:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788684523.045760:0:24234:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788684523.050684:0:24234:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d664646f840 going to sleep for 11 seconds 00000100:00100000:3.0:1788684523.050811:0:22727:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085912448 00000100:00100000:3.0:1788684523.050821:0:22727:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085912448 00000100:00100000:3.0:1788684523.050921:0:22727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:3.0:1788684523.050931:0:22727:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d677ccddc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cebd1789-51a4-46ff-b167-6b1633e930a1+21:24234:x1875571085912448:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788684523.051078:0:22727:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d677ccddc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cebd1789-51a4-46ff-b167-6b1633e930a1+21:24234:x1875571085912448:12345-0@lo:503:mount.lustre.0 Request processed in 148us (5318us total) trans 0 rc 0/0 00000100:00100000:3.0:1788684523.051085:0:22727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:0.0:1788684523.051180:0:24234:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d67450b1180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cebd1789-51a4-46ff-b167-6b1633e930a1:24234:1875571085912448:0@lo:503:mount.lustre.0 00000040:00080000:0.0:1788684523.051612:0:24234:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1788684523.051714:0:24234:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d67450b1180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cebd1789-51a4-46ff-b167-6b1633e930a1:24234:1875571085912576:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788684523.051765:0:24234:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788684523.052197:0:24234:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d664646f000 going to sleep for 11 seconds 00000100:00100000:1.0:1788684523.052229:0:22726:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085912576 00000100:00100000:1.0:1788684523.052235:0:22726:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085912576 00000100:00100000:1.0:1788684523.052267:0:22726:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:1.0:1788684523.052275:0:22726:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d677ccdf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cebd1789-51a4-46ff-b167-6b1633e930a1+21:24234:x1875571085912576:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788684523.052422:0:22726:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d677ccdf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cebd1789-51a4-46ff-b167-6b1633e930a1+21:24234:x1875571085912576:12345-0@lo:502:mount.lustre.0 Request processed in 147us (656us total) trans 0 rc 0/0 00000100:00100000:1.0:1788684523.052429:0:22726:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:0.0:1788684523.052541:0:24234:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d67450b1180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cebd1789-51a4-46ff-b167-6b1633e930a1:24234:1875571085912576:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1788684523.052738:0:24234:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].1, 224 off8416 00000040:00080000:0.0:1788684523.052767:0:24234:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].2, 120 off8536 00000040:00080000:0.0:1788684523.052783:0:24234:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].3, 168 off8704 00000040:00080000:0.0:1788684523.052798:0:24234:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].4, 224 off8928 00000040:00080000:0.0:1788684523.052814:0:24234:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].5, 224 off9152 00000040:00080000:0.0:1788684523.052829:0:24234:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].6, 120 off9272 00000040:00080000:0.0:1788684523.052843:0:24234:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].7, 168 off9440 00000040:00080000:0.0:1788684523.052858:0:24234:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].8, 224 off9664 00000040:00080000:0.0:1788684523.052872:0:24234:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].9, 224 off9888 00000040:00080000:0.0:1788684523.052886:0:24234:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].10, 120 off10008 00000040:00080000:0.0:1788684523.052902:0:24234:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].11, 224 off10232 00000040:00080000:0.0:1788684523.052917:0:24234:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].12, 224 off10456 00000040:00080000:0.0:1788684523.052932:0:24234:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].13, 88 off10544 00000040:00080000:0.0:1788684523.052946:0:24234:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].14, 128 off10672 00000040:00080000:0.0:1788684523.052974:0:24234:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].15, 144 off10816 00000040:00080000:0.0:1788684523.052990:0:24234:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].16, 160 off10976 00000040:00080000:0.0:1788684523.053004:0:24234:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].17, 224 off11200 00000040:00080000:0.0:1788684523.053018:0:24234:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].18, 224 off11424 00000040:00080000:0.0:1788684523.053032:0:24234:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].19, 80 off11504 00000040:00080000:0.0:1788684523.053047:0:24234:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].20, 224 off11728 00000040:00080000:0.0:1788684523.053059:0:24234:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].21, 224 off11952 00000040:00080000:0.0:1788684523.053078:0:24234:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].22, 88 off12040 00000040:00080000:0.0:1788684523.053089:0:24234:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].23, 128 off12168 00000040:00080000:0.0:1788684523.053199:0:24234:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].24, 144 off12312 00000040:00080000:0.0:1788684523.053213:0:24234:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].25, 160 off12472 00000040:00080000:0.0:1788684523.053227:0:24234:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].26, 224 off12696 00000040:00080000:0.0:1788684523.053240:0:24234:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].27, 224 off12920 00000040:00080000:0.0:1788684523.053255:0:24234:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].28, 80 off13000 00000040:00080000:0.0:1788684523.053270:0:24234:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].29, 224 off13224 00000040:00080000:0.0:1788684523.053285:0:24234:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].30, 224 off13448 00000040:00080000:0.0:1788684523.053309:0:24234:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].31, 88 off13536 00000040:00080000:0.0:1788684523.053322:0:24234:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].32, 128 off13664 00000040:00080000:0.0:1788684523.053335:0:24234:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].33, 144 off13808 00000040:00080000:0.0:1788684523.053346:0:24234:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].34, 128 off13936 00000040:00080000:0.0:1788684523.053357:0:24234:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].35, 224 off14160 00000040:00080000:0.0:1788684523.053409:0:24234:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].36, 224 off14384 00000040:00080000:0.0:1788684523.053426:0:24234:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].37, 80 off14464 00000040:00080000:0.0:1788684523.053441:0:24234:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].38, 224 off14688 00000040:00080000:0.0:1788684523.053456:0:24234:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].39, 224 off14912 00000040:00080000:0.0:1788684523.053470:0:24234:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].40, 88 off15000 00000040:00080000:0.0:1788684523.053484:0:24234:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].41, 128 off15128 00000040:00080000:0.0:1788684523.053496:0:24234:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].42, 144 off15272 00000040:00080000:0.0:1788684523.053507:0:24234:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].43, 128 off15400 00000040:00080000:0.0:1788684523.053518:0:24234:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].44, 224 off15624 00000040:00080000:0.0:1788684523.053530:0:24234:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].45, 224 off15848 00000040:00080000:0.0:1788684523.053540:0:24234:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].46, 80 off15928 00000040:00080000:0.0:1788684523.053565:0:24234:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].47, 224 off16152 00000040:00080000:0.0:1788684523.053580:0:24234:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].48, 232 off16384 00000100:00100000:0.0:1788684523.053622:0:24234:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d67450b1180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cebd1789-51a4-46ff-b167-6b1633e930a1:24234:1875571085912704:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788684523.053680:0:24234:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788684523.053718:0:24234:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d664646f000 going to sleep for 11 seconds 00000100:00100000:1.0:1788684523.053979:0:22726:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085912704 00000100:00100000:1.0:1788684523.053986:0:22726:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085912704 00000100:00100000:1.0:1788684523.054018:0:22726:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:1.0:1788684523.054026:0:22726:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d677ccdcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cebd1789-51a4-46ff-b167-6b1633e930a1+21:24234:x1875571085912704:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788684523.054222:0:22726:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d677ccdcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cebd1789-51a4-46ff-b167-6b1633e930a1+21:24234:x1875571085912704:12345-0@lo:502:mount.lustre.0 Request processed in 194us (540us total) trans 0 rc 0/0 00000100:00100000:1.0:1788684523.054230:0:22726:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:0.0:1788684523.055289:0:24234:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d67450b1180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cebd1789-51a4-46ff-b167-6b1633e930a1:24234:1875571085912704:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1788684523.055517:0:24234:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].49, 224 off16608 00000040:00080000:0.0:1788684523.055544:0:24234:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].50, 120 off16728 00000100:00100000:0.0:1788684523.055577:0:24234:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d67450b1180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cebd1789-51a4-46ff-b167-6b1633e930a1:24234:1875571085912832:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788684523.055632:0:24234:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788684523.055667:0:24234:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d664646f000 going to sleep for 11 seconds 00000100:00100000:1.0:1788684523.055905:0:22726:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085912832 00000100:00100000:1.0:1788684523.055911:0:22726:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085912832 00000100:00100000:1.0:1788684523.055959:0:22726:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:1.0:1788684523.055967:0:22726:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d677ccdf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cebd1789-51a4-46ff-b167-6b1633e930a1+21:24234:x1875571085912832:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788684523.056061:0:22726:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d677ccdf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cebd1789-51a4-46ff-b167-6b1633e930a1+21:24234:x1875571085912832:12345-0@lo:502:mount.lustre.0 Request processed in 94us (429us total) trans 0 rc 0/0 00000100:00100000:1.0:1788684523.056069:0:22726:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:0.0:1788684523.058124:0:24234:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d67450b1180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cebd1789-51a4-46ff-b167-6b1633e930a1:24234:1875571085912832:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1788684523.061079:0:24234:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].51, 224 off16952 00000040:00080000:0.0:1788684523.061579:0:24234:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 51 count 51 00000020:01000004:2.0:1788684523.062545:0:24260:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:2.0:1788684523.062561:0:24260:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff8d677721b380) 00000020:00000080:2.0:1788684523.062587:0:24260:0:(obd_config.c:720:class_attach_name()) OBD: dev 23 attached type lwp with refcount 2 00000020:01000004:2.0:1788684523.062682:0:24260:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8d6647988800 from lustre-OST0000, refs=3 00000020:01000004:2.0:1788684523.062687:0:24260:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8d6647988800 from lustre-OST0000, refs=3 00000020:01000004:2.0:1788684523.062689:0:24260:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8d6647988800 3 00010000:00080000:2.0:1788684523.062720:0:24260:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8d677cc6e000@lustre-MDT0000-lwp-OST0000: add connection 192.168.206.144@tcp at head 00010000:00010000:2.0:1788684523.065756:0:24260:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-9 is initialized 00000020:00000080:2.0:1788684523.066007:0:24260:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:2.0:1788684523.066053:0:24260:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1788684523.066066:0:24260:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0x44bac02bd54adf37 00000100:00080000:2.0:1788684523.066075:0:24260:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1788684523.066081:0:24260:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff8d677cc6e000 using connection 192.168.206.144@tcp/0@lo 00000100:00100000:2.0:1788684523.066307:0:24260:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8d677fa83100 x1875571085912960/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788684523.066335:0:24260:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00080000:2.0:1788684523.066401:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788684523.066405:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1788684523.066408:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788684523.066411:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1788684523.066431:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788684523.066434:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1788684523.066436:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788684523.066439:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1788684523.066467:0:3624:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d677fa81c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3624:1875571085913216:0@lo:400:kworker.0 00000100:00100000:2.0:1788684523.066587:0:3624:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788684523.066622:0:3624:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788684523.066628:0:3624:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d677fa80000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3624:1875571085913088:0@lo:400:kworker.0 00000100:00100000:2.0:1788684523.066653:0:3624:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788684523.066682:0:3625:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d677fa82d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3625:1875571085913344:0@lo:400:kworker.0 00000100:00100000:2.0:1788684523.066705:0:3625:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788684523.066723:0:3625:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788684523.066728:0:3625:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d664859a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3625:1875571085913472:0@lo:400:kworker.0 00000100:00100000:2.0:1788684523.066756:0:3625:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788684523.066876:0:22734:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085913216 00000100:00100000:3.0:1788684523.066884:0:22734:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085913216 00000100:00100000:3.0:1788684523.066914:0:22734:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085913472 00000100:00100000:3.0:1788684523.066916:0:22734:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085913472 00000100:00100000:3.0:1788684523.066931:0:22734:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788684523.066939:0:22734:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6648599500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3624:x1875571085913216:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788684523.066985:0:22734:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6648599500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3624:x1875571085913216:12345-0@lo:400:kworker.0 Request processed in 46us (397us total) trans 0 rc 0/0 00000100:00100000:3.0:1788684523.066992:0:22734:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788684523.067005:0:22734:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1788684523.067011:0:22734:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6648598a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3625:x1875571085913472:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788684523.067040:0:22734:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6648598a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3625:x1875571085913472:12345-0@lo:400:kworker.0 Request processed in 29us (283us total) trans 0 rc 0/0 00000100:00100000:3.0:1788684523.067045:0:22734:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1788684523.067064:0:22738:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085913088 00000100:00100000:3.0:1788684523.067074:0:22738:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085913088 00000100:00100000:3.0:1788684523.067114:0:22738:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085913344 00000100:00100000:3.0:1788684523.067117:0:22738:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085913344 00000100:00100000:3.0:1788684523.067129:0:22738:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1788684523.067134:0:22738:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6648598380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3624:x1875571085913088:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788684523.067162:0:22738:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6648598380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3624:x1875571085913088:12345-0@lo:400:kworker.0 Request processed in 28us (508us total) trans 0 rc 0/0 00000100:00100000:3.0:1788684523.067167:0:22738:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1788684523.067177:0:22738:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1788684523.067181:0:22738:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6648599c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3625:x1875571085913344:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788684523.067199:0:22738:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6648599c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3625:x1875571085913344:12345-0@lo:400:kworker.0 Request processed in 18us (495us total) trans 0 rc 0/0 00000100:00100000:3.0:1788684523.067204:0:22738:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1788684523.068205:0:3622:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d677fa83100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3622:1875571085912960:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1788684523.068260:0:3622:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788684523.068318:0:22734:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085912960 00000100:00100000:0.0:1788684523.068324:0:22734:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085912960 00000100:00100000:0.0:1788684523.068353:0:22734:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788684523.068359:0:22734:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67450b1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3622:x1875571085912960:12345-0@lo:38:llog_process_th.0 00010000:00080000:0.0:1788684523.068399:0:22734:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 604 last 0 00000020:00000080:0.0:1788684523.068435:0:22734:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0x44bac02bd54adf3e 00000004:00100000:0.0:1788684523.068707:0:22734:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1788684523.068743:0:22734:0:(import.c:65:import_set_state_nolock()) ffff8d67749df000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788684523.068796:0:22734:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67450b1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3622:x1875571085912960:12345-0@lo:38:llog_process_th.0 Request processed in 435us (535us total) trans 0 rc 0/0 00000100:00100000:0.0:1788684523.068804:0:22734:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:0.0:1788684523.068848:0:3622:0:(ldlm_request.c:1670:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8d677fa83100 x1875571085912960/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788684533 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788684523.068857:0:3622:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1788684523.068865:0:3622:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 3 00000100:00080000:0.0:1788684523.068882:0:3622:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:0.0:1788684523.068887:0:3622:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1788684523.068889:0:3622:0:(import.c:65:import_set_state_nolock()) ffff8d677cc6e000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1788684523.068895:0:3622:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d677fa83100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3622:1875571085912960:0@lo:38:llog_process_th.0 00010000:00080000:2.0:1788684523.069080:0:3625:0:(ldlm_request.c:1670:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8d664859a680 x1875571085913472/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788684539 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788684523.069100:0:3625:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d664859a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3625:1875571085913472:0@lo:400:kworker.0 00000100:00100000:2.0:1788684523.069122:0:3625:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d677fa82d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3625:1875571085913344:0@lo:400:kworker.0 00000100:00100000:2.0:1788684523.069153:0:3624:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d677fa80000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3624:1875571085913088:0@lo:400:kworker.0 00010000:00080000:2.0:1788684523.069165:0:3624:0:(ldlm_request.c:1670:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8d677fa81c00 x1875571085913216/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788684539 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788684523.069172:0:3624:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d677fa81c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3624:1875571085913216:0@lo:400:kworker.0 00000020:01000004:2.0:1788684523.069896:0:24260:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-lwp-OST0000 (typ=lwp) 00000020:00000080:2.0:1788684523.069911:0:24260:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-lwp-OST0000 (ffff8d6750b7cd40) 00000020:00000080:2.0:1788684523.069931:0:24260:0:(obd_config.c:720:class_attach_name()) OBD: dev 24 attached type lwp with refcount 2 00000020:01000004:2.0:1788684523.070022:0:24260:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8d6647988800 from lustre-OST0000, refs=3 00000020:01000004:2.0:1788684523.070026:0:24260:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8d6647988800 from lustre-OST0000, refs=3 00000020:01000004:2.0:1788684523.070028:0:24260:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8d6647988800 3 00010000:00080000:2.0:1788684523.070056:0:24260:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8d677487a000@lustre-MDT0001-lwp-OST0000: add connection 192.168.206.144@tcp at head 00010000:00010000:2.0:1788684523.073831:0:24260:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-lwp-OST0000-10 is initialized 00000020:00000080:2.0:1788684523.074011:0:24260:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-lwp-OST0000 (uuid lustre-MDT0001-lwp-OST0000_UUID) 00000010:01000000:2.0:1788684523.074057:0:24260:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1788684523.074070:0:24260:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-lwp-OST0000, cookie 0x44bac02bd54adf4c 00000100:00080000:2.0:1788684523.074081:0:24260:0:(import.c:545:import_select_connection()) lustre-MDT0001-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1788684523.074088:0:24260:0:(import.c:665:import_select_connection()) lustre-MDT0001-lwp-OST0000: import ffff8d677487a000 using connection 192.168.206.144@tcp/0@lo 00000100:00100000:2.0:1788684523.076484:0:24260:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8d664859a680 x1875571085913600/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788684523.076548:0:3622:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d664859a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3622:1875571085913600:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1788684523.076614:0:3622:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1788684523.076678:0:24260:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-lwp-OST0000_UUID->lustre-MDT0001_UUID 00000100:00080000:2.0:1788684523.076702:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788684523.076707:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1788684523.076710:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788684523.076713:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1788684523.076716:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788684523.076720:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1788684523.076722:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788684523.076725:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000040:00080000:2.0:1788684523.076913:0:24260:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x10:0x0] index 52 count 51 00000100:00100000:3.0:1788684523.077132:0:22733:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085913600 00000100:00100000:3.0:1788684523.077140:0:22733:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085913600 00000100:00100000:3.0:1788684523.077181:0:22733:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788684523.077189:0:22733:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d674698ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3622:x1875571085913600:12345-0@lo:38:llog_process_th.0 00010000:00080000:3.0:1788684523.077218:0:22733:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0001-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 604 last 0 00000020:00000080:3.0:1788684523.077265:0:22733:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-lwp-OST0000_UUID, cookie 0x44bac02bd54adf53 00000004:00100000:3.0:1788684523.077281:0:22733:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1788684523.077311:0:22733:0:(import.c:65:import_set_state_nolock()) ffff8d67488fb000 : changing import state from RECOVER to FULL 00000020:01000000:0.0:1788684523.077604:0:24234:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:0.0:1788684523.077633:0:24234:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.144@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1788684523.077648:0:24234:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.144@tcp lock: ffff8d66479a0200/0x44bac02bd54adf22 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x44bac02bd54adf29 expref: -99 pid: 24234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684523.077658:0:24234:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.144@tcp lock: ffff8d66479a0200/0x44bac02bd54adf22 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x44bac02bd54adf29 expref: -99 pid: 24234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1788684523.077707:0:24234:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:0.0:1788684523.077710:0:24234:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1788684523.077711:0:24234:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788684523.077712:0:24234:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788684523.077713:0:24234:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788684523.077714:0:24234:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788684523.077715:0:24234:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788684523.077717:0:24234:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788684523.077719:0:24234:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1788684523.077722:0:24234:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020002 00000020:01000004:0.0:1788684523.077724:0:24234:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1788684523.077725:0:24234:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1788684523.077726:0:24234:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788684523.077727:0:24234:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788684523.077728:0:24234:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788684523.077729:0:24234:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788684523.077730:0:24234:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788684523.077731:0:24234:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788684523.077732:0:24234:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1788684523.077748:0:24234:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:0.0:1788684523.077763:0:24234:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d67450b1880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cebd1789-51a4-46ff-b167-6b1633e930a1:24234:1875571085913728:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1788684523.077813:0:24234:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788684523.077836:0:24234:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d664646f000 going to sleep for 11 seconds 00000100:00100000:0.0:1788684523.077867:0:22726:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085913728 00000100:00100000:0.0:1788684523.077872:0:22726:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085913728 00000100:00100000:0.0:1788684523.077902:0:22726:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:0.0:1788684523.077909:0:22726:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d677ccdec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cebd1789-51a4-46ff-b167-6b1633e930a1+21:24234:x1875571085913728:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1788684523.077927:0:22726:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:0.0:1788684523.077939:0:22726:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00100000:3.0:1788684523.082725:0:22733:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d674698ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3622:x1875571085913600:12345-0@lo:38:llog_process_th.0 Request processed in 5527us (6102us total) trans 0 rc 0/0 00000100:00100000:3.0:1788684523.082740:0:22733:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:1.0:1788684523.089353:0:3622:0:(ldlm_request.c:1670:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff8d664859a680 x1875571085913600/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788684533 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788684523.089389:0:3622:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1788684523.089399:0:3622:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-MDT0001-lwp-OST0000: connect to target with instance 3 00000100:00080000:1.0:1788684523.089407:0:3622:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-MDT0001-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:1.0:1788684523.089413:0:3622:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:1.0:1788684523.089424:0:3622:0:(import.c:65:import_set_state_nolock()) ffff8d677487a000 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1788684523.089431:0:3622:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d664859a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3622:1875571085913600:0@lo:38:llog_process_th.0 20000000:01000000:2.0:1788684523.095160:0:22726:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1788684523.095189:0:22726:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 20000000:01000000:3.0:1788684523.095299:0:22748:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:3.0:1788684523.095305:0:22748:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:3.0:1788684523.095326:0:22748:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8d66479a1e00/0x44bac02bd54adf5a lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 22748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684523.095356:0:22748:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8d66476d4800/0x44bac02bd54adea4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x44bac02bd54ade9d expref: 21 pid: 22725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684523.095399:0:22748:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8d66476d4200/0x44bac02bd54adeb2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x44bac02bd54adeab expref: 21 pid: 22726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684523.095407:0:22748:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8d66479a1e00/0x44bac02bd54adf5a lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 22748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684523.095449:0:22748:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8d66476d4200/0x44bac02bd54adeb2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x44bac02bd54adeab expref: 21 pid: 22726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684523.095463:0:22748:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8d66476d4200/0x44bac02bd54adeb2 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x44bac02bd54adeab expref: 21 pid: 22726 timeout: 704 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788684523.095477:0:22748:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6647908e00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22748:1875571085913856:0@lo:104: 00000100:00100000:3.0:1788684523.095537:0:22748:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788684523.095585:0:22748:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8d66476d4800/0x44bac02bd54adea4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x44bac02bd54ade9d expref: 21 pid: 22725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684523.095593:0:22748:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8d66476d4800/0x44bac02bd54adea4 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x44bac02bd54ade9d expref: 21 pid: 22725 timeout: 704 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788684523.095601:0:22748:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d664790a680 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22748:1875571085913984:0@lo:104: 00000100:00100000:3.0:1788684523.095626:0:22748:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788684523.095644:0:22748:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d6748205d80 going to sleep for 11 seconds 00000100:00100000:3.0:1788684523.095670:0:22715:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:3.0:1788684523.095685:0:22715:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085913856 00000100:00100000:3.0:1788684523.095692:0:22715:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085913856 00000100:00100000:3.0:1788684523.095731:0:22715:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085913984 00000100:00100000:3.0:1788684523.095734:0:22715:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085913984 00000100:00100000:3.0:1788684523.095749:0:22715:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788684523.095757:0:22715:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6647909180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:cebd1789-51a4-46ff-b167-6b1633e930a1+4:22748:x1875571085913856:12345-0@lo:104: 00010000:00010000:3.0:1788684523.095770:0:22715:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.144@tcp lock: ffff8d6746d3e800/0x44bac02bd54adeab lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x44bac02bd54adeb2 expref: -99 pid: 22729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684523.095819:0:22715:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788684523.095825:0:22715:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6647909180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:cebd1789-51a4-46ff-b167-6b1633e930a1+4:22748:x1875571085913856:12345-0@lo:104: Request processed in 70us (289us total) trans 0 rc 0/0 00000100:00100000:3.0:1788684523.095833:0:22715:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788684523.095850:0:22715:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788684523.095856:0:22715:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d677cbf4850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:cebd1789-51a4-46ff-b167-6b1633e930a1+3:22748:x1875571085913984:12345-0@lo:104: 00010000:00010000:3.0:1788684523.095863:0:22715:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.144@tcp lock: ffff8d6746d3f200/0x44bac02bd54ade9d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x44bac02bd54adea4 expref: -99 pid: 22729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684523.095897:0:22715:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1788684523.095902:0:22715:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d677cbf4850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:cebd1789-51a4-46ff-b167-6b1633e930a1+3:22748:x1875571085913984:12345-0@lo:104: Request processed in 46us (276us total) trans 0 rc 0/0 00000100:00100000:3.0:1788684523.095907:0:22715:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00010000:3.0:1788684523.095939:0:22720:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788684523.095944:0:22720:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.144@tcp lock: ffff8d6746d3e800/0x44bac02bd54adeab lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x44bac02bd54adeb2 expref: -99 pid: 22729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684523.095951:0:22720:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d6746d3e800 already unused, calling callback (ffffffffc1297c20) 10000000:00010000:3.0:1788684523.095954:0:22720:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.144@tcp lock: ffff8d6746d3e800/0x44bac02bd54adeab lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x44bac02bd54adeb2 expref: -99 pid: 22729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684523.095962:0:22720:0:(ldlm_request.c:1390:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.144@tcp lock: ffff8d6746d3e800/0x44bac02bd54adeab lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x44bac02bd54adeb2 expref: -99 pid: 22729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788684523.095982:0:22720:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.144@tcp lock: ffff8d6746d3e800/0x44bac02bd54adeab lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x44bac02bd54adeb2 expref: -99 pid: 22729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788684523.095988:0:22720:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1788684523.096018:0:22720:0:(ldlm_request.c:1438:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.144@tcp lock: ffff8d6746d3e800/0x44bac02bd54adeab lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x44bac02bd54adeb2 expref: -99 pid: 22729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684523.096025:0:22720:0:(ldlm_request.c:1497:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788684523.096042:0:22720:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.144@tcp lock: ffff8d6746d3e800/0x44bac02bd54adeab lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x44bac02bd54adeb2 expref: -99 pid: 22729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684523.096049:0:22720:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.144@tcp lock: ffff8d6746d3e800/0x44bac02bd54adeab lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x44bac02bd54adeb2 expref: -99 pid: 22729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684523.096060:0:22720:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788684523.096063:0:22720:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.144@tcp lock: ffff8d6746d3f200/0x44bac02bd54ade9d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x44bac02bd54adea4 expref: -99 pid: 22729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684523.096068:0:22720:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d6746d3f200 already unused, calling callback (ffffffffc1297c20) 10000000:00010000:3.0:1788684523.096071:0:22720:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.144@tcp lock: ffff8d6746d3f200/0x44bac02bd54ade9d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x44bac02bd54adea4 expref: -99 pid: 22729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684523.096077:0:22720:0:(ldlm_request.c:1390:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.144@tcp lock: ffff8d6746d3f200/0x44bac02bd54ade9d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x44bac02bd54adea4 expref: -99 pid: 22729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788684523.096082:0:22720:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.144@tcp lock: ffff8d6746d3f200/0x44bac02bd54ade9d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x44bac02bd54adea4 expref: -99 pid: 22729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788684523.096087:0:22720:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1788684523.096119:0:22720:0:(ldlm_request.c:1438:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.144@tcp lock: ffff8d6746d3f200/0x44bac02bd54ade9d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x44bac02bd54adea4 expref: -99 pid: 22729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684523.096126:0:22720:0:(ldlm_request.c:1497:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788684523.096133:0:22720:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.144@tcp lock: ffff8d6746d3f200/0x44bac02bd54ade9d lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x44bac02bd54adea4 expref: -99 pid: 22729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684523.096139:0:22720:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.144@tcp lock: ffff8d6746d3f200/0x44bac02bd54ade9d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x44bac02bd54adea4 expref: -99 pid: 22729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684523.096151:0:22720:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788684523.096153:0:22720:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788684523.096154:0:22720:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788684523.096161:0:22721:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788684523.096179:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6647908700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:cebd1789-51a4-46ff-b167-6b1633e930a1:3623:1875571085914112:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788684523.096206:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788684523.096231:0:3623:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788684523.096238:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d664790bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:cebd1789-51a4-46ff-b167-6b1633e930a1:3623:1875571085914240:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788684523.096262:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788684523.096308:0:22718:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085914112 00000100:00100000:3.0:1788684523.096313:0:22718:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085914112 00010000:00010000:3.0:1788684523.096332:0:22718:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8d66476d4200/0x44bac02bd54adeb2 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x44bac02bd54adeab expref: 22 pid: 22726 timeout: 704 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788684523.096352:0:22718:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085914240 00000100:00100000:3.0:1788684523.096355:0:22718:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085914240 00010000:00010000:3.0:1788684523.096393:0:22718:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8d66476d4800/0x44bac02bd54adea4 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x44bac02bd54ade9d expref: 23 pid: 22725 timeout: 704 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788684523.096407:0:22718:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788684523.096414:0:22718:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6647909180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:cebd1789-51a4-46ff-b167-6b1633e930a1+23:3623:x1875571085914112:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788684523.096431:0:22718:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788684523.096437:0:22718:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8d66476d4200/0x44bac02bd54adeb2 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x44bac02bd54adeab expref: 23 pid: 22726 timeout: 704 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684523.096447:0:22718:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8d66476d4200/0x44bac02bd54adeb2 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x44bac02bd54adeab expref: 23 pid: 22726 timeout: 704 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684523.096461:0:22718:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788684523.096491:0:22718:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6647909180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:cebd1789-51a4-46ff-b167-6b1633e930a1+23:3623:x1875571085914112:12345-0@lo:103:ldlm_bl.0 Request processed in 79us (285us total) trans 0 rc 0/0 00000100:00100000:3.0:1788684523.096497:0:22718:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788684523.096510:0:22718:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788684523.096516:0:22718:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d66465dc850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:cebd1789-51a4-46ff-b167-6b1633e930a1+22:3623:x1875571085914240:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788684523.096523:0:22718:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788684523.096527:0:22718:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8d66476d4800/0x44bac02bd54adea4 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x44bac02bd54ade9d expref: 22 pid: 22725 timeout: 704 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684523.096535:0:22718:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8d66476d4800/0x44bac02bd54adea4 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x44bac02bd54ade9d expref: 22 pid: 22725 timeout: 704 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684523.096546:0:22718:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8d66479a1e00/0x44bac02bd54adf5a lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 22748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684523.096554:0:22718:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d66479a1e00/0x44bac02bd54adf5a lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 22748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1788684523.096567:0:22718:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.024186502s 00010000:00010000:3.0:1788684523.096571:0:22718:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8d66479a1e00/0x44bac02bd54adf5a lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 22748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684523.096588:0:22718:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8d66479a1e00/0x44bac02bd54adf5a lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 22748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684523.096595:0:22718:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8d66479a1e00/0x44bac02bd54adf5a lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 22748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684523.096601:0:22718:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8d66479a1e00/0x44bac02bd54adf5a lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 22748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684523.096607:0:22718:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d66479a1e00 already unused, calling callback (ffffffffc0cae340) 00010000:00010000:3.0:1788684523.096612:0:22718:0:(ldlm_request.c:377:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8d66479a1e00/0x44bac02bd54adf5a lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 22748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684523.096619:0:22718:0:(ldlm_request.c:1415:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8d66479a1e00/0x44bac02bd54adf5a lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 22748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684523.096628:0:22718:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8d66479a1e00/0x44bac02bd54adf5a lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684523.096637:0:22718:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788684523.096660:0:22718:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d66465dc850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:cebd1789-51a4-46ff-b167-6b1633e930a1+22:3623:x1875571085914240:12345-0@lo:103:ldlm_bl.0 Request processed in 145us (397us total) trans 0 rc 0/0 00000100:00100000:3.0:1788684523.096667:0:22718:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788684523.096724:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d664790bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:cebd1789-51a4-46ff-b167-6b1633e930a1:3623:1875571085914240:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788684523.096733:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6647908700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:cebd1789-51a4-46ff-b167-6b1633e930a1:3623:1875571085914112:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788684523.096759:0:22748:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d66476d4200/0x44bac02bd54adeb2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x44bac02bd54adeab expref: 21 pid: 22726 timeout: 704 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788684523.096778:0:22748:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6647908e00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22748:1875571085913856:0@lo:104: 00010000:00010000:3.0:1788684523.096789:0:22748:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d66476d4800/0x44bac02bd54adea4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x44bac02bd54ade9d expref: 20 pid: 22725 timeout: 704 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788684523.096796:0:22748:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d664790a680 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22748:1875571085913984:0@lo:104: 00010000:00010000:3.0:1788684523.096809:0:22748:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8d66479a1e00/0x44bac02bd54adf5a lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684523.096817:0:22748:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8d66479a1e00/0x44bac02bd54adf5a lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684523.096823:0:22748:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8d66479a1e00/0x44bac02bd54adf5a lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684523.096830:0:22748:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d66479a1e00/0x44bac02bd54adf5a lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788684523.097300:0:22726:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d677ccdec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cebd1789-51a4-46ff-b167-6b1633e930a1+19:24234:x1875571085913728:12345-0@lo:253:mount.lustre.0 Request processed in 19389us (19483us total) trans 0 rc 0/0 00000100:00100000:2.0:1788684523.097309:0:22726:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:3.0:1788684523.097702:0:24234:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d67450b1880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cebd1789-51a4-46ff-b167-6b1633e930a1:24234:1875571085913728:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1788684523.097714:0:24234:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:3.0:1788684523.097718:0:24234:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1788684523.097719:0:24234:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1788684523.097721:0:24234:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788684523.097722:0:24234:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788684523.097723:0:24234:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788684523.097724:0:24234:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788684523.097726:0:24234:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788684523.097728:0:24234:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788684523.097729:0:24234:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:3.0:1788684523.097742:0:24234:0:(tgt_mount.c:2698:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 00000001:00000004:3.0:1788684523.106000:0:24234:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 3, last_transno is 12884901888 00002000:00080000:3.0:1788684523.112234:0:24234:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:3.0:1788684523.112241:0:24234:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:3.0:1788684523.112277:0:24234:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:3.0:1788684523.112315:0:24234:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.206.144@tcp: cl_mgc_mutex unlock 00000020:01000004:3.0:1788684523.112334:0:24234:0:(tgt_mount.c:2464:server_fill_super_common()) Server sb, dev=49 00000080:00000004:3.0:1788684523.112351:0:24234:0:(super25.c:182:lustre_fill_super()) /dev/mapper/ost1_flakey: Mount complete 00000020:00000004:3.0:1788684523.113599:0:24234:0:(tgt_mount.c:2350:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1788684523.113821:0:24234:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:3.0:1788684523.200514:0:22720:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:2.0:1788684524.059996:0:24313:0:(tgt_mount.c:2350:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1788684524.060277:0:24313:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:3.0:1788684524.224972:0:22721:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788684524.669646:0:3626:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788684524.669681:0:3626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d664790a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3626:1875571085914368:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788684524.669744:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788684524.669789:0:22738:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085914368 00000100:00100000:2.0:1788684524.669796:0:22738:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085914368 00000100:00100000:2.0:1788684524.669836:0:22738:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1788684524.669845:0:22738:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6648599f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3626:x1875571085914368:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1788684524.669876:0:22738:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:2.0:1788684524.669921:0:22738:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6648599f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3626:x1875571085914368:12345-0@lo:41:osp-pre-1-0.0 Request processed in 77us (176us total) trans 0 rc 0/0 00000100:00100000:2.0:1788684524.669928:0:22738:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1788684524.670087:0:3626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d664790a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3626:1875571085914368:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788684524.675159:0:3626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d664859a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3626:1875571085914496:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788684524.675227:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788684524.675354:0:24164:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085914496 00000100:00100000:2.0:1788684524.675362:0:24164:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085914496 00000100:00100000:2.0:1788684524.675432:0:24164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1788684524.675441:0:24164:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6647908e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3626:x1875571085914496:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1788684524.675474:0:24164:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446309888 avail 1300070400 00000100:00100000:2.0:1788684524.675523:0:24164:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6647908e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3626:x1875571085914496:12345-0@lo:41:osp-pre-0-1.0 Request processed in 83us (296us total) trans 0 rc 0/0 00000100:00100000:2.0:1788684524.675531:0:24164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1788684524.675652:0:3626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d664859a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3626:1875571085914496:0@lo:41:osp-pre-0-1.0 10000000:01000000:3.0:1788684524.797448:0:22729:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1788684524.797456:0:22729:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8d6647429800 from 13 10000000:01000000:3.0:1788684524.797461:0:22729:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1788684524.797508:0:22729:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.144@tcp lock: ffff8d66479a0800/0x44bac02bd54adf61 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684524.797520:0:22729:0:(ldlm_request.c:1106:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.144@tcp lock: ffff8d66479a0800/0x44bac02bd54adf61 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684524.797541:0:22729:0:(ldlm_request.c:1193:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.144@tcp lock: ffff8d66479a0800/0x44bac02bd54adf61 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788684524.797569:0:22729:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6647908700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cebd1789-51a4-46ff-b167-6b1633e930a1:22729:1875571085914624:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788684524.797647:0:22729:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788684524.797702:0:22729:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d66477c7d80 going to sleep for 11 seconds 00000100:00100000:0.0:1788684524.797902:0:22725:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085914624 00000100:00100000:0.0:1788684524.797910:0:22725:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085914624 00000100:00100000:0.0:1788684524.797978:0:22725:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:0.0:1788684524.797988:0:22725:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d677ccdd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cebd1789-51a4-46ff-b167-6b1633e930a1+19:22729:x1875571085914624:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788684524.798002:0:22725:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788684524.798025:0:22725:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d6746d3e800/0x44bac02bd54adf68 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x44bac02bd54adf61 expref: -99 pid: 22725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684524.798048:0:22725:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d6746d3e800/0x44bac02bd54adf68 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x44bac02bd54adf61 expref: 20 pid: 22725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684524.798058:0:22725:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d6746d3e800/0x44bac02bd54adf68 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x44bac02bd54adf61 expref: 20 pid: 22725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684524.798066:0:22725:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d6746d3e800, rc 0) 00000100:00100000:0.0:1788684524.798119:0:22725:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d677ccdd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cebd1789-51a4-46ff-b167-6b1633e930a1+20:22729:x1875571085914624:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 132us (472us total) trans 0 rc 0/0 00000100:00100000:0.0:1788684524.798125:0:22725:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:3.0:1788684524.798257:0:22729:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6647908700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cebd1789-51a4-46ff-b167-6b1633e930a1:22729:1875571085914624:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788684524.798271:0:22729:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.144@tcp lock: ffff8d66479a0800/0x44bac02bd54adf61 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x44bac02bd54adf68 expref: -99 pid: 22729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684524.798294:0:22729:0:(ldlm_request.c:840:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.144@tcp lock: ffff8d66479a0800/0x44bac02bd54adf61 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x44bac02bd54adf68 expref: -99 pid: 22729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788684524.798342:0:22729:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6647908700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cebd1789-51a4-46ff-b167-6b1633e930a1:22729:1875571085914752:0@lo:256:ll_cfg_requeue.0 00000100:00100000:3.0:1788684524.798411:0:22729:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788684524.798431:0:22729:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d66477c7d80 going to sleep for 11 seconds 00000100:00100000:1.0:1788684524.798566:0:22727:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085914752 00000100:00100000:1.0:1788684524.798572:0:22727:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085914752 00000100:00100000:1.0:1788684524.798607:0:22727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:1.0:1788684524.798614:0:22727:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d677ccdc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cebd1789-51a4-46ff-b167-6b1633e930a1+20:22729:x1875571085914752:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:1.0:1788684524.798806:0:22727:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1788684524.798820:0:22727:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1788684524.798824:0:22727:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 13 00000100:00100000:1.0:1788684524.800394:0:22727:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d677ccdc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cebd1789-51a4-46ff-b167-6b1633e930a1+20:22729:x1875571085914752:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 1772us (1973us total) trans 0 rc 0/0 00000100:00100000:1.0:1788684524.800408:0:22727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:3.0:1788684524.801239:0:22729:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6647908700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cebd1789-51a4-46ff-b167-6b1633e930a1:22729:1875571085914752:0@lo:256:ll_cfg_requeue.0 10000000:01000000:3.0:1788684524.801528:0:22729:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.144@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1788684524.801609:0:22729:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.144@tcp lock: ffff8d66479a0800/0x44bac02bd54adf61 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x44bac02bd54adf68 expref: -99 pid: 22729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684524.801619:0:22729:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.144@tcp lock: ffff8d66479a0800/0x44bac02bd54adf61 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x44bac02bd54adf68 expref: -99 pid: 22729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788684524.801693:0:22729:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1788684524.801695:0:22729:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8d677cb59000 from 13 10000000:01000000:3.0:1788684524.801698:0:22729:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1788684524.801730:0:22729:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.144@tcp lock: ffff8d66479a1e00/0x44bac02bd54adf6f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684524.801738:0:22729:0:(ldlm_request.c:1106:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.144@tcp lock: ffff8d66479a1e00/0x44bac02bd54adf6f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684524.801747:0:22729:0:(ldlm_request.c:1193:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.144@tcp lock: ffff8d66479a1e00/0x44bac02bd54adf6f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788684524.801832:0:22729:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6647908700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cebd1789-51a4-46ff-b167-6b1633e930a1:22729:1875571085914880:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788684524.801898:0:22729:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788684524.801991:0:22729:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d6742d173c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788684524.802527:0:22725:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085914880 00000100:00100000:0.0:1788684524.802607:0:22725:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085914880 00000100:00100000:0.0:1788684524.802781:0:22725:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:0.0:1788684524.802791:0:22725:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d677ccdf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cebd1789-51a4-46ff-b167-6b1633e930a1+20:22729:x1875571085914880:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788684524.802807:0:22725:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788684524.802822:0:22725:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d6746d3f400/0x44bac02bd54adf76 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x44bac02bd54adf6f expref: -99 pid: 22725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684524.802845:0:22725:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d6746d3f400/0x44bac02bd54adf76 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x44bac02bd54adf6f expref: 21 pid: 22725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684524.802856:0:22725:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d6746d3f400/0x44bac02bd54adf76 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x44bac02bd54adf6f expref: 21 pid: 22725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684524.802865:0:22725:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d6746d3f400, rc 0) 00000100:00100000:0.0:1788684524.802923:0:22725:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d677ccdf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cebd1789-51a4-46ff-b167-6b1633e930a1+21:22729:x1875571085914880:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 133us (1024us total) trans 0 rc 0/0 00000100:00100000:0.0:1788684524.802930:0:22725:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:3.0:1788684524.803029:0:22729:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6647908700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cebd1789-51a4-46ff-b167-6b1633e930a1:22729:1875571085914880:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788684524.803046:0:22729:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.144@tcp lock: ffff8d66479a1e00/0x44bac02bd54adf6f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x44bac02bd54adf76 expref: -99 pid: 22729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684524.803056:0:22729:0:(ldlm_request.c:840:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.144@tcp lock: ffff8d66479a1e00/0x44bac02bd54adf6f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x44bac02bd54adf76 expref: -99 pid: 22729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788684524.803123:0:22729:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6647908700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cebd1789-51a4-46ff-b167-6b1633e930a1:22729:1875571085915008:0@lo:256:ll_cfg_requeue.0 00000100:00100000:3.0:1788684524.803164:0:22729:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788684524.803542:0:22729:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d6742d173c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788684524.805341:0:22726:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085915008 00000100:00100000:1.0:1788684524.805353:0:22726:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085915008 00000100:00100000:1.0:1788684524.805413:0:22726:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:1.0:1788684524.805428:0:22726:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d677ccde850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cebd1789-51a4-46ff-b167-6b1633e930a1+21:22729:x1875571085915008:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:1.0:1788684524.805450:0:22726:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1788684524.805473:0:22726:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1788684524.805477:0:22726:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 13 00000100:00100000:1.0:1788684524.805607:0:22726:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d677ccde850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cebd1789-51a4-46ff-b167-6b1633e930a1+21:22729:x1875571085915008:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 185us (2441us total) trans 0 rc 0/0 00000100:00100000:1.0:1788684524.805615:0:22726:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:3.0:1788684524.806143:0:22729:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6647908700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cebd1789-51a4-46ff-b167-6b1633e930a1:22729:1875571085915008:0@lo:256:ll_cfg_requeue.0 10000000:01000000:3.0:1788684524.806224:0:22729:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.144@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1788684524.806235:0:22729:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.144@tcp lock: ffff8d66479a1e00/0x44bac02bd54adf6f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x44bac02bd54adf76 expref: -99 pid: 22729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684524.806246:0:22729:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.144@tcp lock: ffff8d66479a1e00/0x44bac02bd54adf6f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x44bac02bd54adf76 expref: -99 pid: 22729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684525.246486:0:22720:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788684526.269825:0:22721:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788684527.298426:0:22720:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1788684528.256924:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788684528.256931:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1788684528.256934:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788684528.256937:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1788684528.256959:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788684528.256962:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1788684528.256970:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788684528.256973:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1788684528.257025:0:3624:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d664859ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3624:1875571085915264:0@lo:400:kworker.0 00000100:00100000:2.0:1788684528.257098:0:3624:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788684528.257141:0:3624:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6648598700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3624:1875571085915776:0@lo:400:kworker.0 00000100:00100000:2.0:1788684528.257170:0:3624:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788684528.257195:0:3624:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:2.0:1788684528.257201:0:3624:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d664859b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:cebd1789-51a4-46ff-b167-6b1633e930a1:3624:1875571085915136:0@lo:400:kworker.0 00000100:00100000:2.0:1788684528.257232:0:3624:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788684528.257252:0:3624:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6648599880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3624:1875571085915648:0@lo:400:kworker.0 00000100:00100000:2.0:1788684528.257270:0:3624:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788684528.257292:0:3625:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d664859bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3625:1875571085915392:0@lo:400:kworker.0 00000100:00100000:2.0:1788684528.257309:0:3625:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788684528.257322:0:3625:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d664859b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3625:1875571085915904:0@lo:400:kworker.0 00000100:00100000:2.0:1788684528.257340:0:3625:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788684528.257353:0:3625:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788684528.257357:0:3625:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d664859b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3625:1875571085915520:0@lo:400:kworker.0 00000100:00100000:2.0:1788684528.257405:0:3625:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788684528.257435:0:22737:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085915264 00000100:00100000:2.0:1788684528.257441:0:22737:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085915264 00000100:00100000:2.0:1788684528.257472:0:22737:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085915520 00000100:00100000:2.0:1788684528.257475:0:22737:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085915520 00000100:00100000:2.0:1788684528.257487:0:22737:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1788684528.257493:0:22737:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6648599180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3624:x1875571085915264:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788684528.257538:0:22737:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6648599180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3624:x1875571085915264:12345-0@lo:400:kworker.0 Request processed in 44us (440us total) trans 0 rc 0/0 00000100:00100000:2.0:1788684528.257551:0:22737:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1788684528.257565:0:22737:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1788684528.257570:0:22737:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d664859a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3625:x1875571085915520:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788684528.257596:0:22737:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d664859a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3625:x1875571085915520:12345-0@lo:400:kworker.0 Request processed in 25us (190us total) trans 0 rc 0/0 00000100:00100000:2.0:1788684528.257601:0:22737:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1788684528.257614:0:22734:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085915776 00000100:00100000:2.0:1788684528.257617:0:22734:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085915776 00000100:00100000:1.0:1788684528.258432:0:22733:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085915648 00000100:00100000:1.0:1788684528.258439:0:22733:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085915648 00000100:00100000:1.0:1788684528.258462:0:22733:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085915392 00000100:00100000:1.0:1788684528.258464:0:22733:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085915392 00000100:00100000:1.0:1788684528.258479:0:22733:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085915904 00000100:00100000:1.0:1788684528.258482:0:22733:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085915904 00000100:00100000:0.0:1788684528.260812:0:23765:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1788684528.260828:0:23765:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d664859aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3624:x1875571085915648:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788684528.260911:0:23765:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d664859aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3624:x1875571085915648:12345-0@lo:400:kworker.0 Request processed in 88us (3639us total) trans 0 rc 0/0 00000100:00100000:0.0:1788684528.260919:0:23765:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1788684528.260942:0:23765:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1788684528.260949:0:23765:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6648598e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3625:x1875571085915392:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788684528.260977:0:23765:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6648598e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3625:x1875571085915392:12345-0@lo:400:kworker.0 Request processed in 30us (3667us total) trans 0 rc 0/0 00000100:00100000:0.0:1788684528.260983:0:23765:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1788684528.261137:0:22734:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1788684528.261145:0:22734:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6648598000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3624:x1875571085915776:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788684528.261180:0:22734:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6648598000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3624:x1875571085915776:12345-0@lo:400:kworker.0 Request processed in 36us (4009us total) trans 0 rc 0/0 00000100:00100000:2.0:1788684528.261186:0:22734:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1788684528.261237:0:3625:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d664859b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3625:1875571085915520:0@lo:400:kworker.0 00010000:00080000:2.0:1788684528.261252:0:3625:0:(ldlm_request.c:1670:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d664859bb80 x1875571085915392/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788684544 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788684528.261263:0:3625:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d664859bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3625:1875571085915392:0@lo:400:kworker.0 00010000:00080000:2.0:1788684528.261300:0:3624:0:(ldlm_request.c:1670:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d6648599880 x1875571085915648/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788684544 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788684528.261309:0:3624:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6648599880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3624:1875571085915648:0@lo:400:kworker.0 00000100:00100000:2.0:1788684528.261320:0:3624:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d664859ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3624:1875571085915264:0@lo:400:kworker.0 00010000:00080000:2.0:1788684528.261329:0:3624:0:(ldlm_request.c:1670:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d6648598700 x1875571085915776/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788684544 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788684528.261349:0:3624:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6648598700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3624:1875571085915776:0@lo:400:kworker.0 00000100:00100000:1.0:1788684528.264495:0:22733:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1788684528.264508:0:22733:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d664859a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3625:x1875571085915904:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788684528.264593:0:22733:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d664859a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3625:x1875571085915904:12345-0@lo:400:kworker.0 Request processed in 88us (7252us total) trans 0 rc 0/0 00000100:00100000:1.0:1788684528.264601:0:22733:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1788684528.264633:0:22726:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085915136 00000100:00100000:1.0:1788684528.264640:0:22726:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085915136 00000100:00100000:1.0:1788684528.264666:0:22726:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:1.0:1788684528.264673:0:22726:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d677ccdc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cebd1789-51a4-46ff-b167-6b1633e930a1+21:3624:x1875571085915136:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788684528.264708:0:22726:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d677ccdc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cebd1789-51a4-46ff-b167-6b1633e930a1+21:3624:x1875571085915136:12345-0@lo:400:kworker.0 Request processed in 35us (7475us total) trans 0 rc 0/0 00000100:00100000:1.0:1788684528.264714:0:22726:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00080000:2.0:1788684528.264927:0:22728:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1788684528.264933:0:22728:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:2.0:1788684528.264969:0:3625:0:(ldlm_request.c:1670:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d664859b800 x1875571085915904/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788684544 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788684528.264985:0:3625:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d664859b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3625:1875571085915904:0@lo:400:kworker.0 00000100:00100000:2.0:1788684528.265023:0:3624:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d664859b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:cebd1789-51a4-46ff-b167-6b1633e930a1:3624:1875571085915136:0@lo:400:kworker.0 00010000:00010000:0.0:1788684528.319191:0:22721:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788684528.957986:0:22768:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1788684529.344172:0:22720:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1788684529.489801:0:24603:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg644-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000100:00100000:3.0:1788684529.792865:0:3626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6647908700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3626:1875571085916032:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788684529.792932:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788684529.792985:0:22737:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085916032 00000100:00100000:3.0:1788684529.792992:0:22737:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085916032 00000100:00100000:3.0:1788684529.793037:0:22737:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1788684529.793046:0:22737:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d664790bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3626:x1875571085916032:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1788684529.793100:0:22737:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:3.0:1788684529.793145:0:22737:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d664790bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3626:x1875571085916032:12345-0@lo:41:osp-pre-1-0.0 Request processed in 100us (212us total) trans 0 rc 0/0 00000100:00100000:3.0:1788684529.793153:0:22737:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1788684529.793213:0:3626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6647908700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3626:1875571085916032:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788684529.793274:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6647908700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3623:1875571085916160:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788684529.793297:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788684529.793326:0:22738:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085916160 00000100:00100000:3.0:1788684529.793329:0:22738:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085916160 00000100:00100000:3.0:1788684529.793350:0:22738:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1788684529.793357:0:22738:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d664790a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3623:x1875571085916160:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1788684529.793405:0:22738:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446309888 avail 1300070400 00000100:00100000:3.0:1788684529.793439:0:22738:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d664790a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3623:x1875571085916160:12345-0@lo:41:osp-pre-0-1.0 Request processed in 83us (141us total) trans 0 rc 0/0 00000100:00100000:3.0:1788684529.793446:0:22738:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1788684529.793472:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6647908700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3623:1875571085916160:0@lo:41:osp-pre-0-1.0 00010000:00010000:3.0:1788684530.367075:0:22721:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:2.0:1788684530.568803:0:24655:0:(tgt_mount.c:2350:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1788684530.569054:0:24655:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1788684531.392415:0:22720:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1788684531.652767:0:23489:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000020:00000004:0.0:1788684531.849319:0:24706:0:(tgt_mount.c:2350:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1788684531.851089:0:24706:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:3.0:1788684532.415731:0:22721:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788684533.309649:0:3622:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788684518/real 1788684518] req@ffff8d677fb45880 x1875571085909120/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788684533 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788684533.309689:0:3622:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8d677fb45880 x1875571085909120/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788684533 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788684533.309700:0:3622:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788684518/real 1788684518] req@ffff8d67450b0e00 x1875571085909248/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788684533 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788684533.309712:0:3622:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8d67450b0e00 x1875571085909248/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788684533 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788684533.309736:0:3622:0:(import.c:65:import_set_state_nolock()) ffff8d6751b75000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788684533.309767:0:3622:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:0.0:1788684533.309772:0:3622:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d677fb45880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3622:1875571085909120:0@lo:8:kworker.0 00000100:00080000:0.0:1788684533.309779:0:3622:0:(import.c:65:import_set_state_nolock()) ffff8d677cc6b000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788684533.309784:0:3622:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:0.0:1788684533.309788:0:3622:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d67450b0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3622:1875571085909248:0@lo:8:kworker.0 00000100:00080000:1.0:1788684533.314260:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788684533.314268:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788684533.314271:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788684533.314274:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788684533.314294:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788684533.314297:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:1.0:1788684533.314302:0:38:0:(import.c:65:import_set_state_nolock()) ffff8d6751b75000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788684533.314312:0:38:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 599 00000100:00080000:1.0:1788684533.314319:0:38:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-MDT0001: tried all connections, increasing latency to 10s 00000100:00080000:1.0:1788684533.314335:0:38:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff8d6751b75000 using connection 192.168.206.144@tcp/0@lo 00000100:00100000:1.0:1788684533.314395:0:38:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8d674698ed80 x1875571085916800/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788684533.314414:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788684533.314417:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1788684533.314419:0:38:0:(import.c:65:import_set_state_nolock()) ffff8d677cc6b000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788684533.314422:0:38:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 599 00000100:00080000:1.0:1788684533.314425:0:38:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 10s 00000100:00080000:1.0:1788684533.314428:0:38:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff8d677cc6b000 using connection 192.168.206.144@tcp/0@lo 00000100:00100000:1.0:1788684533.314441:0:38:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8d674698e680 x1875571085916928/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788684533.314510:0:3625:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d674698e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3625:1875571085916416:0@lo:400:kworker.0 00000100:00100000:1.0:1788684533.314597:0:3625:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788684533.314665:0:3625:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d674698d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3625:1875571085917184:0@lo:400:kworker.0 00000100:00100000:1.0:1788684533.314702:0:3625:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788684533.314728:0:3625:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1788684533.314734:0:3625:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d674698f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3625:1875571085916544:0@lo:400:kworker.0 00000100:00100000:1.0:1788684533.314755:0:3625:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788684533.314773:0:3625:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d674698c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3625:1875571085917312:0@lo:400:kworker.0 00000100:00100000:1.0:1788684533.314795:0:3625:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788684533.314833:0:24164:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085916416 00000100:00100000:1.0:1788684533.314842:0:24164:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085916416 00000100:00100000:1.0:1788684533.314900:0:24164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1788684533.314910:0:24164:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d674698f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3625:x1875571085916416:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788684533.314968:0:24164:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d674698f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3625:x1875571085916416:12345-0@lo:400:kworker.0 Request processed in 59us (371us total) trans 0 rc 0/0 00000100:00100000:1.0:1788684533.314983:0:24164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1788684533.315133:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d674698df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3623:1875571085916672:0@lo:400:kworker.0 00000100:00100000:0.0:1788684533.315169:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788684533.315196:0:3623:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1788684533.315203:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d674698ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:cebd1789-51a4-46ff-b167-6b1633e930a1:3623:1875571085916288:0@lo:400:kworker.0 00000100:00100000:0.0:1788684533.315235:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788684533.315272:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d674698dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3623:1875571085917056:0@lo:400:kworker.0 00000100:00100000:0.0:1788684533.315296:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788684533.315324:0:23765:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085917184 00000100:00100000:0.0:1788684533.315327:0:23765:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085917184 00000100:00100000:0.0:1788684533.315362:0:23765:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085916544 00000100:00100000:0.0:1788684533.315381:0:23765:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085916544 00000100:00100000:0.0:1788684533.315396:0:23765:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085917312 00000100:00100000:0.0:1788684533.315399:0:23765:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085917312 00000100:00100000:0.0:1788684533.315411:0:23765:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085917056 00000100:00100000:0.0:1788684533.315413:0:23765:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085917056 00000100:00100000:0.0:1788684533.315424:0:23765:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1788684533.315431:0:23765:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d674698ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3625:x1875571085917184:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788684533.315466:0:23765:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d674698ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3625:x1875571085917184:12345-0@lo:400:kworker.0 Request processed in 35us (763us total) trans 0 rc 0/0 00000100:00100000:0.0:1788684533.315472:0:23765:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1788684533.315485:0:23765:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1788684533.315491:0:23765:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d677fab7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3625:x1875571085916544:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788684533.315518:0:23765:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d677fab7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3625:x1875571085916544:12345-0@lo:400:kworker.0 Request processed in 27us (761us total) trans 0 rc 0/0 00000100:00100000:0.0:1788684533.315524:0:23765:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1788684533.315535:0:23765:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1788684533.315541:0:23765:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d677fab5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3625:x1875571085917312:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788684533.315568:0:23765:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d677fab5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3625:x1875571085917312:12345-0@lo:400:kworker.0 Request processed in 28us (772us total) trans 0 rc 0/0 00000100:00100000:0.0:1788684533.315574:0:23765:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1788684533.315583:0:23765:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1788684533.315588:0:23765:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67450b0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3623:x1875571085917056:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788684533.315632:0:23765:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67450b0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3623:x1875571085917056:12345-0@lo:400:kworker.0 Request processed in 43us (335us total) trans 0 rc 0/0 00000100:00100000:0.0:1788684533.315640:0:23765:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1788684533.315658:0:22737:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085916672 00000100:00100000:0.0:1788684533.315662:0:22737:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085916672 00000100:00080000:2.0:1788684533.317066:0:22728:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1788684533.317076:0:22728:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788684533.320765:0:22737:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1788684533.320791:0:22737:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67450b0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3623:x1875571085916672:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788684533.320914:0:22737:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67450b0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3623:x1875571085916672:12345-0@lo:400:kworker.0 Request processed in 134us (5742us total) trans 0 rc 0/0 00000100:00100000:0.0:1788684533.320922:0:22737:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1788684533.320963:0:22725:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085916288 00000100:00100000:0.0:1788684533.320973:0:22725:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085916288 00000100:00100000:2.0:1788684533.324967:0:3622:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d674698ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3622:1875571085916800:0@lo:8:kworker.0 00000100:00100000:2.0:1788684533.325095:0:3622:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788684533.325158:0:3622:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d674698e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3622:1875571085916928:0@lo:8:kworker.0 00000100:00100000:2.0:1788684533.325184:0:3622:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788684533.327170:0:24240:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085916800 00000100:00100000:1.0:1788684533.327191:0:24240:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085916800 00000100:00100000:1.0:1788684533.327241:0:24240:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085916928 00000100:00100000:1.0:1788684533.327245:0:24240:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085916928 00000100:00100000:1.0:1788684533.327264:0:24240:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788684533.327273:0:24240:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d664859b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3622:x1875571085916800:12345-0@lo:8:kworker.0 00010000:00080000:1.0:1788684533.327313:0:24240:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 614 last 0 00000020:00000080:1.0:1788684533.327353:0:24240:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x44bac02bd54adf7d 00002000:00100000:1.0:1788684533.327392:0:24240:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0001-mdtlov_UUID/ffff8d6646624800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a02 ocd_grant: 0 ocd_index: 0 ocd_group 1 00002000:00080000:1.0:1788684533.327397:0:24240:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 1 00002000:00100000:1.0:1788684533.327400:0:24240:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:1.0:1788684533.327625:0:24240:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 1 00000100:00080000:1.0:1788684533.327655:0:24240:0:(import.c:65:import_set_state_nolock()) ffff8d6646622800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788684533.327765:0:24240:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d664859b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+6:3622:x1875571085916800:12345-0@lo:8:kworker.0 Request processed in 492us (2670us total) trans 0 rc 0/0 00000100:00100000:1.0:1788684533.327774:0:24240:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788684533.327795:0:24240:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788684533.327799:0:24240:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d664859b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3622:x1875571085916928:12345-0@lo:8:kworker.0 00010000:00020000:1.0:1788684533.327814:0:24240:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00010000:00080000:0.0:1788684533.336029:0:3623:0:(ldlm_request.c:1670:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d674698dc00 x1875571085917056/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788684549 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788684533.336064:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d674698dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3623:1875571085917056:0@lo:400:kworker.0 00000100:00100000:0.0:1788684533.336085:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d674698df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3623:1875571085916672:0@lo:400:kworker.0 00000100:00100000:0.0:1788684533.336136:0:22725:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:0.0:1788684533.336155:0:22725:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d677ccdfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cebd1789-51a4-46ff-b167-6b1633e930a1+21:3623:x1875571085916288:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788684533.336278:0:22725:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d677ccdfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cebd1789-51a4-46ff-b167-6b1633e930a1+21:3623:x1875571085916288:12345-0@lo:400:kworker.0 Request processed in 132us (21041us total) trans 0 rc 0/0 00000100:00100000:0.0:1788684533.336286:0:22725:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:0.0:1788684533.336340:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d674698ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:cebd1789-51a4-46ff-b167-6b1633e930a1:3623:1875571085916288:0@lo:400:kworker.0 00010000:00080000:0.0:1788684533.336447:0:3625:0:(ldlm_request.c:1670:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d674698f480 x1875571085916544/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788684549 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788684533.336478:0:3625:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d674698f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3625:1875571085916544:0@lo:400:kworker.0 00010000:00080000:0.0:1788684533.336516:0:3625:0:(ldlm_request.c:1670:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d674698c700 x1875571085917312/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788684549 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788684533.336526:0:3625:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d674698c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3625:1875571085917312:0@lo:400:kworker.0 00000100:00100000:0.0:1788684533.336541:0:3625:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d674698e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3625:1875571085916416:0@lo:400:kworker.0 00010000:00080000:0.0:1788684533.336555:0:3625:0:(ldlm_request.c:1670:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d674698d880 x1875571085917184/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788684549 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788684533.336564:0:3625:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d674698d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3625:1875571085917184:0@lo:400:kworker.0 00010000:00080000:2.0:1788684533.338214:0:3622:0:(ldlm_request.c:1670:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d674698ed80 x1875571085916800/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788684553 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788684533.338230:0:3622:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:2.0:1788684533.338244:0:3622:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0001: connect to target with instance 3 00000100:00080000:2.0:1788684533.338255:0:3622:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0001: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:2.0:1788684533.338262:0:3622:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:2.0:1788684533.338266:0:3622:0:(import.c:65:import_set_state_nolock()) ffff8d6751b75000 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:2.0:1788684533.338291:0:3622:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:2.0:1788684533.338298:0:3622:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d674698ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3622:1875571085916800:0@lo:8:kworker.0 00000004:00080000:0.0:1788684533.339770:0:23473:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0001: going to cleanup orphans since [0x280000400:0x1:0x0] 00000100:00100000:0.0:1788684533.339821:0:23473:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d67450b1f80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:23473:1875571085917568:0@lo:7:osp-pre-0-1.0 00000100:00100000:2.0:1788684533.340276:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d67450b0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3623:1875571085917440:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788684533.340318:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788684533.340849:0:24242:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085917440 00000100:00100000:3.0:1788684533.340858:0:24242:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085917440 00000100:00100000:0.0:1788684533.340966:0:23473:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788684533.340995:0:23473:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d677708f9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788684533.341029:0:24241:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:0.0:1788684533.341038:0:24241:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_003' 00000100:00100000:0.0:1788684533.341179:0:24241:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085917568 00000100:00100000:0.0:1788684533.341183:0:24241:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085917568 00000100:00100000:0.0:1788684533.341314:0:24763:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788684533.341325:0:24763:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67450b1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+7:23473:x1875571085917568:12345-0@lo:7:osp-pre-0-1.0 00000100:00100000:3.0:1788684533.341811:0:24242:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788684533.341822:0:24242:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6648598700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+7:3623:x1875571085917440:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1788684533.341845:0:24242:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923513344 avail 3691991040 00000100:00100000:3.0:1788684533.341942:0:24242:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6648598700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+7:3623:x1875571085917440:12345-0@lo:13:osp-pre-0-1.0 Request processed in 122us (1622us total) trans 0 rc 0/0 00000100:00100000:3.0:1788684533.341962:0:24242:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00080000:2.0:1788684533.357316:0:22728:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1788684533.357412:0:3623:0:(ldlm_request.c:1670:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d67450b0700 x1875571085917440/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788684549 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788684533.357445:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d67450b0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3623:1875571085917440:0@lo:13:osp-pre-0-1.0 00002000:00080000:0.0:1788684533.357812:0:24763:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x280000400 00002000:00080000:0.0:1788684533.357824:0:24763:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0000: LAST FID is [0x280000400:0x41:0x0] 00000100:00100000:0.0:1788684533.357938:0:24763:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67450b1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:23473:x1875571085917568:12345-0@lo:7:osp-pre-0-1.0 Request processed in 16601us (16957us total) trans 0 rc 0/0 00000100:00100000:0.0:1788684533.357949:0:24763:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:2.0:1788684533.358133:0:23473:0:(ldlm_request.c:1670:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d67450b1f80 x1875571085917568/t0(0) o7->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 264/240 e 0 to 0 dl 1788684549 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788684533.358147:0:23473:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d67450b1f80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:23473:1875571085917568:0@lo:7:osp-pre-0-1.0 00000004:00080000:2.0:1788684533.358160:0:23473:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0000-osc-MDT0001: Got last_fid [0x280000400:0x41:0x0] 00000100:00100000:2.0:1788684533.358207:0:23473:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d664859ad80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:23473:1875571085917696:0@lo:5:osp-pre-0-1.0 00000100:00100000:2.0:1788684533.358268:0:23473:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788684533.358304:0:23473:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d6775ea73c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788684533.358328:0:24241:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085917696 00000100:00100000:0.0:1788684533.358353:0:24241:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085917696 00000100:00100000:0.0:1788684533.358508:0:24241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788684533.358517:0:24241:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6648599880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+6:23473:x1875571085917696:12345-0@lo:5:osp-pre-0-1.0 00002000:00080000:0.0:1788684533.358547:0:24241:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 65 -> diff = 0 00000100:00100000:0.0:1788684533.358663:0:24241:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6648599880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+6:23473:x1875571085917696:12345-0@lo:5:osp-pre-0-1.0 Request processed in 146us (393us total) trans 0 rc 0/0 00000100:00100000:0.0:1788684533.358670:0:24241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:2.0:1788684533.358883:0:23473:0:(ldlm_request.c:1670:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d664859ad80 x1875571085917696/t0(0) o5->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788684549 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788684533.358896:0:23473:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d664859ad80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:23473:1875571085917696:0@lo:5:osp-pre-0-1.0 00000004:00080000:2.0:1788684533.358907:0:23473:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0001: Got last_id [0x280000400:0x41:0x0] from OST, last_created [0x280000400:0x41:0x0]last_used is [0x280000400:0x41:0x0] 00000100:00100000:2.0:1788684533.358946:0:23473:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d664859ad80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:23473:1875571085917824:0@lo:5:osp-pre-0-1.0 00000100:00100000:2.0:1788684533.358976:0:23473:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788684533.359025:0:24763:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085917824 00000100:00100000:0.0:1788684533.359032:0:24763:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085917824 00000100:00100000:2.0:1788684533.359087:0:23473:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d6775ea73c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788684533.359217:0:24763:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788684533.359231:0:24763:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d664859bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:23473:x1875571085917824:12345-0@lo:5:osp-pre-0-1.0 00002000:00080000:0.0:1788684533.359264:0:24763:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000400 at 66 00000004:00080000:2.0:1788684533.369443:0:23472:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:2.0:1788684533.369591:0:23472:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 614363224237ns, next at 0ns, rc = 0 00080000:00080000:2.0:1788684533.369600:0:23472:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0001: async commit OSD 00000004:00080000:0.0:1788684533.372203:0:23464:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 1 committed 00000100:00100000:1.0:1788684533.382883:0:24240:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d664859b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3622:x1875571085916928:12345-0@lo:8:kworker.0 Request processed in 55071us (57686us total) trans 0 rc -19/-19 00000100:00100000:1.0:1788684533.382901:0:24240:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00080000:2.0:1788684533.388573:0:3622:0:(import.c:65:import_set_state_nolock()) ffff8d677cc6b000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788684533.388587:0:3622:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1788684533.388593:0:3622:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d674698e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3622:1875571085916928:0@lo:8:kworker.0 00000001:00080000:1.0:1788684533.403159:0:24235:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 12884901889 is committed 00000001:00100000:1.0:1788684533.403179:0:24235:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000100:00100000:0.0:1788684533.403690:0:24763:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d664859bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:23473:x1875571085917824:12345-0@lo:5:osp-pre-0-1.0 Request processed in 44458us (44705us total) trans 12884901889 rc 0/0 00000100:00100000:0.0:1788684533.403704:0:24763:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:2.0:1788684533.408158:0:23473:0:(ldlm_request.c:1670:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d664859ad80 x1875571085917824/t0(0) o5->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788684549 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788684533.408176:0:23473:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 12884901889 gen 2 00000100:00100000:2.0:1788684533.408183:0:23473:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d664859ad80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:23473:1875571085917824:0@lo:5:osp-pre-0-1.0 00000004:00080000:2.0:1788684533.408203:0:23473:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0001: current precreated pool: [0x280000400:0x41:0x0]-[0x280000400:0x61:0x0] 00000100:00100000:0.0:1788684533.408960:0:23473:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d67450b3b80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0000-lwp-MDT0001_UUID:23473:1875571085917952:0@lo:900:osp-pre-0-1.0 00000100:00100000:0.0:1788684533.409063:0:23473:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788684533.409098:0:23473:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d677708fa80 going to sleep for 11 seconds 00000100:00100000:2.0:1788684533.409193:0:22744:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085917952 00000100:00100000:2.0:1788684533.409201:0:22744:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085917952 00000100:00100000:2.0:1788684533.409256:0:22744:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788684533.409265:0:22744:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67450b1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:23473:x1875571085917952:12345-0@lo:900:osp-pre-0-1.0 00000100:00100000:2.0:1788684533.409330:0:22744:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67450b1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:23473:x1875571085917952:12345-0@lo:900:osp-pre-0-1.0 Request processed in 66us (276us total) trans 0 rc 0/0 00000100:00100000:2.0:1788684533.409337:0:22744:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:2.0:1788684533.409393:0:23473:0:(ldlm_request.c:1670:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d67450b3b80 x1875571085917952/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1788684549 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788684533.409405:0:23473:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d67450b3b80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0000-lwp-MDT0001_UUID:23473:1875571085917952:0@lo:900:osp-pre-0-1.0 00010000:00010000:1.0:1788684533.439711:0:22720:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788684534.462640:0:22721:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788684534.909597:0:3623:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788684534.909627:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6647908700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3623:1875571085918080:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788684534.909704:0:3625:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d664859ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3625:1875571085918208:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788684534.909736:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788684534.909810:0:22737:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085918080 00000100:00100000:0.0:1788684534.909820:0:22737:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085918080 00000100:00100000:0.0:1788684534.909882:0:22737:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1788684534.909891:0:22737:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6647908000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3623:x1875571085918080:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1788684534.909935:0:22737:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446309888 avail 1300070400 00000100:00100000:0.0:1788684534.910000:0:22737:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6647908000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3623:x1875571085918080:12345-0@lo:41:osp-pre-0-1.0 Request processed in 109us (265us total) trans 0 rc 0/0 00000100:00100000:0.0:1788684534.910007:0:22737:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1788684534.910097:0:3625:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788684534.910184:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6647908700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3623:1875571085918080:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788684534.910187:0:24164:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085918208 00000100:00100000:0.0:1788684534.910193:0:24164:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085918208 00000100:00100000:0.0:1788684534.910229:0:24164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1788684534.910287:0:24164:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d664859b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3625:x1875571085918208:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1788684534.910309:0:24164:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:0.0:1788684534.910356:0:24164:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d664859b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3625:x1875571085918208:12345-0@lo:41:osp-pre-1-0.0 Request processed in 120us (259us total) trans 0 rc 0/0 00000100:00100000:0.0:1788684534.910363:0:24164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1788684534.910429:0:3625:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d664859ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3625:1875571085918208:0@lo:41:osp-pre-1-0.0 00010000:00010000:0.0:1788684535.488330:0:22720:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788684536.511491:0:22721:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788684537.542163:0:22720:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1788684538.178684:0:22768:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00080000:2.0:1788684538.495291:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788684538.495297:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1788684538.495300:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788684538.495303:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1788684538.495332:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788684538.495335:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1788684538.495338:0:38:0:(import.c:65:import_set_state_nolock()) ffff8d677cc6b000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788684538.495346:0:38:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 614 00000100:00080000:2.0:1788684538.495361:0:38:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 15s 00000100:00080000:2.0:1788684538.495387:0:38:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff8d677cc6b000 using connection 192.168.206.144@tcp/0@lo 00000100:00100000:2.0:1788684538.495410:0:38:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8d6648667800 x1875571085918976/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788684538.495464:0:3626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d664859ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:cebd1789-51a4-46ff-b167-6b1633e930a1:3626:1875571085918336:0@lo:400:kworker.0 00000100:00100000:2.0:1788684538.495925:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788684538.495976:0:3626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6648665500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3626:1875571085918848:0@lo:400:kworker.0 00000100:00100000:2.0:1788684538.496005:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788684538.496089:0:3626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d677fab6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3626:1875571085919488:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788684538.496114:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788684538.496134:0:3626:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:2.0:1788684538.496140:0:3626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6648664700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3626:1875571085918720:0@lo:400:kworker.0 00000100:00100000:2.0:1788684538.496164:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788684538.496182:0:3626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6648664e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3626:1875571085919360:0@lo:400:kworker.0 00000100:00100000:2.0:1788684538.496202:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788684538.496230:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6648665880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3623:1875571085918464:0@lo:400:kworker.0 00000100:00100000:2.0:1788684538.496266:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788684538.496284:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6648666d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3623:1875571085919104:0@lo:400:kworker.0 00000100:00100000:2.0:1788684538.496301:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788684538.496319:0:3623:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1788684538.496332:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6648666680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3623:1875571085918592:0@lo:400:kworker.0 00000100:00100000:2.0:1788684538.496584:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788684538.496610:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6648667480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3623:1875571085919232:0@lo:400:kworker.0 00000100:00100000:2.0:1788684538.496633:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788684538.496671:0:3622:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6648667800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3622:1875571085918976:0@lo:8:kworker.0 00000100:00100000:2.0:1788684538.496697:0:3622:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788684538.496740:0:24241:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085918848 00000100:00100000:2.0:1788684538.496748:0:24241:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085918848 00000100:00100000:2.0:1788684538.496801:0:24241:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085918976 00000100:00100000:2.0:1788684538.496805:0:24241:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085918976 00000100:00100000:2.0:1788684538.496834:0:24241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788684538.496844:0:24241:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6648665c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3626:x1875571085918848:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788684538.496894:0:24241:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6648665c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3626:x1875571085918848:12345-0@lo:400:kworker.0 Request processed in 53us (888us total) trans 0 rc 0/0 00000100:00100000:2.0:1788684538.496901:0:24241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788684538.496917:0:24241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788684538.496921:0:24241:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6648667100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3622:x1875571085918976:12345-0@lo:8:kworker.0 00010000:00020000:2.0:1788684538.496940:0:24241:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1788684538.496971:0:24241:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6648667100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3622:x1875571085918976:12345-0@lo:8:kworker.0 Request processed in 48us (273us total) trans 0 rc -19/-19 00000100:00100000:2.0:1788684538.496977:0:24241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788684538.496999:0:24243:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085919488 00000100:00100000:2.0:1788684538.497002:0:24243:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085919488 00000100:00100000:2.0:1788684538.497022:0:24243:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788684538.497040:0:24243:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6648667b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3626:x1875571085919488:12345-0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788684538.497144:0:22727:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085918336 00000100:00100000:1.0:1788684538.497148:0:22727:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085918336 00000100:00100000:1.0:1788684538.497178:0:22727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:1.0:1788684538.497185:0:22727:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d677ccdc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cebd1789-51a4-46ff-b167-6b1633e930a1+21:3626:x1875571085918336:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788684538.497222:0:22727:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d677ccdc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cebd1789-51a4-46ff-b167-6b1633e930a1+21:3626:x1875571085918336:12345-0@lo:400:kworker.0 Request processed in 37us (1297us total) trans 0 rc 0/0 00000100:00100000:1.0:1788684538.497228:0:22727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:3.0:1788684538.497561:0:22733:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085919360 00000100:00100000:3.0:1788684538.497567:0:22733:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085919360 00000100:00100000:3.0:1788684538.497601:0:22733:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085919104 00000100:00100000:3.0:1788684538.497604:0:22733:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085919104 00000100:00100000:3.0:1788684538.497618:0:22733:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085918592 00002000:00000024:2.0:1788684538.497618:0:24243:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923513344 avail 3691991040 00000100:00100000:3.0:1788684538.497621:0:22733:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085918592 00000100:00100000:3.0:1788684538.497630:0:22733:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085919232 00000100:00100000:3.0:1788684538.497634:0:22733:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085919232 00000100:00100000:3.0:1788684538.497651:0:22733:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1788684538.497658:0:22733:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6648666300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3626:x1875571085919360:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788684538.497697:0:22733:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6648666300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3626:x1875571085919360:12345-0@lo:400:kworker.0 Request processed in 40us (1493us total) trans 0 rc 0/0 00000100:00100000:3.0:1788684538.497704:0:22733:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1788684538.497717:0:22733:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1788684538.497725:0:22733:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6648664000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3623:x1875571085919104:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788684538.497740:0:24243:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6648667b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3626:x1875571085919488:12345-0@lo:13:osp-pre-0-1.0 Request processed in 698us (1622us total) trans 0 rc 0/0 00000100:00100000:2.0:1788684538.497749:0:24243:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00080000:2.0:1788684538.497774:0:22728:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788684538.497779:0:22733:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6648664000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3623:x1875571085919104:12345-0@lo:400:kworker.0 Request processed in 53us (1473us total) trans 0 rc 0/0 00000100:00080000:2.0:1788684538.497780:0:22728:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1788684538.497785:0:22728:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788684538.497791:0:22733:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1788684538.497807:0:22733:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1788684538.497815:0:22733:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6648664a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3623:x1875571085918592:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788684538.497859:0:22733:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6648664a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3623:x1875571085918592:12345-0@lo:400:kworker.0 Request processed in 45us (1342us total) trans 0 rc 0/0 00000100:00100000:3.0:1788684538.497867:0:22733:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1788684538.497884:0:22733:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1788684538.497891:0:22733:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6648665f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3623:x1875571085919232:12345-0@lo:400:kworker.0 00000100:00080000:2.0:1788684538.497902:0:3622:0:(import.c:65:import_set_state_nolock()) ffff8d677cc6b000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788684538.497909:0:3622:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1788684538.497914:0:3622:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6648667800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3622:1875571085918976:0@lo:8:kworker.0 00000100:00100000:3.0:1788684538.497926:0:22733:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6648665f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3623:x1875571085919232:12345-0@lo:400:kworker.0 Request processed in 35us (1291us total) trans 0 rc 0/0 00000100:00100000:3.0:1788684538.497934:0:22733:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00010000:00080000:2.0:1788684538.497956:0:3626:0:(ldlm_request.c:1670:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d6648664e00 x1875571085919360/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788684554 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788684538.497968:0:3626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6648664e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3626:1875571085919360:0@lo:400:kworker.0 00010000:00080000:2.0:1788684538.497981:0:3626:0:(ldlm_request.c:1670:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d677fab6300 x1875571085919488/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788684554 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788684538.497982:0:22737:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085918720 00000100:00100000:3.0:1788684538.497988:0:22737:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085918720 00000100:00100000:2.0:1788684538.498001:0:3626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d677fab6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3626:1875571085919488:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788684538.498014:0:3626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d664859ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:cebd1789-51a4-46ff-b167-6b1633e930a1:3626:1875571085918336:0@lo:400:kworker.0 00000100:00100000:3.0:1788684538.498015:0:22737:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085918464 00000100:00100000:3.0:1788684538.498020:0:22737:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085918464 00000100:00100000:3.0:1788684538.498049:0:22737:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1788684538.498054:0:22737:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6648664380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3626:x1875571085918720:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788684538.498074:0:22738:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1788684538.498086:0:22738:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6648665180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3623:x1875571085918464:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788684538.498093:0:22737:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6648664380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3626:x1875571085918720:12345-0@lo:400:kworker.0 Request processed in 37us (1927us total) trans 0 rc 0/0 00000100:00100000:3.0:1788684538.498100:0:22737:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1788684538.498131:0:22738:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6648665180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3623:x1875571085918464:12345-0@lo:400:kworker.0 Request processed in 47us (1862us total) trans 0 rc 0/0 00000100:00100000:1.0:1788684538.498138:0:22738:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00010000:00080000:1.0:1788684538.498169:0:3623:0:(ldlm_request.c:1670:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d6648666680 x1875571085918592/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788684554 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788684538.498179:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6648666680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3623:1875571085918592:0@lo:400:kworker.0 00010000:00080000:1.0:1788684538.498189:0:3623:0:(ldlm_request.c:1670:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d6648667480 x1875571085919232/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788684554 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788684538.498196:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6648667480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3623:1875571085919232:0@lo:400:kworker.0 00000100:00100000:1.0:1788684538.498206:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6648665880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3623:1875571085918464:0@lo:400:kworker.0 00010000:00080000:1.0:1788684538.498216:0:3623:0:(ldlm_request.c:1670:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d6648666d80 x1875571085919104/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788684554 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788684538.498223:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6648666d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3623:1875571085919104:0@lo:400:kworker.0 00010000:00080000:2.0:1788684538.498749:0:3626:0:(ldlm_request.c:1670:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d6648665500 x1875571085918848/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788684554 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788684538.498760:0:3626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6648665500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3626:1875571085918848:0@lo:400:kworker.0 00000100:00100000:2.0:1788684538.498790:0:3626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6648664700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3626:1875571085918720:0@lo:400:kworker.0 00010000:00010000:2.0:1788684538.560485:0:22721:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:1.0:1788684539.217491:0:25053:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:1.0:1788684539.217495:0:25053:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/ost2_flakey 00000020:01000004:1.0:1788684539.217496:0:25053:0:(obd_mount.c:929:lmd_print()) options: errors=remount-ro 00000080:01200004:1.0:1788684539.217605:0:25053:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff8d6646627000 00000020:01000004:1.0:1788684539.217620:0:25053:0:(tgt_mount.c:2506:osd_start()) Attempting to start lustre-OST0001, type=osd-ldiskfs, lsifl=200002, mountfl=0 00000020:01000004:1.0:1788684539.217634:0:25053:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-ldiskfs) 00000020:00000080:1.0:1788684539.217658:0:25053:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffff8d6648634d40) 00000020:00000080:1.0:1788684539.217681:0:25053:0:(obd_config.c:720:class_attach_name()) OBD: dev 25 attached type osd-ldiskfs with refcount 2 00100000:10000000:3.0:1788684539.305433:0:25053:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:3.0:1788684539.308249:0:25053:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:3.0:1788684539.308898:0:25053:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:3.0:1788684539.309297:0:25053:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/32) registered 00100000:10000000:3.0:1788684539.309812:0:25053:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:3.0:1788684539.310160:0:25053:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000003:0x4:0x0] (8/32) registered 00100000:10000000:3.0:1788684539.310431:0:25053:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000003:0x5:0x0] (8/32) registered 00080000:01000000:3.0:1788684539.318544:0:25053:0:(osd_lproc.c:911:osd_procfs_init()) lustre-OST0001: register osd-ldiskfs tunable parameters 00000020:00000080:3.0:1788684539.319148:0:25053:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:3.0:1788684539.319164:0:25053:0:(osd_handler.c:8924:osd_obd_connect()) connect #0 00000020:00000080:3.0:1788684539.319182:0:25053:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x44bac02bd54adf8b 00000020:01000004:3.0:1788684539.319191:0:25053:0:(tgt_mount.c:2591:server_fill_super()) Found service lustre-OST0001 on device /dev/mapper/ost2_flakey 00000020:01000004:3.0:1788684539.319214:0:25053:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.206.144@tcp:Set MGC reconnect 1 10000000:01000000:3.0:1788684539.319218:0:25053:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.206.144@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:3.0:1788684539.319225:0:25053:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-OST0001 00000020:01000004:3.0:1788684539.319255:0:25053:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/ost2_flakey 10000000:01000000:3.0:1788684539.319259:0:25053:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.206.144@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00000040:01000000:2.0:1788684539.344746:0:25053:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.206.144@tcp ctxt 0 is initialized 00000020:01000004:2.0:1788684539.344795:0:25053:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.206.144@tcp, index=0001, flags=0x20002 00000020:01000004:2.0:1788684539.344801:0:25053:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1788684539.344808:0:25053:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1788684539.344809:0:25053:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788684539.344810:0:25053:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788684539.344812:0:25053:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788684539.344813:0:25053:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788684539.344814:0:25053:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788684539.344816:0:25053:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788684539.344817:0:25053:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1788684539.344820:0:25053:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020002 00000020:01000004:2.0:1788684539.344822:0:25053:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1788684539.344823:0:25053:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1788684539.344824:0:25053:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788684539.344825:0:25053:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788684539.344826:0:25053:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788684539.344827:0:25053:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788684539.344828:0:25053:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788684539.344829:0:25053:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788684539.344830:0:25053:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1788684539.344856:0:25053:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:2.0:1788684539.344875:0:25053:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6648664700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cebd1789-51a4-46ff-b167-6b1633e930a1:25053:1875571085919616:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1788684539.344955:0:25053:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788684539.345003:0:25053:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d6745398480 going to sleep for 11 seconds 00000100:00100000:1.0:1788684539.345049:0:22726:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085919616 00000100:00100000:1.0:1788684539.345057:0:22726:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085919616 00000100:00100000:1.0:1788684539.345117:0:22726:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:1.0:1788684539.345126:0:22726:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6746cac450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cebd1789-51a4-46ff-b167-6b1633e930a1+21:25053:x1875571085919616:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1788684539.345156:0:22726:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:1.0:1788684539.345159:0:22726:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0001 is running on 0@lo 20000000:01000000:1.0:1788684539.345162:0:22726:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:0.0:1788684539.346136:0:22726:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6746cac450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cebd1789-51a4-46ff-b167-6b1633e930a1+21:25053:x1875571085919616:12345-0@lo:253:mount.lustre.0 Request processed in 1009us (1178us total) trans 0 rc 0/0 00000100:00100000:0.0:1788684539.346146:0:22726:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:1.0:1788684539.346318:0:25053:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6648664700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cebd1789-51a4-46ff-b167-6b1633e930a1:25053:1875571085919616:0@lo:253:mount.lustre.0 10000000:01000000:1.0:1788684539.346332:0:25053:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:1.0:1788684539.346335:0:25053:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1788684539.346337:0:25053:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1788684539.346338:0:25053:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788684539.346339:0:25053:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788684539.346340:0:25053:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788684539.346341:0:25053:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788684539.346342:0:25053:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788684539.346344:0:25053:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788684539.346345:0:25053:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:1.0:1788684539.346379:0:25053:0:(tgt_mount.c:101:server_register_mount()) register mount ffff8d6646627000 from lustre-OST0001 10000000:01000000:1.0:1788684539.346406:0:25053:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:1.0:1788684539.346408:0:25053:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:1.0:1788684539.346416:0:25053:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff8d677e3e8000 local copy 00010000:00010000:1.0:1788684539.346426:0:25053:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.144@tcp lock: ffff8d6746d3ea00/0x44bac02bd54adca5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x44bac02bd54adcac expref: -99 pid: 22710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788684539.346541:0:25053:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d677fab7b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cebd1789-51a4-46ff-b167-6b1633e930a1:25053:1875571085919744:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788684539.346586:0:25053:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788684539.346617:0:25053:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d6749001600 going to sleep for 11 seconds 00000100:00100000:0.0:1788684539.346857:0:22725:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085919744 00000100:00100000:0.0:1788684539.346862:0:22725:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085919744 00000100:00100000:0.0:1788684539.346907:0:22725:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:0.0:1788684539.346917:0:22725:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6746cad050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cebd1789-51a4-46ff-b167-6b1633e930a1+21:25053:x1875571085919744:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788684539.347009:0:22725:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6746cad050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cebd1789-51a4-46ff-b167-6b1633e930a1+21:25053:x1875571085919744:12345-0@lo:501:mount.lustre.0 Request processed in 93us (422us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788684539.347017:0:22725:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:1.0:1788684539.347223:0:25053:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d677fab7b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cebd1789-51a4-46ff-b167-6b1633e930a1:25053:1875571085919744:0@lo:501:mount.lustre.0 10000000:01000000:1.0:1788684539.347238:0:25053:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.206.144@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:1.0:1788684539.347256:0:25053:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.206.144@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:1.0:1788684539.347263:0:25053:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.144@tcp lock: ffff8d6746d3ea00/0x44bac02bd54adca5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x44bac02bd54adcac expref: -99 pid: 22710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684539.347271:0:25053:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.144@tcp lock: ffff8d6746d3ea00/0x44bac02bd54adca5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x44bac02bd54adcac expref: -99 pid: 22710 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788684539.347295:0:25053:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff8d6646627000 10000000:01000000:1.0:1788684539.347300:0:25053:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:1.0:1788684539.347306:0:25053:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:1.0:1788684539.347309:0:25053:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1788684539.347312:0:25053:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:1.0:1788684539.347315:0:25053:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:1.0:1788684539.347339:0:25053:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.144@tcp lock: ffff8d6746cb2000/0x44bac02bd54adf92 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 25053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684539.347346:0:25053:0:(ldlm_request.c:1106:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.144@tcp lock: ffff8d6746cb2000/0x44bac02bd54adf92 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 25053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684539.347355:0:25053:0:(ldlm_request.c:1193:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.144@tcp lock: ffff8d6746cb2000/0x44bac02bd54adf92 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 25053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788684539.347410:0:25053:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d677fab7b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cebd1789-51a4-46ff-b167-6b1633e930a1:25053:1875571085919872:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1788684539.347438:0:25053:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788684539.347449:0:25053:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d6749001600 going to sleep for 11 seconds 00000100:00100000:0.0:1788684539.347502:0:22726:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085919872 00000100:00100000:0.0:1788684539.347516:0:22726:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085919872 00000100:00100000:0.0:1788684539.347544:0:22726:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:0.0:1788684539.347550:0:22726:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6746caf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cebd1789-51a4-46ff-b167-6b1633e930a1+21:25053:x1875571085919872:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788684539.347558:0:22726:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788684539.347708:0:22726:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d6746d3fa00/0x44bac02bd54adf99 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x44bac02bd54adf92 expref: -99 pid: 22726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684539.347740:0:22726:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d6746d3fa00/0x44bac02bd54adf99 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x44bac02bd54adf92 expref: 22 pid: 22726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684539.347750:0:22726:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d6746d3fa00/0x44bac02bd54adf99 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x44bac02bd54adf92 expref: 22 pid: 22726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684539.347759:0:22726:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d6746d3fa00, rc 0) 00000100:00100000:0.0:1788684539.349471:0:22726:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6746caf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cebd1789-51a4-46ff-b167-6b1633e930a1+22:25053:x1875571085919872:12345-0@lo:101:mount.lustre.0 Request processed in 1914us (2024us total) trans 0 rc 0/0 00000100:00100000:0.0:1788684539.349483:0:22726:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:1.0:1788684539.351092:0:25053:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d677fab7b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cebd1789-51a4-46ff-b167-6b1633e930a1:25053:1875571085919872:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788684539.351120:0:25053:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.144@tcp lock: ffff8d6746cb2000/0x44bac02bd54adf92 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x44bac02bd54adf99 expref: -99 pid: 25053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684539.351133:0:25053:0:(ldlm_request.c:840:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.144@tcp lock: ffff8d6746cb2000/0x44bac02bd54adf92 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x44bac02bd54adf99 expref: -99 pid: 25053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788684539.357824:0:25053:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 11 count 11 00000040:00080000:0.0:1788684539.364659:0:25053:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788684539.368529:0:25053:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].1, 224 off8416 00000040:00080000:0.0:1788684539.368640:0:25053:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].2, 128 off8544 00000040:00080000:0.0:1788684539.368655:0:25053:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].3, 112 off8656 00000040:00080000:0.0:1788684539.368666:0:25053:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].4, 224 off8880 00000040:00080000:0.0:1788684539.368677:0:25053:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].5, 224 off9104 00000040:00080000:0.0:1788684539.368688:0:25053:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].6, 80 off9184 00000040:00080000:0.0:1788684539.368698:0:25053:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].7, 224 off9408 00000040:00080000:0.0:1788684539.368710:0:25053:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].8, 224 off9632 00000040:00080000:0.0:1788684539.368722:0:25053:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].9, 120 off9752 00000040:00080000:0.0:1788684539.368746:0:25053:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].10, 224 off9976 00000040:00080000:0.0:1788684539.368750:0:25053:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 10 count 11 00000100:00100000:0.0:1788684539.368858:0:25053:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d67450b3480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cebd1789-51a4-46ff-b167-6b1633e930a1:25053:1875571085920000:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788684539.369639:0:25053:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788684539.369711:0:25053:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d6743f7c840 going to sleep for 11 seconds 00000100:00100000:1.0:1788684539.372178:0:22725:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085920000 00000100:00100000:1.0:1788684539.372192:0:22725:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085920000 00000100:00100000:0.0:1788684539.375745:0:22725:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:0.0:1788684539.375760:0:22725:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6746cacc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cebd1789-51a4-46ff-b167-6b1633e930a1+22:25053:x1875571085920000:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788684539.378304:0:22725:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6746cacc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cebd1789-51a4-46ff-b167-6b1633e930a1+22:25053:x1875571085920000:12345-0@lo:501:mount.lustre.0 Request processed in 2535us (8655us total) trans 0 rc 0/0 00000100:00100000:0.0:1788684539.378337:0:22725:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:2.0:1788684539.379404:0:25053:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d67450b3480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cebd1789-51a4-46ff-b167-6b1633e930a1:25053:1875571085920000:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788684539.379473:0:25053:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6648665500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cebd1789-51a4-46ff-b167-6b1633e930a1:25053:1875571085920128:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788684539.379544:0:25053:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788684539.379644:0:25053:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d67460443c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788684539.382044:0:22726:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085920128 00000100:00100000:0.0:1788684539.382059:0:22726:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085920128 00000100:00100000:0.0:1788684539.382218:0:22726:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:0.0:1788684539.382230:0:22726:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6746caf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cebd1789-51a4-46ff-b167-6b1633e930a1+22:25053:x1875571085920128:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788684539.386183:0:22726:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6746caf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cebd1789-51a4-46ff-b167-6b1633e930a1+22:25053:x1875571085920128:12345-0@lo:503:mount.lustre.0 Request processed in 3947us (6630us total) trans 0 rc 0/0 00000100:00100000:0.0:1788684539.386197:0:22726:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:2.0:1788684539.386315:0:25053:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6648665500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cebd1789-51a4-46ff-b167-6b1633e930a1:25053:1875571085920128:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1788684539.386762:0:25053:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1788684539.386866:0:25053:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6648665500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cebd1789-51a4-46ff-b167-6b1633e930a1:25053:1875571085920256:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788684539.386938:0:25053:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788684539.389821:0:25053:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d67460443c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788684539.398182:0:22727:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085920256 00000100:00100000:3.0:1788684539.398200:0:22727:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085920256 00000100:00100000:3.0:1788684539.398285:0:22727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:3.0:1788684539.398294:0:22727:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6746cad850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cebd1789-51a4-46ff-b167-6b1633e930a1+22:25053:x1875571085920256:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788684539.401163:0:22727:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6746cad850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cebd1789-51a4-46ff-b167-6b1633e930a1+22:25053:x1875571085920256:12345-0@lo:502:mount.lustre.0 Request processed in 2862us (14216us total) trans 0 rc 0/0 00000100:00100000:3.0:1788684539.401179:0:22727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:2.0:1788684539.401304:0:25053:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6648665500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cebd1789-51a4-46ff-b167-6b1633e930a1:25053:1875571085920256:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1788684539.401564:0:25053:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].1, 224 off8416 00000040:00080000:2.0:1788684539.401594:0:25053:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].2, 128 off8544 00000040:00080000:2.0:1788684539.401608:0:25053:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].3, 112 off8656 00000040:00080000:2.0:1788684539.401620:0:25053:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].4, 224 off8880 00000040:00080000:2.0:1788684539.401637:0:25053:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].5, 224 off9104 00000040:00080000:2.0:1788684539.401649:0:25053:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].6, 80 off9184 00000040:00080000:2.0:1788684539.401661:0:25053:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].7, 224 off9408 00000040:00080000:2.0:1788684539.401672:0:25053:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].8, 224 off9632 00000040:00080000:2.0:1788684539.401684:0:25053:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].9, 120 off9752 00000100:00100000:2.0:1788684539.401718:0:25053:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6648665500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cebd1789-51a4-46ff-b167-6b1633e930a1:25053:1875571085920384:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788684539.401763:0:25053:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788684539.401801:0:25053:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d67460443c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788684539.401807:0:22726:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085920384 00000100:00100000:0.0:1788684539.401815:0:22726:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085920384 00000100:00100000:0.0:1788684539.401862:0:22726:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:0.0:1788684539.401872:0:22726:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6746cac050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cebd1789-51a4-46ff-b167-6b1633e930a1+22:25053:x1875571085920384:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788684539.401977:0:22726:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6746cac050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cebd1789-51a4-46ff-b167-6b1633e930a1+22:25053:x1875571085920384:12345-0@lo:502:mount.lustre.0 Request processed in 106us (213us total) trans 0 rc 0/0 00000100:00100000:0.0:1788684539.401984:0:22726:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:2.0:1788684539.402051:0:25053:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6648665500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cebd1789-51a4-46ff-b167-6b1633e930a1:25053:1875571085920384:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1788684539.402088:0:25053:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].10, 224 off9976 00000040:00080000:2.0:1788684539.402096:0:25053:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 10 count 11 00000020:01000000:2.0:1788684539.402776:0:25057:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1788684539.402784:0:25057:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/ost2_flakey 00000020:00000080:2.0:1788684539.402790:0:25057:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788684539.402792:0:25057:0:(obd_config.c:1563:class_process_config()) marker 29 (0x1) lustre-OST0001 add ost 00000020:00000080:2.0:1788684539.402798:0:25057:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1788684539.402811:0:25057:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffff8d6750b799c0) 00000020:00000080:2.0:1788684539.402833:0:25057:0:(obd_config.c:720:class_attach_name()) OBD: dev 26 attached type obdfilter with refcount 2 00000020:00000080:2.0:1788684539.402838:0:25057:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:2.0:1788684539.402912:0:25057:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8d6646627000 from lustre-OST0001, refs=2 00080000:01000000:2.0:1788684539.402921:0:25057:0:(osd_handler.c:8924:osd_obd_connect()) connect #1 00000020:00000080:2.0:1788684539.402927:0:25057:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x44bac02bd54adfa7 00010000:00010000:3.0:1788684539.408287:0:25057:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-4 is initialized 00000001:00000004:2.0:1788684539.408864:0:25057:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 3, last_transno is 8589934600 00080000:10000000:2.0:1788684539.410836:0:25057:0:(osd_handler.c:5580:osd_index_try()) lustre-OST0001: index object [0x200000003:0xb:0x0] (8/32) registered 00000020:00000080:2.0:1788684539.429714:0:25057:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:2.0:1788684539.429727:0:25057:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788684539.429739:0:25057:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788684539.429742:0:25057:0:(obd_config.c:1563:class_process_config()) marker 29 (0x2) lustre-OST0001 add ost 00000020:01000000:2.0:1788684539.429747:0:25057:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788684539.429751:0:25057:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788684539.429753:0:25057:0:(obd_config.c:1563:class_process_config()) marker 37 (0x1) lustre sys.timeout 00000020:00000080:2.0:1788684539.429757:0:25057:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1788684539.429759:0:25057:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:2.0:1788684539.429761:0:25057:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788684539.429765:0:25057:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788684539.429766:0:25057:0:(obd_config.c:1563:class_process_config()) marker 37 (0x2) lustre sys.timeout 00000020:01000000:2.0:1788684539.429769:0:25057:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788684539.429772:0:25057:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788684539.429774:0:25057:0:(obd_config.c:1563:class_process_config()) marker 42 (0x1) lustre sys.jobid_var 00000020:00000080:2.0:1788684539.429779:0:25057:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:2.0:1788684539.429808:0:25057:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788684539.429812:0:25057:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788684539.429814:0:25057:0:(obd_config.c:1563:class_process_config()) marker 42 (0x2) lustre sys.jobid_var 00000040:00080000:2.0:1788684539.429817:0:25057:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xc:0x0] index 11 count 11 00000020:01000000:1.0:1788684539.430017:0:25053:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-10 (rc=0) 10000000:01000000:1.0:1788684539.430062:0:25053:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.144@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:1.0:1788684539.430090:0:25053:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.144@tcp lock: ffff8d6746cb2000/0x44bac02bd54adf92 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x44bac02bd54adf99 expref: -99 pid: 25053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684539.430103:0:25053:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.144@tcp lock: ffff8d6746cb2000/0x44bac02bd54adf92 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x44bac02bd54adf99 expref: -99 pid: 25053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788684539.430112:0:25053:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8d6646627000 from 1 10000000:01000000:1.0:1788684539.430115:0:25053:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788684539.430156:0:25053:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.144@tcp lock: ffff8d6746cb2400/0x44bac02bd54adfae lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 25053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684539.430165:0:25053:0:(ldlm_request.c:1106:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.144@tcp lock: ffff8d6746cb2400/0x44bac02bd54adfae lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 25053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684539.430189:0:25053:0:(ldlm_request.c:1193:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.144@tcp lock: ffff8d6746cb2400/0x44bac02bd54adfae lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 25053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788684539.430213:0:25053:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d677fab7b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cebd1789-51a4-46ff-b167-6b1633e930a1:25053:1875571085920512:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1788684539.430276:0:25053:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788684539.430322:0:25053:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d6745398480 going to sleep for 11 seconds 00000100:00100000:2.0:1788684539.431408:0:22727:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085920512 00000100:00100000:2.0:1788684539.431419:0:22727:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085920512 00000100:00100000:2.0:1788684539.431467:0:22727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:2.0:1788684539.431478:0:22727:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6746caec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cebd1789-51a4-46ff-b167-6b1633e930a1+22:25053:x1875571085920512:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788684539.431494:0:22727:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788684539.431509:0:22727:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d66476d4200/0x44bac02bd54adfb5 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x44bac02bd54adfae expref: -99 pid: 22727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684539.431536:0:22727:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d66476d4200/0x44bac02bd54adfb5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x44bac02bd54adfae expref: 23 pid: 22727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684539.431547:0:22727:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d66476d4200/0x44bac02bd54adfb5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x44bac02bd54adfae expref: 23 pid: 22727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684539.431556:0:22727:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d66476d4200, rc 0) 00000100:00100000:2.0:1788684539.431633:0:22727:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6746caec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cebd1789-51a4-46ff-b167-6b1633e930a1+23:25053:x1875571085920512:12345-0@lo:101:mount.lustre.0 Request processed in 157us (1356us total) trans 0 rc 0/0 00000100:00100000:2.0:1788684539.431640:0:22727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:3.0:1788684539.431825:0:25053:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d677fab7b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cebd1789-51a4-46ff-b167-6b1633e930a1:25053:1875571085920512:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788684539.431843:0:25053:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.144@tcp lock: ffff8d6746cb2400/0x44bac02bd54adfae lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x44bac02bd54adfb5 expref: -99 pid: 25053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684539.431854:0:25053:0:(ldlm_request.c:840:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.144@tcp lock: ffff8d6746cb2400/0x44bac02bd54adfae lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x44bac02bd54adfb5 expref: -99 pid: 25053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788684539.434774:0:25053:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 13 count 13 00000040:00080000:3.0:1788684539.435301:0:25053:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788684539.435574:0:25053:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].1, 224 off8416 00000040:00080000:3.0:1788684539.435599:0:25053:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].2, 112 off8528 00000040:00080000:3.0:1788684539.435615:0:25053:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].3, 224 off8752 00000040:00080000:3.0:1788684539.435630:0:25053:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].4, 224 off8976 00000040:00080000:3.0:1788684539.435645:0:25053:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].5, 112 off9088 00000040:00080000:3.0:1788684539.435672:0:25053:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].6, 224 off9312 00000040:00080000:3.0:1788684539.435689:0:25053:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].7, 224 off9536 00000040:00080000:3.0:1788684539.435704:0:25053:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].8, 128 off9664 00000040:00080000:3.0:1788684539.435719:0:25053:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].9, 224 off9888 00000040:00080000:3.0:1788684539.435733:0:25053:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].10, 224 off10112 00000040:00080000:3.0:1788684539.435746:0:25053:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].11, 128 off10240 00000040:00080000:3.0:1788684539.435763:0:25053:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].12, 224 off10464 00000040:00080000:3.0:1788684539.435768:0:25053:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 12 count 13 00000100:00100000:3.0:1788684539.435840:0:25053:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6647908700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cebd1789-51a4-46ff-b167-6b1633e930a1:25053:1875571085920640:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788684539.435918:0:25053:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788684539.437569:0:25053:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d6743ee6900 going to sleep for 11 seconds 00000100:00100000:1.0:1788684539.443537:0:22725:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085920640 00000100:00100000:1.0:1788684539.443549:0:22725:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085920640 00000100:00100000:1.0:1788684539.443602:0:22725:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:1.0:1788684539.443613:0:22725:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6746cac850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cebd1789-51a4-46ff-b167-6b1633e930a1+23:25053:x1875571085920640:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788684539.443779:0:22725:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6746cac850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cebd1789-51a4-46ff-b167-6b1633e930a1+23:25053:x1875571085920640:12345-0@lo:501:mount.lustre.0 Request processed in 168us (7861us total) trans 0 rc 0/0 00000100:00100000:1.0:1788684539.443787:0:22725:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:3.0:1788684539.443840:0:25053:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6647908700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cebd1789-51a4-46ff-b167-6b1633e930a1:25053:1875571085920640:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788684539.443901:0:25053:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6647908700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cebd1789-51a4-46ff-b167-6b1633e930a1:25053:1875571085920768:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788684539.443950:0:25053:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788684539.443985:0:25053:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d6743ee6900 going to sleep for 11 seconds 00000100:00100000:1.0:1788684539.444016:0:22726:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085920768 00000100:00100000:1.0:1788684539.444031:0:22726:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085920768 00000100:00100000:1.0:1788684539.444061:0:22726:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:1.0:1788684539.444068:0:22726:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6746cadc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cebd1789-51a4-46ff-b167-6b1633e930a1+23:25053:x1875571085920768:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788684539.444158:0:22726:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6746cadc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cebd1789-51a4-46ff-b167-6b1633e930a1+23:25053:x1875571085920768:12345-0@lo:503:mount.lustre.0 Request processed in 89us (208us total) trans 0 rc 0/0 00000100:00100000:1.0:1788684539.444164:0:22726:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:3.0:1788684539.444221:0:25053:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6647908700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cebd1789-51a4-46ff-b167-6b1633e930a1:25053:1875571085920768:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1788684539.444588:0:25053:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1788684539.444666:0:25053:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6647908700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cebd1789-51a4-46ff-b167-6b1633e930a1:25053:1875571085920896:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788684539.444700:0:25053:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788684539.444724:0:25053:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d6743ee6780 going to sleep for 11 seconds 00000100:00100000:1.0:1788684539.445050:0:22725:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085920896 00000100:00100000:1.0:1788684539.445056:0:22725:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085920896 00000100:00100000:1.0:1788684539.445192:0:22725:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:1.0:1788684539.445203:0:22725:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6746cae050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cebd1789-51a4-46ff-b167-6b1633e930a1+23:25053:x1875571085920896:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788684539.445308:0:22725:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6746cae050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cebd1789-51a4-46ff-b167-6b1633e930a1+23:25053:x1875571085920896:12345-0@lo:502:mount.lustre.0 Request processed in 106us (605us total) trans 0 rc 0/0 00000100:00100000:1.0:1788684539.445324:0:22725:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:3.0:1788684539.445827:0:25053:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6647908700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cebd1789-51a4-46ff-b167-6b1633e930a1:25053:1875571085920896:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1788684539.446028:0:25053:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].1, 224 off8416 00000040:00080000:3.0:1788684539.446056:0:25053:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].2, 112 off8528 00000040:00080000:3.0:1788684539.446071:0:25053:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].3, 224 off8752 00000040:00080000:3.0:1788684539.446086:0:25053:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].4, 224 off8976 00000040:00080000:3.0:1788684539.446098:0:25053:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].5, 112 off9088 00000040:00080000:3.0:1788684539.446109:0:25053:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].6, 224 off9312 00000040:00080000:3.0:1788684539.446130:0:25053:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].7, 224 off9536 00000040:00080000:3.0:1788684539.446142:0:25053:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].8, 128 off9664 00000040:00080000:3.0:1788684539.446153:0:25053:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].9, 224 off9888 00000040:00080000:3.0:1788684539.446167:0:25053:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].10, 224 off10112 00000040:00080000:3.0:1788684539.446179:0:25053:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].11, 128 off10240 00000100:00100000:3.0:1788684539.446205:0:25053:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6647908700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cebd1789-51a4-46ff-b167-6b1633e930a1:25053:1875571085921024:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788684539.446253:0:25053:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788684539.446322:0:25053:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d6743ee6780 going to sleep for 11 seconds 00000100:00100000:2.0:1788684539.446361:0:22727:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085921024 00000100:00100000:2.0:1788684539.446483:0:22727:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085921024 00000100:00100000:3.0:1788684539.446615:0:22727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:3.0:1788684539.446623:0:22727:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6746cae450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cebd1789-51a4-46ff-b167-6b1633e930a1+23:25053:x1875571085921024:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788684539.446742:0:22727:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6746cae450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cebd1789-51a4-46ff-b167-6b1633e930a1+23:25053:x1875571085921024:12345-0@lo:502:mount.lustre.0 Request processed in 111us (480us total) trans 0 rc 0/0 00000100:00100000:3.0:1788684539.446750:0:22727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:0.0:1788684539.446897:0:25053:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6647908700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cebd1789-51a4-46ff-b167-6b1633e930a1:25053:1875571085921024:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1788684539.446948:0:25053:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].12, 224 off10464 00000040:00080000:0.0:1788684539.446957:0:25053:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 12 count 13 00000020:01000000:0.0:1788684539.447571:0:25061:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788684539.447581:0:25061:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788684539.447583:0:25061:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:0.0:1788684539.447589:0:25061:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8d6646627000 00000020:00000080:0.0:1788684539.447591:0:25061:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1788684539.447598:0:25061:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788684539.447600:0:25061:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788684539.447602:0:25061:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:0.0:1788684539.447604:0:25061:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788684539.447611:0:25061:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788684539.447612:0:25061:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:0.0:1788684539.447616:0:25061:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff8d6646627000 00000020:00000080:0.0:1788684539.447618:0:25061:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1788684539.447670:0:25061:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788684539.447673:0:25061:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788684539.447674:0:25061:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:0.0:1788684539.447676:0:25061:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788684539.447678:0:25061:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788684539.447680:0:25061:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1788684539.447683:0:25061:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8d6646627000 00000020:00000080:0.0:1788684539.447684:0:25061:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1788684539.447698:0:25061:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788684539.447700:0:25061:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788684539.447702:0:25061:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1788684539.447704:0:25061:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788684539.447706:0:25061:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788684539.447707:0:25061:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:0.0:1788684539.447710:0:25061:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff8d6646627000 00000020:00000080:0.0:1788684539.447712:0:25061:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1788684539.447729:0:25061:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788684539.447732:0:25061:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788684539.447739:0:25061:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:0.0:1788684539.447742:0:25061:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xe:0x0] index 13 count 13 00000020:01000000:0.0:1788684539.447822:0:25053:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:0.0:1788684539.447846:0:25053:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.144@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788684539.447860:0:25053:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.144@tcp lock: ffff8d6746cb2400/0x44bac02bd54adfae lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x44bac02bd54adfb5 expref: -99 pid: 25053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684539.447870:0:25053:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.144@tcp lock: ffff8d6746cb2400/0x44bac02bd54adfae lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x44bac02bd54adfb5 expref: -99 pid: 25053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788684539.447913:0:25053:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:0.0:1788684539.447919:0:25053:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff8d6646627000 10000000:01000000:0.0:1788684539.447922:0:25053:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff8d6646627000 10000000:01000000:0.0:1788684539.447926:0:25053:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1788684539.447931:0:25053:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff8d6646627000 from 1 10000000:01000000:0.0:1788684539.447933:0:25053:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1788684539.447960:0:25053:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.144@tcp lock: ffff8d6746d3f200/0x44bac02bd54adfbc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 25053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684539.447969:0:25053:0:(ldlm_request.c:1106:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.144@tcp lock: ffff8d6746d3f200/0x44bac02bd54adfbc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 25053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684539.447978:0:25053:0:(ldlm_request.c:1193:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.144@tcp lock: ffff8d6746d3f200/0x44bac02bd54adfbc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 25053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788684539.447996:0:25053:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d67450b2d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cebd1789-51a4-46ff-b167-6b1633e930a1:25053:1875571085921152:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1788684539.448049:0:25053:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788684539.448076:0:25053:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d67461e2d80 going to sleep for 11 seconds 00000100:00100000:3.0:1788684539.449203:0:22727:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085921152 00000100:00100000:3.0:1788684539.449215:0:22727:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085921152 00000100:00100000:3.0:1788684539.449256:0:22727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:3.0:1788684539.449265:0:22727:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6746caf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cebd1789-51a4-46ff-b167-6b1633e930a1+23:25053:x1875571085921152:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788684539.449279:0:22727:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788684539.449294:0:22727:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d66479a1600/0x44bac02bd54adfc3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x44bac02bd54adfbc expref: -99 pid: 22727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684539.449317:0:22727:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d66479a1600/0x44bac02bd54adfc3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x44bac02bd54adfbc expref: 24 pid: 22727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684539.449328:0:22727:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d66479a1600/0x44bac02bd54adfc3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x44bac02bd54adfbc expref: 24 pid: 22727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684539.449337:0:22727:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d66479a1600, rc 0) 00000100:00100000:3.0:1788684539.449426:0:22727:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6746caf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cebd1789-51a4-46ff-b167-6b1633e930a1+24:25053:x1875571085921152:12345-0@lo:101:mount.lustre.0 Request processed in 162us (1376us total) trans 0 rc 0/0 00000100:00100000:3.0:1788684539.449443:0:22727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:0.0:1788684539.456174:0:25053:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d67450b2d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cebd1789-51a4-46ff-b167-6b1633e930a1:25053:1875571085921152:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788684539.456208:0:25053:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.144@tcp lock: ffff8d6746d3f200/0x44bac02bd54adfbc lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x44bac02bd54adfc3 expref: -99 pid: 25053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684539.456221:0:25053:0:(ldlm_request.c:840:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.144@tcp lock: ffff8d6746d3f200/0x44bac02bd54adfbc lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x44bac02bd54adfc3 expref: -99 pid: 25053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788684539.458838:0:25053:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 52 count 51 00000040:00080000:0.0:1788684539.459174:0:25053:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788684539.459406:0:25053:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].1, 224 off8416 00000040:00080000:0.0:1788684539.459435:0:25053:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].2, 120 off8536 00000040:00080000:0.0:1788684539.459452:0:25053:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].3, 168 off8704 00000040:00080000:0.0:1788684539.459469:0:25053:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].4, 224 off8928 00000040:00080000:0.0:1788684539.459503:0:25053:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].5, 224 off9152 00000040:00080000:0.0:1788684539.459521:0:25053:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].6, 120 off9272 00000040:00080000:0.0:1788684539.459537:0:25053:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].7, 168 off9440 00000040:00080000:0.0:1788684539.459551:0:25053:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].8, 224 off9664 00000040:00080000:0.0:1788684539.459564:0:25053:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].9, 224 off9888 00000040:00080000:0.0:1788684539.459578:0:25053:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].10, 120 off10008 00000040:00080000:0.0:1788684539.459594:0:25053:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].11, 224 off10232 00000040:00080000:0.0:1788684539.459608:0:25053:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].12, 224 off10456 00000040:00080000:0.0:1788684539.459623:0:25053:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].13, 88 off10544 00000040:00080000:0.0:1788684539.459638:0:25053:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].14, 128 off10672 00000040:00080000:0.0:1788684539.459653:0:25053:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].15, 144 off10816 00000040:00080000:0.0:1788684539.459669:0:25053:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].16, 160 off10976 00000040:00080000:0.0:1788684539.459685:0:25053:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].17, 224 off11200 00000040:00080000:0.0:1788684539.459701:0:25053:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].18, 224 off11424 00000040:00080000:0.0:1788684539.459718:0:25053:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].19, 80 off11504 00000040:00080000:0.0:1788684539.459734:0:25053:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].20, 224 off11728 00000040:00080000:0.0:1788684539.459761:0:25053:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].21, 224 off11952 00000040:00080000:0.0:1788684539.459777:0:25053:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].22, 88 off12040 00000040:00080000:0.0:1788684539.459791:0:25053:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].23, 128 off12168 00000040:00080000:0.0:1788684539.459804:0:25053:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].24, 144 off12312 00000040:00080000:0.0:1788684539.459818:0:25053:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].25, 160 off12472 00000040:00080000:0.0:1788684539.459830:0:25053:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].26, 224 off12696 00000040:00080000:0.0:1788684539.459841:0:25053:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].27, 224 off12920 00000040:00080000:0.0:1788684539.459853:0:25053:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].28, 80 off13000 00000040:00080000:0.0:1788684539.459865:0:25053:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].29, 224 off13224 00000040:00080000:0.0:1788684539.459878:0:25053:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].30, 224 off13448 00000040:00080000:0.0:1788684539.459890:0:25053:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].31, 88 off13536 00000040:00080000:0.0:1788684539.459902:0:25053:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].32, 128 off13664 00000040:00080000:0.0:1788684539.459914:0:25053:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].33, 144 off13808 00000040:00080000:0.0:1788684539.459927:0:25053:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].34, 128 off13936 00000040:00080000:0.0:1788684539.459940:0:25053:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].35, 224 off14160 00000040:00080000:0.0:1788684539.459952:0:25053:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].36, 224 off14384 00000040:00080000:0.0:1788684539.459974:0:25053:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].37, 80 off14464 00000040:00080000:0.0:1788684539.459992:0:25053:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].38, 224 off14688 00000040:00080000:0.0:1788684539.460004:0:25053:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].39, 224 off14912 00000040:00080000:0.0:1788684539.460015:0:25053:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].40, 88 off15000 00000040:00080000:0.0:1788684539.460042:0:25053:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].41, 128 off15128 00000040:00080000:0.0:1788684539.460054:0:25053:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].42, 144 off15272 00000040:00080000:0.0:1788684539.460067:0:25053:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].43, 128 off15400 00000040:00080000:0.0:1788684539.460080:0:25053:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].44, 224 off15624 00000040:00080000:0.0:1788684539.460093:0:25053:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].45, 224 off15848 00000040:00080000:0.0:1788684539.460105:0:25053:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].46, 80 off15928 00000040:00080000:0.0:1788684539.460120:0:25053:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].47, 224 off16152 00000040:00080000:0.0:1788684539.460134:0:25053:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].48, 232 off16384 00000040:00080000:0.0:1788684539.460279:0:25053:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].49, 224 off16608 00000040:00080000:0.0:1788684539.460305:0:25053:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].50, 120 off16728 00000040:00080000:0.0:1788684539.460337:0:25053:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].51, 224 off16952 00000040:00080000:0.0:1788684539.460344:0:25053:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 51 count 51 00000100:00100000:0.0:1788684539.460453:0:25053:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d67450b2d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cebd1789-51a4-46ff-b167-6b1633e930a1:25053:1875571085921280:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788684539.460511:0:25053:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788684539.460546:0:22727:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085921280 00000100:00100000:0.0:1788684539.460552:0:25053:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d67461e2a80 going to sleep for 11 seconds 00000100:00100000:3.0:1788684539.460556:0:22727:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085921280 00000100:00100000:3.0:1788684539.460607:0:22727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:3.0:1788684539.460617:0:22727:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6746cad450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cebd1789-51a4-46ff-b167-6b1633e930a1+24:25053:x1875571085921280:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788684539.460742:0:22727:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6746cad450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cebd1789-51a4-46ff-b167-6b1633e930a1+24:25053:x1875571085921280:12345-0@lo:501:mount.lustre.0 Request processed in 120us (223us total) trans 0 rc 0/0 00000100:00100000:3.0:1788684539.460751:0:22727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:0.0:1788684539.463588:0:25053:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d67450b2d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cebd1789-51a4-46ff-b167-6b1633e930a1:25053:1875571085921280:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788684539.463653:0:25053:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d67450b2d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cebd1789-51a4-46ff-b167-6b1633e930a1:25053:1875571085921408:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788684539.463722:0:25053:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788684539.463764:0:25053:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d67461e2a80 going to sleep for 11 seconds 00000100:00100000:3.0:1788684539.463815:0:22726:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085921408 00000100:00100000:3.0:1788684539.463822:0:22726:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085921408 00000100:00100000:3.0:1788684539.463915:0:22726:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:3.0:1788684539.463925:0:22726:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6750e72850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cebd1789-51a4-46ff-b167-6b1633e930a1+24:25053:x1875571085921408:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788684539.464044:0:22726:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6750e72850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cebd1789-51a4-46ff-b167-6b1633e930a1+24:25053:x1875571085921408:12345-0@lo:503:mount.lustre.0 Request processed in 120us (320us total) trans 0 rc 0/0 00000100:00100000:3.0:1788684539.464052:0:22726:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:0.0:1788684539.464985:0:25053:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d67450b2d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cebd1789-51a4-46ff-b167-6b1633e930a1:25053:1875571085921408:0@lo:503:mount.lustre.0 00000040:00080000:0.0:1788684539.465402:0:25053:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1788684539.465474:0:25053:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d67450b2d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cebd1789-51a4-46ff-b167-6b1633e930a1:25053:1875571085921536:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788684539.465526:0:25053:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788684539.465555:0:22725:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085921536 00000100:00100000:0.0:1788684539.465560:0:22725:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085921536 00000100:00100000:0.0:1788684539.465601:0:22725:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:0.0:1788684539.465608:0:22725:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6750e72450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cebd1789-51a4-46ff-b167-6b1633e930a1+24:25053:x1875571085921536:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788684539.465695:0:22725:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6750e72450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cebd1789-51a4-46ff-b167-6b1633e930a1+24:25053:x1875571085921536:12345-0@lo:502:mount.lustre.0 Request processed in 87us (168us total) trans 0 rc 0/0 00000100:00100000:0.0:1788684539.465703:0:22725:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:0.0:1788684539.465803:0:25053:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d67461e2d80 going to sleep for 11 seconds 00000100:00100000:0.0:1788684539.465818:0:25053:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d67450b2d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cebd1789-51a4-46ff-b167-6b1633e930a1:25053:1875571085921536:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1788684539.465969:0:25053:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].1, 224 off8416 00000040:00080000:0.0:1788684539.465993:0:25053:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].2, 120 off8536 00000040:00080000:0.0:1788684539.466006:0:25053:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].3, 168 off8704 00000040:00080000:0.0:1788684539.466030:0:25053:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].4, 224 off8928 00000040:00080000:0.0:1788684539.466048:0:25053:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].5, 224 off9152 00000040:00080000:0.0:1788684539.466063:0:25053:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].6, 120 off9272 00000040:00080000:0.0:1788684539.466077:0:25053:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].7, 168 off9440 00000040:00080000:0.0:1788684539.466091:0:25053:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].8, 224 off9664 00000040:00080000:0.0:1788684539.466105:0:25053:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].9, 224 off9888 00000040:00080000:0.0:1788684539.466120:0:25053:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].10, 120 off10008 00000040:00080000:0.0:1788684539.466133:0:25053:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].11, 224 off10232 00000040:00080000:0.0:1788684539.466146:0:25053:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].12, 224 off10456 00000040:00080000:0.0:1788684539.466160:0:25053:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].13, 88 off10544 00000040:00080000:0.0:1788684539.466185:0:25053:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].14, 128 off10672 00000040:00080000:0.0:1788684539.466201:0:25053:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].15, 144 off10816 00000040:00080000:0.0:1788684539.466215:0:25053:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].16, 160 off10976 00000040:00080000:0.0:1788684539.466228:0:25053:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].17, 224 off11200 00000040:00080000:0.0:1788684539.466240:0:25053:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].18, 224 off11424 00000040:00080000:0.0:1788684539.466252:0:25053:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].19, 80 off11504 00000040:00080000:0.0:1788684539.466263:0:25053:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].20, 224 off11728 00000040:00080000:0.0:1788684539.466275:0:25053:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].21, 224 off11952 00000040:00080000:0.0:1788684539.466285:0:25053:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].22, 88 off12040 00000040:00080000:0.0:1788684539.466297:0:25053:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].23, 128 off12168 00000040:00080000:0.0:1788684539.466318:0:25053:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].24, 144 off12312 00000040:00080000:0.0:1788684539.466334:0:25053:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].25, 160 off12472 00000040:00080000:0.0:1788684539.466348:0:25053:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].26, 224 off12696 00000040:00080000:0.0:1788684539.466361:0:25053:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].27, 224 off12920 00000040:00080000:0.0:1788684539.466394:0:25053:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].28, 80 off13000 00000040:00080000:0.0:1788684539.466408:0:25053:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].29, 224 off13224 00000040:00080000:0.0:1788684539.466431:0:25053:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].30, 224 off13448 00000040:00080000:0.0:1788684539.466447:0:25053:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].31, 88 off13536 00000040:00080000:0.0:1788684539.466460:0:25053:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].32, 128 off13664 00000040:00080000:0.0:1788684539.466471:0:25053:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].33, 144 off13808 00000040:00080000:0.0:1788684539.466483:0:25053:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].34, 128 off13936 00000040:00080000:0.0:1788684539.466495:0:25053:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].35, 224 off14160 00000040:00080000:0.0:1788684539.466508:0:25053:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].36, 224 off14384 00000040:00080000:0.0:1788684539.466520:0:25053:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].37, 80 off14464 00000040:00080000:0.0:1788684539.466532:0:25053:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].38, 224 off14688 00000040:00080000:0.0:1788684539.466543:0:25053:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].39, 224 off14912 00000040:00080000:0.0:1788684539.466555:0:25053:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].40, 88 off15000 00000040:00080000:0.0:1788684539.466568:0:25053:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].41, 128 off15128 00000040:00080000:0.0:1788684539.466582:0:25053:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].42, 144 off15272 00000040:00080000:0.0:1788684539.466595:0:25053:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].43, 128 off15400 00000040:00080000:0.0:1788684539.466608:0:25053:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].44, 224 off15624 00000040:00080000:0.0:1788684539.466622:0:25053:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].45, 224 off15848 00000040:00080000:0.0:1788684539.466647:0:25053:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].46, 80 off15928 00000040:00080000:0.0:1788684539.466662:0:25053:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].47, 224 off16152 00000040:00080000:0.0:1788684539.466676:0:25053:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].48, 232 off16384 00000100:00100000:0.0:1788684539.466711:0:25053:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d67450b2d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cebd1789-51a4-46ff-b167-6b1633e930a1:25053:1875571085921664:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788684539.468052:0:25053:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788684539.468086:0:25053:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d67461e2d80 going to sleep for 11 seconds 00000100:00100000:3.0:1788684539.470132:0:22726:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085921664 00000100:00100000:3.0:1788684539.470145:0:22726:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085921664 00000100:00100000:3.0:1788684539.470203:0:22726:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:3.0:1788684539.470212:0:22726:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6750e73850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cebd1789-51a4-46ff-b167-6b1633e930a1+24:25053:x1875571085921664:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788684539.470388:0:22726:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6750e73850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cebd1789-51a4-46ff-b167-6b1633e930a1+24:25053:x1875571085921664:12345-0@lo:502:mount.lustre.0 Request processed in 151us (2313us total) trans 0 rc 0/0 00000100:00100000:3.0:1788684539.470396:0:22726:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:1.0:1788684539.471072:0:25053:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d67450b2d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cebd1789-51a4-46ff-b167-6b1633e930a1:25053:1875571085921664:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1788684539.471428:0:25053:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].49, 224 off16608 00000040:00080000:1.0:1788684539.471459:0:25053:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].50, 120 off16728 00000100:00100000:1.0:1788684539.471499:0:25053:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d677fab7480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cebd1789-51a4-46ff-b167-6b1633e930a1:25053:1875571085921792:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788684539.471557:0:25053:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788684539.471592:0:25053:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d6775ea7900 going to sleep for 11 seconds 00000100:00100000:0.0:1788684539.474284:0:22727:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085921792 00000100:00100000:0.0:1788684539.474299:0:22727:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085921792 00000100:00100000:0.0:1788684539.474354:0:22727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:0.0:1788684539.474404:0:22727:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6750e72c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cebd1789-51a4-46ff-b167-6b1633e930a1+24:25053:x1875571085921792:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788684539.474579:0:22727:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6750e72c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cebd1789-51a4-46ff-b167-6b1633e930a1+24:25053:x1875571085921792:12345-0@lo:502:mount.lustre.0 Request processed in 217us (3023us total) trans 0 rc 0/0 00000100:00100000:0.0:1788684539.474587:0:22727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:1.0:1788684539.474788:0:25053:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d677fab7480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cebd1789-51a4-46ff-b167-6b1633e930a1:25053:1875571085921792:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1788684539.474866:0:25053:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].51, 224 off16952 00000040:00080000:1.0:1788684539.474879:0:25053:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 51 count 51 00000020:01000004:0.0:1788684539.476759:0:25066:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:0.0:1788684539.476777:0:25066:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffff8d67482e3380) 00000020:00000080:0.0:1788684539.476802:0:25066:0:(obd_config.c:720:class_attach_name()) OBD: dev 27 attached type lwp with refcount 2 00000020:01000004:0.0:1788684539.476890:0:25066:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8d6646627000 from lustre-OST0001, refs=3 00000020:01000004:0.0:1788684539.476894:0:25066:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8d6646627000 from lustre-OST0001, refs=3 00000020:01000004:0.0:1788684539.476896:0:25066:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8d6646627000 3 00010000:00080000:0.0:1788684539.476927:0:25066:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8d676674c000@lustre-MDT0000-lwp-OST0001: add connection 192.168.206.144@tcp at head 00010000:00010000:0.0:1788684539.479048:0:25066:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-11 is initialized 00000020:00000080:0.0:1788684539.479245:0:25066:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:0.0:1788684539.479289:0:25066:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1788684539.479301:0:25066:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0x44bac02bd54adfd1 00000100:00080000:0.0:1788684539.479312:0:25066:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1788684539.479319:0:25066:0:(import.c:665:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff8d676674c000 using connection 192.168.206.144@tcp/0@lo 00000100:00100000:0.0:1788684539.479355:0:25066:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8d67450b0000 x1875571085921920/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788684539.480215:0:25066:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000020:01000004:0.0:1788684539.480515:0:25066:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-lwp-OST0001 (typ=lwp) 00000020:00000080:0.0:1788684539.480530:0:25066:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-lwp-OST0001 (ffff8d66465e19c0) 00000020:00000080:0.0:1788684539.480551:0:25066:0:(obd_config.c:720:class_attach_name()) OBD: dev 28 attached type lwp with refcount 2 00000100:00100000:2.0:1788684539.481201:0:3622:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d67450b0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3622:1875571085921920:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1788684539.481270:0:3622:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788684539.481332:0:22733:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085921920 00000100:00100000:2.0:1788684539.481339:0:22733:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085921920 00000100:00100000:2.0:1788684539.481390:0:22733:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788684539.481397:0:22733:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6648665500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3622:x1875571085921920:12345-0@lo:38:llog_process_th.0 00010000:00080000:2.0:1788684539.481421:0:22733:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 620 last 0 00000020:00000080:2.0:1788684539.481449:0:22733:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0x44bac02bd54adfdf 00000004:00100000:2.0:1788684539.481462:0:22733:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1788684539.481491:0:22733:0:(import.c:65:import_set_state_nolock()) ffff8d6646cbe800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788684539.481541:0:22733:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6648665500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3622:x1875571085921920:12345-0@lo:38:llog_process_th.0 Request processed in 143us (270us total) trans 0 rc 0/0 00000100:00100000:2.0:1788684539.481549:0:22733:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:2.0:1788684539.481662:0:3622:0:(ldlm_request.c:1670:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d67450b0000 x1875571085921920/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788684549 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788684539.481672:0:3622:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:2.0:1788684539.481681:0:3622:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 3 00000100:00080000:2.0:1788684539.481688:0:3622:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:2.0:1788684539.481692:0:3622:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1788684539.481695:0:3622:0:(import.c:65:import_set_state_nolock()) ffff8d676674c000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1788684539.481701:0:3622:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d67450b0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3622:1875571085921920:0@lo:38:llog_process_th.0 00000020:01000004:0.0:1788684539.482066:0:25066:0:(tgt_mount.c:153:server_get_mount()) get mount ffff8d6646627000 from lustre-OST0001, refs=3 00000020:01000004:0.0:1788684539.482072:0:25066:0:(tgt_mount.c:187:server_put_mount()) put mount ffff8d6646627000 from lustre-OST0001, refs=3 00000020:01000004:0.0:1788684539.482075:0:25066:0:(obd_mount.c:710:lustre_put_lsi()) put ffff8d6646627000 3 00000100:00080000:1.0:1788684539.482087:0:14645:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788684539.482092:0:14645:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788684539.482095:0:14645:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788684539.482099:0:14645:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00010000:00080000:0.0:1788684539.482126:0:25066:0:(ldlm_lib.c:102:import_set_conn()) imp ffff8d6647932000@lustre-MDT0001-lwp-OST0001: add connection 192.168.206.144@tcp at head 00000100:00100000:2.0:1788684539.482130:0:3624:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d677fab5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3624:1875571085922176:0@lo:400:kworker.0 00000100:00080000:1.0:1788684539.482145:0:14645:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788684539.482149:0:14645:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1788684539.482152:0:14645:0:(import.c:65:import_set_state_nolock()) ffff8d677cc6b000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788684539.482159:0:14645:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 619 00000100:00080000:1.0:1788684539.482163:0:14645:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 20s 00000100:00080000:1.0:1788684539.482170:0:14645:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff8d677cc6b000 using connection 192.168.206.144@tcp/0@lo 00000100:00100000:2.0:1788684539.482171:0:3624:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788684539.482194:0:14645:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8d677fab4e00 x1875571085922560/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788684539.482202:0:3624:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788684539.482211:0:3624:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d677fab7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3624:1875571085922048:0@lo:400:kworker.0 00000100:00100000:2.0:1788684539.482244:0:3624:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788684539.482268:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d677fab4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3623:1875571085922688:0@lo:400:kworker.0 00000100:00100000:2.0:1788684539.482270:0:3624:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d677fab6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3624:1875571085922816:0@lo:400:kworker.0 00000100:00100000:2.0:1788684539.482294:0:3624:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788684539.482325:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788684539.482329:0:3625:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d677fab5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3625:1875571085922304:0@lo:400:kworker.0 00000100:00100000:2.0:1788684539.482361:0:3625:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788684539.482405:0:3625:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d677fab7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3625:1875571085922944:0@lo:400:kworker.0 00000100:00100000:2.0:1788684539.482428:0:3625:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788684539.482449:0:3625:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788684539.482455:0:3625:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d677fab6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3625:1875571085922432:0@lo:400:kworker.0 00000100:00100000:2.0:1788684539.482481:0:3625:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788684539.482518:0:22734:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085922176 00000100:00100000:2.0:1788684539.482523:0:22734:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085922176 00000100:00100000:2.0:1788684539.482548:0:22734:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085922816 00000100:00100000:2.0:1788684539.482551:0:22734:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085922816 00000100:00100000:2.0:1788684539.482563:0:22734:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085922688 00000100:00100000:2.0:1788684539.482625:0:22734:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085922688 00000100:00100000:2.0:1788684539.482643:0:22734:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085922944 00000100:00100000:2.0:1788684539.482646:0:22734:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085922944 00000100:00100000:2.0:1788684539.482662:0:22734:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1788684539.482669:0:22734:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6648664e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3624:x1875571085922176:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788684539.482711:0:22734:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6648664e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3624:x1875571085922176:12345-0@lo:400:kworker.0 Request processed in 42us (543us total) trans 0 rc 0/0 00000100:00100000:2.0:1788684539.482718:0:22734:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1788684539.482740:0:22734:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1788684539.482746:0:22734:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6648666a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3624:x1875571085922816:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788684539.482776:0:22734:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6648666a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3624:x1875571085922816:12345-0@lo:400:kworker.0 Request processed in 30us (482us total) trans 0 rc 0/0 00000100:00100000:2.0:1788684539.482782:0:22734:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1788684539.482793:0:22734:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1788684539.482798:0:22734:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d677fab4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3623:x1875571085922688:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788684539.482835:0:22734:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d677fab4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3623:x1875571085922688:12345-0@lo:400:kworker.0 Request processed in 37us (512us total) trans 0 rc 0/0 00000100:00100000:2.0:1788684539.482841:0:22734:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1788684539.482855:0:22734:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1788684539.482863:0:22734:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6648666d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3625:x1875571085922944:12345-0@lo:400:kworker.0 00010000:00080000:1.0:1788684539.482872:0:3623:0:(ldlm_request.c:1670:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d677fab4a80 x1875571085922688/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788684555 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788684539.482896:0:22734:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6648666d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3625:x1875571085922944:12345-0@lo:400:kworker.0 Request processed in 34us (466us total) trans 0 rc 0/0 00000100:00100000:2.0:1788684539.482903:0:22734:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1788684539.482957:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d677fab4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3623:1875571085922688:0@lo:400:kworker.0 00000100:00100000:2.0:1788684539.482991:0:22737:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085922048 00000100:00100000:2.0:1788684539.482997:0:22737:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085922048 00000100:00100000:2.0:1788684539.483035:0:22737:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085922304 00000100:00100000:2.0:1788684539.483038:0:22737:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085922304 00000100:00100000:2.0:1788684539.483051:0:22737:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1788684539.483057:0:22737:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6648667800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3624:x1875571085922048:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788684539.483095:0:22737:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6648667800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3624:x1875571085922048:12345-0@lo:400:kworker.0 Request processed in 38us (851us total) trans 0 rc 0/0 00000100:00100000:2.0:1788684539.483101:0:22737:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1788684539.483113:0:22737:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1788684539.483120:0:22737:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6648664700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3625:x1875571085922304:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788684539.483162:0:22737:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6648664700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3625:x1875571085922304:12345-0@lo:400:kworker.0 Request processed in 43us (800us total) trans 0 rc 0/0 00000100:00100000:2.0:1788684539.483169:0:22737:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1788684539.483198:0:24241:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085922432 00000100:00100000:2.0:1788684539.483202:0:24241:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085922432 00000100:00100000:2.0:1788684539.483237:0:24241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788684539.483245:0:24241:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6648665880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3625:x1875571085922432:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788684539.483276:0:24241:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6648665880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3625:x1875571085922432:12345-0@lo:400:kworker.0 Request processed in 32us (795us total) trans 0 rc 0/0 00000100:00100000:2.0:1788684539.483283:0:24241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:2.0:1788684539.483312:0:3624:0:(ldlm_request.c:1670:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d677fab6d80 x1875571085922816/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788684555 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788684539.483323:0:3624:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d677fab6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3624:1875571085922816:0@lo:400:kworker.0 00000100:00100000:2.0:1788684539.483335:0:3624:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d677fab7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3624:1875571085922048:0@lo:400:kworker.0 00010000:00080000:2.0:1788684539.483347:0:3624:0:(ldlm_request.c:1670:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d677fab5500 x1875571085922176/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788684555 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788684539.483356:0:3624:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d677fab5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3624:1875571085922176:0@lo:400:kworker.0 00010000:00080000:2.0:1788684539.483419:0:3625:0:(ldlm_request.c:1670:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d677fab6680 x1875571085922432/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788684555 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788684539.483428:0:3625:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d677fab6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3625:1875571085922432:0@lo:400:kworker.0 00000100:00100000:2.0:1788684539.483438:0:3625:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d677fab5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3625:1875571085922304:0@lo:400:kworker.0 00010000:00080000:2.0:1788684539.483449:0:3625:0:(ldlm_request.c:1670:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d677fab7100 x1875571085922944/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788684555 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788684539.483471:0:3625:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d677fab7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3625:1875571085922944:0@lo:400:kworker.0 00000100:00100000:2.0:1788684539.483500:0:3622:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d677fab4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3622:1875571085922560:0@lo:8:kworker.0 00000100:00100000:2.0:1788684539.483533:0:3622:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788684539.483667:0:24763:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085922560 00000100:00100000:2.0:1788684539.483672:0:24763:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085922560 00000100:00100000:2.0:1788684539.483697:0:24763:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788684539.483702:0:24763:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6648667480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:3622:x1875571085922560:12345-0@lo:8:kworker.0 00000100:00100000:2.0:1788684539.483753:0:24763:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6648667480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:3622:x1875571085922560:12345-0@lo:8:kworker.0 Request processed in 49us (219us total) trans 0 rc -11/-11 00000100:00100000:2.0:1788684539.483760:0:24763:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788684539.483788:0:3622:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:2.0:1788684539.483794:0:3622:0:(import.c:65:import_set_state_nolock()) ffff8d677cc6b000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788684539.483798:0:3622:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-11) 00000100:00100000:2.0:1788684539.483801:0:3622:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d677fab4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3622:1875571085922560:0@lo:8:kworker.0 00010000:00010000:0.0:1788684539.487041:0:25066:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-lwp-OST0001-12 is initialized 00000020:00000080:0.0:1788684539.487232:0:25066:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-lwp-OST0001 (uuid lustre-MDT0001-lwp-OST0001_UUID) 00000010:01000000:0.0:1788684539.487284:0:25066:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1788684539.487296:0:25066:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-lwp-OST0001, cookie 0x44bac02bd54adfe6 00000100:00080000:0.0:1788684539.487305:0:25066:0:(import.c:545:import_select_connection()) lustre-MDT0001-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1788684539.487311:0:25066:0:(import.c:665:import_select_connection()) lustre-MDT0001-lwp-OST0001: import ffff8d6647932000 using connection 192.168.206.144@tcp/0@lo 00000100:00100000:0.0:1788684539.487347:0:25066:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8d67450b0000 x1875571085923072/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788684539.488814:0:25066:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID 00000100:00080000:0.0:1788684539.488848:0:14645:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788684539.488853:0:14645:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1788684539.488856:0:14645:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788684539.488859:0:14645:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1788684539.489058:0:3622:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d67450b0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3622:1875571085923072:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1788684539.489126:0:3622:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788684539.489180:0:22734:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085923072 00000100:00100000:2.0:1788684539.489187:0:22734:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085923072 00000100:00100000:2.0:1788684539.489221:0:22734:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788684539.489228:0:22734:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6648666680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3622:x1875571085923072:12345-0@lo:38:llog_process_th.0 00010000:00080000:2.0:1788684539.489256:0:22734:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0001-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 620 last 0 00000020:00000080:2.0:1788684539.489293:0:22734:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-lwp-OST0001_UUID, cookie 0x44bac02bd54adfed 00000004:00100000:2.0:1788684539.489310:0:22734:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1788684539.489341:0:22734:0:(import.c:65:import_set_state_nolock()) ffff8d6646cbb800 : changing import state from RECOVER to FULL 00000040:00080000:0.0:1788684539.489949:0:25066:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x10:0x0] index 52 count 51 00000100:00100000:2.0:1788684539.490519:0:22734:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6648666680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3622:x1875571085923072:12345-0@lo:38:llog_process_th.0 Request processed in 1288us (1390us total) trans 0 rc 0/0 00000100:00100000:2.0:1788684539.490529:0:22734:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:2.0:1788684539.490599:0:3622:0:(ldlm_request.c:1670:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff8d67450b0000 x1875571085923072/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788684549 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788684539.490611:0:3622:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:2.0:1788684539.490620:0:3622:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-MDT0001-lwp-OST0001: connect to target with instance 3 00000100:00080000:2.0:1788684539.490628:0:3622:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-MDT0001-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:2.0:1788684539.490633:0:3622:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:2.0:1788684539.490635:0:3622:0:(import.c:65:import_set_state_nolock()) ffff8d6647932000 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1788684539.490642:0:3622:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d67450b0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3622:1875571085923072:0@lo:38:llog_process_th.0 00000020:01000000:1.0:1788684539.493222:0:25053:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:1.0:1788684539.493264:0:25053:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.144@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1788684539.493292:0:25053:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.144@tcp lock: ffff8d6746d3f200/0x44bac02bd54adfbc lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x44bac02bd54adfc3 expref: -99 pid: 25053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684539.493305:0:25053:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.144@tcp lock: ffff8d6746d3f200/0x44bac02bd54adfbc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x44bac02bd54adfc3 expref: -99 pid: 25053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:1.0:1788684539.493353:0:25053:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:1.0:1788684539.493355:0:25053:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1788684539.493357:0:25053:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788684539.493358:0:25053:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788684539.493360:0:25053:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788684539.493361:0:25053:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788684539.493362:0:25053:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788684539.493817:0:25053:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788684539.493819:0:25053:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1788684539.493823:0:25053:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020002 00000020:01000004:1.0:1788684539.493825:0:25053:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1788684539.493827:0:25053:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1788684539.493828:0:25053:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788684539.493829:0:25053:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788684539.493830:0:25053:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788684539.493831:0:25053:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788684539.493832:0:25053:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788684539.493833:0:25053:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788684539.493834:0:25053:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1788684539.493859:0:25053:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:1.0:1788684539.493879:0:25053:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d677fab4a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cebd1789-51a4-46ff-b167-6b1633e930a1:25053:1875571085923200:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1788684539.494102:0:25053:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788684539.494146:0:25053:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d6775ea70c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788684539.494416:0:22725:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085923200 00000100:00100000:0.0:1788684539.494424:0:22725:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085923200 00000100:00100000:0.0:1788684539.494474:0:22725:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:0.0:1788684539.494484:0:22725:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6750e70050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cebd1789-51a4-46ff-b167-6b1633e930a1+24:25053:x1875571085923200:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1788684539.494511:0:22725:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:0.0:1788684539.494526:0:22725:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:0.0:1788684539.505819:0:22725:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1788684539.505840:0:22725:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 20000000:01000000:3.0:1788684539.505872:0:22748:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:3.0:1788684539.505879:0:22748:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:3.0:1788684539.505911:0:22748:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8d66479a0e00/0x44bac02bd54adff4 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 22748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684539.505941:0:22748:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8d6746d3e800/0x44bac02bd54adf68 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x44bac02bd54adf61 expref: 24 pid: 22725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684539.505949:0:22748:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8d6746d3f400/0x44bac02bd54adf76 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x44bac02bd54adf6f expref: 24 pid: 22725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684539.505957:0:22748:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8d66479a0e00/0x44bac02bd54adff4 lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 22748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684539.506003:0:22748:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8d6746d3f400/0x44bac02bd54adf76 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x44bac02bd54adf6f expref: 24 pid: 22725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684539.506027:0:22748:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8d6746d3f400/0x44bac02bd54adf76 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x44bac02bd54adf6f expref: 24 pid: 22725 timeout: 720 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788684539.506042:0:22748:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6647909180 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22748:1875571085923328:0@lo:104: 00000100:00100000:3.0:1788684539.506105:0:22748:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788684539.506159:0:22748:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8d6746d3e800/0x44bac02bd54adf68 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x44bac02bd54adf61 expref: 24 pid: 22725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684539.506169:0:22748:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8d6746d3e800/0x44bac02bd54adf68 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x44bac02bd54adf61 expref: 24 pid: 22725 timeout: 720 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788684539.506177:0:22748:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d664790b480 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22748:1875571085923456:0@lo:104: 00000100:00100000:3.0:1788684539.506197:0:22748:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788684539.506222:0:22748:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d6647a8a240 going to sleep for 11 seconds 00000100:00100000:0.0:1788684539.506450:0:22715:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085923328 00000100:00100000:0.0:1788684539.506458:0:22715:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085923328 00000100:00100000:0.0:1788684539.506492:0:22715:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085923456 00000100:00100000:0.0:1788684539.506494:0:22715:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085923456 00000100:00100000:0.0:1788684539.506505:0:22715:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788684539.506512:0:22715:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6647908380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:cebd1789-51a4-46ff-b167-6b1633e930a1+4:22748:x1875571085923328:12345-0@lo:104: 00010000:00010000:0.0:1788684539.506526:0:22715:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.144@tcp lock: ffff8d66479a1e00/0x44bac02bd54adf6f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x44bac02bd54adf76 expref: -99 pid: 22729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684539.506595:0:22715:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788684539.506602:0:22715:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6647908380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:cebd1789-51a4-46ff-b167-6b1633e930a1+4:22748:x1875571085923328:12345-0@lo:104: Request processed in 90us (497us total) trans 0 rc 0/0 00000100:00100000:0.0:1788684539.506610:0:22715:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788684539.506628:0:22748:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6647909180 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22748:1875571085923328:0@lo:104: 00000100:00100000:0.0:1788684539.506631:0:22715:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1788684539.506642:0:22715:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d664790b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:cebd1789-51a4-46ff-b167-6b1633e930a1+3:22748:x1875571085923456:12345-0@lo:104: 00010000:00010000:0.0:1788684539.506649:0:22715:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.144@tcp lock: ffff8d66479a0800/0x44bac02bd54adf61 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x44bac02bd54adf68 expref: -99 pid: 22729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684539.506674:0:22720:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788684539.506686:0:22715:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788684539.506691:0:22715:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d664790b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:cebd1789-51a4-46ff-b167-6b1633e930a1+3:22748:x1875571085923456:12345-0@lo:104: Request processed in 52us (494us total) trans 0 rc 0/0 00000100:00100000:0.0:1788684539.506698:0:22715:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1788684539.506712:0:22748:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d664790b480 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22748:1875571085923456:0@lo:104: 00010000:00010000:3.0:1788684539.506738:0:22748:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8d66479a0e00/0x44bac02bd54adff4 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 22748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788684539.506826:0:22725:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6750e70050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cebd1789-51a4-46ff-b167-6b1633e930a1+24:25053:x1875571085923200:12345-0@lo:253:mount.lustre.0 Request processed in 12343us (12723us total) trans 0 rc 0/0 00000100:00100000:1.0:1788684539.506834:0:22725:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:3.0:1788684539.507358:0:25053:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d677fab4a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cebd1789-51a4-46ff-b167-6b1633e930a1:25053:1875571085923200:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1788684539.507396:0:25053:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:3.0:1788684539.507400:0:25053:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1788684539.507402:0:25053:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1788684539.507403:0:25053:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788684539.507404:0:25053:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788684539.507406:0:25053:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788684539.507407:0:25053:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788684539.507408:0:25053:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788684539.507409:0:25053:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788684539.507411:0:25053:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:3.0:1788684539.507428:0:25053:0:(tgt_mount.c:2698:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 00000001:00000004:1.0:1788684539.511656:0:25053:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 3, last_transno is 12884901888 00010000:00010000:2.0:1788684539.512867:0:22720:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.144@tcp lock: ffff8d66479a1e00/0x44bac02bd54adf6f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x44bac02bd54adf76 expref: -99 pid: 22729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684539.512883:0:22720:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d66479a1e00 already unused, calling callback (ffffffffc1297c20) 10000000:00010000:2.0:1788684539.512897:0:22720:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.144@tcp lock: ffff8d66479a1e00/0x44bac02bd54adf6f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x44bac02bd54adf76 expref: -99 pid: 22729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684539.512908:0:22720:0:(ldlm_request.c:1390:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.144@tcp lock: ffff8d66479a1e00/0x44bac02bd54adf6f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x44bac02bd54adf76 expref: -99 pid: 22729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788684539.512916:0:22720:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.144@tcp lock: ffff8d66479a1e00/0x44bac02bd54adf6f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x44bac02bd54adf76 expref: -99 pid: 22729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788684539.512922:0:22720:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1788684539.513191:0:22720:0:(ldlm_request.c:1438:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.144@tcp lock: ffff8d66479a1e00/0x44bac02bd54adf6f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x44bac02bd54adf76 expref: -99 pid: 22729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684539.513210:0:22720:0:(ldlm_request.c:1497:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788684539.513245:0:22720:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.144@tcp lock: ffff8d66479a1e00/0x44bac02bd54adf6f lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x44bac02bd54adf76 expref: -99 pid: 22729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684539.513254:0:22720:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.144@tcp lock: ffff8d66479a1e00/0x44bac02bd54adf6f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x44bac02bd54adf76 expref: -99 pid: 22729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684539.513268:0:22720:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788684539.513272:0:22720:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.144@tcp lock: ffff8d66479a0800/0x44bac02bd54adf61 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x44bac02bd54adf68 expref: -99 pid: 22729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684539.513278:0:22720:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d66479a0800 already unused, calling callback (ffffffffc1297c20) 10000000:00010000:2.0:1788684539.513281:0:22720:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.144@tcp lock: ffff8d66479a0800/0x44bac02bd54adf61 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x44bac02bd54adf68 expref: -99 pid: 22729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684539.513288:0:22720:0:(ldlm_request.c:1390:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.144@tcp lock: ffff8d66479a0800/0x44bac02bd54adf61 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x44bac02bd54adf68 expref: -99 pid: 22729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788684539.513295:0:22720:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.144@tcp lock: ffff8d66479a0800/0x44bac02bd54adf61 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x44bac02bd54adf68 expref: -99 pid: 22729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788684539.513301:0:22720:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00000100:00100000:1.0:1788684539.513313:0:3625:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00010000:00010000:2.0:1788684539.513317:0:22720:0:(ldlm_request.c:1438:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.144@tcp lock: ffff8d66479a0800/0x44bac02bd54adf61 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x44bac02bd54adf68 expref: -99 pid: 22729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684539.513323:0:22720:0:(ldlm_request.c:1497:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:1.0:1788684539.513335:0:3625:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d664859ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:cebd1789-51a4-46ff-b167-6b1633e930a1:3625:1875571085923584:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788684539.513339:0:22720:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.144@tcp lock: ffff8d66479a0800/0x44bac02bd54adf61 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x44bac02bd54adf68 expref: -99 pid: 22729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684539.513349:0:22720:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.144@tcp lock: ffff8d66479a0800/0x44bac02bd54adf61 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x44bac02bd54adf68 expref: -99 pid: 22729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684539.513389:0:22720:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788684539.513392:0:22720:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788684539.513395:0:22720:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788684539.513407:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d66479a6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:cebd1789-51a4-46ff-b167-6b1633e930a1:3623:1875571085923712:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788684539.513462:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00080000:3.0:1788684539.514899:0:25053:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:3.0:1788684539.514909:0:25053:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:3.0:1788684539.514949:0:25053:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:3.0:1788684539.514990:0:25053:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.206.144@tcp: cl_mgc_mutex unlock 00000020:01000004:3.0:1788684539.515008:0:25053:0:(tgt_mount.c:2464:server_fill_super_common()) Server sb, dev=50 00000080:00000004:3.0:1788684539.515041:0:25053:0:(super25.c:182:lustre_fill_super()) /dev/mapper/ost2_flakey: Mount complete 00010000:00010000:0.0:1788684539.515573:0:22721:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:3.0:1788684539.515965:0:25053:0:(tgt_mount.c:2350:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1788684539.516216:0:25053:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:1.0:1788684539.516814:0:3625:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788684539.516960:0:22719:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085923712 00000100:00100000:1.0:1788684539.516970:0:22719:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085923712 00010000:00010000:1.0:1788684539.517004:0:22719:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8d6746d3e800/0x44bac02bd54adf68 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x44bac02bd54adf61 expref: 24 pid: 22725 timeout: 720 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788684539.517099:0:22719:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085923584 00000100:00100000:1.0:1788684539.517104:0:22719:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085923584 00010000:00010000:1.0:1788684539.517118:0:22719:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8d6746d3f400/0x44bac02bd54adf76 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x44bac02bd54adf6f expref: 25 pid: 22725 timeout: 720 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788684539.518639:0:22718:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788684539.518654:0:22718:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d66479a7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:cebd1789-51a4-46ff-b167-6b1633e930a1+25:3623:x1875571085923712:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788684539.518673:0:22718:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788684539.518682:0:22718:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8d6746d3e800/0x44bac02bd54adf68 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x44bac02bd54adf61 expref: 25 pid: 22725 timeout: 720 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684539.518694:0:22718:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8d6746d3e800/0x44bac02bd54adf68 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x44bac02bd54adf61 expref: 25 pid: 22725 timeout: 720 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684539.518758:0:22718:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d6746d3e800/0x44bac02bd54adf68 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x44bac02bd54adf61 expref: 25 pid: 22725 timeout: 720 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684539.518773:0:22718:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788684539.518847:0:22718:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d66479a7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:cebd1789-51a4-46ff-b167-6b1633e930a1+24:3623:x1875571085923712:12345-0@lo:103:ldlm_bl.0 Request processed in 198us (5385us total) trans 0 rc 0/0 00000100:00100000:0.0:1788684539.518855:0:22718:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788684539.518875:0:22718:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1788684539.518880:0:22718:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d677fab6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:cebd1789-51a4-46ff-b167-6b1633e930a1+23:3625:x1875571085923584:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788684539.518949:0:22718:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788684539.518955:0:22718:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8d6746d3f400/0x44bac02bd54adf76 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x44bac02bd54adf6f expref: 23 pid: 22725 timeout: 720 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684539.519137:0:22718:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8d6746d3f400/0x44bac02bd54adf76 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x44bac02bd54adf6f expref: 23 pid: 22725 timeout: 720 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684539.519149:0:22718:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d6746d3f400/0x44bac02bd54adf76 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x44bac02bd54adf6f expref: 23 pid: 22725 timeout: 720 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684539.519160:0:22718:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8d66479a0e00/0x44bac02bd54adff4 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 22748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684539.519168:0:22718:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d66479a0e00/0x44bac02bd54adff4 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 22748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1788684539.519183:0:22718:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.024186502s 00010000:00010000:0.0:1788684539.519187:0:22718:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8d66479a0e00/0x44bac02bd54adff4 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 22748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684539.519194:0:22718:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8d66479a0e00/0x44bac02bd54adff4 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 22748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684539.519200:0:22718:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8d66479a0e00/0x44bac02bd54adff4 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 22748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684539.519215:0:22718:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8d66479a0e00/0x44bac02bd54adff4 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 22748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684539.519221:0:22718:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d66479a0e00 already unused, calling callback (ffffffffc0cae340) 00010000:00010000:0.0:1788684539.519226:0:22718:0:(ldlm_request.c:377:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8d66479a0e00/0x44bac02bd54adff4 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 22748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684539.519234:0:22718:0:(ldlm_request.c:1415:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8d66479a0e00/0x44bac02bd54adff4 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 22748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684539.519309:0:22718:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8d66479a0e00/0x44bac02bd54adff4 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684539.519320:0:22718:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788684539.519354:0:22718:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d677fab6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:cebd1789-51a4-46ff-b167-6b1633e930a1+22:3625:x1875571085923584:12345-0@lo:103:ldlm_bl.0 Request processed in 474us (2543us total) trans 0 rc 0/0 00000100:00100000:0.0:1788684539.519361:0:22718:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00010000:0.0:1788684539.519445:0:22748:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8d66479a0e00/0x44bac02bd54adff4 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684539.519514:0:22748:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8d66479a0e00/0x44bac02bd54adff4 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684539.519521:0:22748:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d66479a0e00/0x44bac02bd54adff4 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22748 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788684539.519562:0:3625:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d664859ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:cebd1789-51a4-46ff-b167-6b1633e930a1:3625:1875571085923584:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788684539.520434:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d66479a6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:cebd1789-51a4-46ff-b167-6b1633e930a1:3623:1875571085923712:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788684539.581515:0:22720:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788684540.032188:0:3623:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788684540.032223:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d67450b2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3623:1875571085923840:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788684540.032293:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788684540.032391:0:22737:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085923840 00000100:00100000:0.0:1788684540.032399:0:22737:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085923840 00000100:00100000:0.0:1788684540.032461:0:22737:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1788684540.032470:0:22737:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d677fab5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3623:x1875571085923840:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1788684540.032503:0:22737:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446309888 avail 1300070400 00000100:00100000:0.0:1788684540.032551:0:22737:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d677fab5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3623:x1875571085923840:12345-0@lo:41:osp-pre-0-1.0 Request processed in 82us (257us total) trans 0 rc 0/0 00000100:00100000:0.0:1788684540.032559:0:22737:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1788684540.032783:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d67450b2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3623:1875571085923840:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788684540.032976:0:3626:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788684540.032987:0:3626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d66479a6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3626:1875571085923968:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788684540.033031:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788684540.033729:0:22738:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085923968 00000100:00100000:2.0:1788684540.033737:0:22738:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085923968 00000100:00100000:2.0:1788684540.033770:0:22738:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1788684540.033777:0:22738:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d664790b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3626:x1875571085923968:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1788684540.033803:0:22738:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:2.0:1788684540.033860:0:22738:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d664790b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3626:x1875571085923968:12345-0@lo:41:osp-pre-1-0.0 Request processed in 83us (828us total) trans 0 rc 0/0 00000100:00100000:2.0:1788684540.033867:0:22738:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1788684540.033942:0:3626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d66479a6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3626:1875571085923968:0@lo:41:osp-pre-1-0.0 00000020:00000004:3.0:1788684540.461033:0:25119:0:(tgt_mount.c:2350:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1788684540.461325:0:25119:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1788684540.611400:0:22721:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1788684540.994381:0:22729:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1788684540.994387:0:22729:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8d6647429800 from 14 10000000:01000000:0.0:1788684540.994391:0:22729:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1788684540.994438:0:22729:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.144@tcp lock: ffff8d6746d3f400/0x44bac02bd54adffb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684540.994449:0:22729:0:(ldlm_request.c:1106:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.144@tcp lock: ffff8d6746d3f400/0x44bac02bd54adffb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684540.994461:0:22729:0:(ldlm_request.c:1193:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.144@tcp lock: ffff8d6746d3f400/0x44bac02bd54adffb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788684540.994498:0:22729:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d67450b3480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cebd1789-51a4-46ff-b167-6b1633e930a1:22729:1875571085924096:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788684540.994563:0:22729:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788684540.994600:0:22729:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d677e2ba000 going to sleep for 11 seconds 00000100:00100000:0.0:1788684540.994620:0:22727:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085924096 00000100:00100000:0.0:1788684540.994626:0:22727:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085924096 00000100:00100000:0.0:1788684540.994683:0:22727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:0.0:1788684540.994692:0:22727:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6750e73c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cebd1789-51a4-46ff-b167-6b1633e930a1+22:22729:x1875571085924096:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788684540.994704:0:22727:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788684540.994717:0:22727:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d6746d3e800/0x44bac02bd54ae002 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x44bac02bd54adffb expref: -99 pid: 22727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684540.994753:0:22727:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d6746d3e800/0x44bac02bd54ae002 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x44bac02bd54adffb expref: 23 pid: 22727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684540.994764:0:22727:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d6746d3e800/0x44bac02bd54ae002 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x44bac02bd54adffb expref: 23 pid: 22727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684540.994772:0:22727:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d6746d3e800, rc 0) 00000100:00100000:0.0:1788684540.994825:0:22727:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6750e73c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cebd1789-51a4-46ff-b167-6b1633e930a1+23:22729:x1875571085924096:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 120us (248us total) trans 0 rc 0/0 00000100:00100000:0.0:1788684540.994833:0:22727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:0.0:1788684540.994889:0:22729:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d67450b3480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cebd1789-51a4-46ff-b167-6b1633e930a1:22729:1875571085924096:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788684540.994905:0:22729:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.144@tcp lock: ffff8d6746d3f400/0x44bac02bd54adffb lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x44bac02bd54ae002 expref: -99 pid: 22729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684540.994914:0:22729:0:(ldlm_request.c:840:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.144@tcp lock: ffff8d6746d3f400/0x44bac02bd54adffb lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x44bac02bd54ae002 expref: -99 pid: 22729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788684540.994959:0:22729:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d67450b3480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cebd1789-51a4-46ff-b167-6b1633e930a1:22729:1875571085924224:0@lo:256:ll_cfg_requeue.0 00000100:00100000:0.0:1788684540.994991:0:22729:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788684540.995007:0:22729:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d677e2ba000 going to sleep for 11 seconds 00000100:00100000:0.0:1788684540.995032:0:22725:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085924224 00000100:00100000:0.0:1788684540.995035:0:22725:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085924224 00000100:00100000:0.0:1788684540.995058:0:22725:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:0.0:1788684540.995064:0:22725:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6750e71c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cebd1789-51a4-46ff-b167-6b1633e930a1+23:22729:x1875571085924224:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:0.0:1788684540.995076:0:22725:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1788684540.995092:0:22725:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1788684540.995100:0:22725:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 14 00000100:00100000:0.0:1788684540.995171:0:22725:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6750e71c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cebd1789-51a4-46ff-b167-6b1633e930a1+23:22729:x1875571085924224:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 106us (178us total) trans 0 rc 0/0 00000100:00100000:0.0:1788684540.995316:0:22725:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:0.0:1788684540.995355:0:22729:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d67450b3480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cebd1789-51a4-46ff-b167-6b1633e930a1:22729:1875571085924224:0@lo:256:ll_cfg_requeue.0 10000000:01000000:0.0:1788684540.995428:0:22729:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.144@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1788684540.995435:0:22729:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.144@tcp lock: ffff8d6746d3f400/0x44bac02bd54adffb lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x44bac02bd54ae002 expref: -99 pid: 22729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684540.995442:0:22729:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.144@tcp lock: ffff8d6746d3f400/0x44bac02bd54adffb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x44bac02bd54ae002 expref: -99 pid: 22729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788684540.995451:0:22729:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1788684540.995453:0:22729:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff8d677cb59000 from 14 10000000:01000000:0.0:1788684540.995455:0:22729:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1788684540.995472:0:22729:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.144@tcp lock: ffff8d6746d3e000/0x44bac02bd54ae009 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684540.995480:0:22729:0:(ldlm_request.c:1106:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.144@tcp lock: ffff8d6746d3e000/0x44bac02bd54ae009 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684540.995488:0:22729:0:(ldlm_request.c:1193:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.144@tcp lock: ffff8d6746d3e000/0x44bac02bd54ae009 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788684540.995500:0:22729:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d67450b3480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cebd1789-51a4-46ff-b167-6b1633e930a1:22729:1875571085924352:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788684540.995525:0:22729:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788684540.995539:0:22729:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d677e2ba000 going to sleep for 11 seconds 00000100:00100000:0.0:1788684540.995550:0:22725:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085924352 00000100:00100000:0.0:1788684540.995554:0:22725:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085924352 00000100:00100000:0.0:1788684540.995584:0:22725:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:0.0:1788684540.995590:0:22725:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67511ad850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cebd1789-51a4-46ff-b167-6b1633e930a1+23:22729:x1875571085924352:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788684540.995597:0:22725:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788684540.995617:0:22725:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d6765f61e00/0x44bac02bd54ae010 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x44bac02bd54ae009 expref: -99 pid: 22725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684540.995634:0:22725:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d6765f61e00/0x44bac02bd54ae010 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x44bac02bd54ae009 expref: 24 pid: 22725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684540.995643:0:22725:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d6765f61e00/0x44bac02bd54ae010 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x44bac02bd54ae009 expref: 24 pid: 22725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684540.995649:0:22725:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d6765f61e00, rc 0) 00000100:00100000:0.0:1788684540.995677:0:22725:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67511ad850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cebd1789-51a4-46ff-b167-6b1633e930a1+24:22729:x1875571085924352:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 88us (152us total) trans 0 rc 0/0 00000100:00100000:0.0:1788684540.995684:0:22725:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:0.0:1788684540.995713:0:22729:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d67450b3480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cebd1789-51a4-46ff-b167-6b1633e930a1:22729:1875571085924352:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788684540.995723:0:22729:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.144@tcp lock: ffff8d6746d3e000/0x44bac02bd54ae009 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x44bac02bd54ae010 expref: -99 pid: 22729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684540.995730:0:22729:0:(ldlm_request.c:840:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.144@tcp lock: ffff8d6746d3e000/0x44bac02bd54ae009 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x44bac02bd54ae010 expref: -99 pid: 22729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788684540.995764:0:22729:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d67450b3480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cebd1789-51a4-46ff-b167-6b1633e930a1:22729:1875571085924480:0@lo:256:ll_cfg_requeue.0 00000100:00100000:0.0:1788684540.995787:0:22729:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788684540.995799:0:22729:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d6647a8ad80 going to sleep for 11 seconds 00000100:00100000:0.0:1788684540.995809:0:22725:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085924480 00000100:00100000:0.0:1788684540.995812:0:22725:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085924480 00000100:00100000:0.0:1788684540.995837:0:22725:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:0.0:1788684540.995842:0:22725:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67511af450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cebd1789-51a4-46ff-b167-6b1633e930a1+24:22729:x1875571085924480:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:0.0:1788684540.995850:0:22725:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1788684540.995860:0:22725:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1788684540.995863:0:22725:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 14 00000100:00100000:0.0:1788684540.996186:0:22725:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67511af450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cebd1789-51a4-46ff-b167-6b1633e930a1+24:22729:x1875571085924480:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 343us (397us total) trans 0 rc 0/0 00000100:00100000:0.0:1788684540.996194:0:22725:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:0.0:1788684540.996226:0:22729:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d67450b3480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cebd1789-51a4-46ff-b167-6b1633e930a1:22729:1875571085924480:0@lo:256:ll_cfg_requeue.0 10000000:01000000:0.0:1788684540.996268:0:22729:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.144@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1788684540.996274:0:22729:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.144@tcp lock: ffff8d6746d3e000/0x44bac02bd54ae009 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x44bac02bd54ae010 expref: -99 pid: 22729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684540.996281:0:22729:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.144@tcp lock: ffff8d6746d3e000/0x44bac02bd54ae009 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x44bac02bd54ae010 expref: -99 pid: 22729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788684541.566413:0:3622:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788684521/real 1788684521] req@ffff8d677fa83800 x1875571085910016/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788684541 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788684541.566441:0:3622:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8d677fa83800 x1875571085910016/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788684541 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788684541.566458:0:3622:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788684521/real 1788684521] req@ffff8d677fa82a00 x1875571085910144/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788684541 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788684541.566469:0:3622:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff8d677fa82a00 x1875571085910144/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788684541 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1788684541.566487:0:3622:0:(import.c:65:import_set_state_nolock()) ffff8d677fab9000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788684541.566512:0:3622:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:3.0:1788684541.566516:0:3622:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d677fa83800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3622:1875571085910016:0@lo:8:kworker.0 00000100:00080000:3.0:1788684541.566522:0:3622:0:(import.c:65:import_set_state_nolock()) ffff8d6775fa5800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788684541.566526:0:3622:0:(import.c:1555:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:3.0:1788684541.566528:0:3622:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d677fa82a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3622:1875571085910144:0@lo:8:kworker.0 00000100:00080000:2.0:1788684541.566645:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788684541.566650:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:2.0:1788684541.566653:0:38:0:(import.c:65:import_set_state_nolock()) ffff8d677fab9000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788684541.566658:0:38:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 602 00000100:00080000:2.0:1788684541.566664:0:38:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 15s 00000100:00080000:2.0:1788684541.566670:0:38:0:(import.c:665:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff8d677fab9000 using connection 192.168.206.144@tcp/0@lo 00000100:00100000:2.0:1788684541.566691:0:38:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8d66479a6300 x1875571085924864/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788684541.566706:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788684541.566715:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1788684541.566718:0:38:0:(import.c:65:import_set_state_nolock()) ffff8d6775fa5800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788684541.566721:0:38:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 602 00000100:00080000:2.0:1788684541.566724:0:38:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 15s 00000100:00080000:2.0:1788684541.566728:0:38:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff8d6775fa5800 using connection 192.168.206.144@tcp/0@lo 00000100:00100000:2.0:1788684541.566755:0:38:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8d66479a4a80 x1875571085924992/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788684541.566783:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788684541.566786:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1788684541.566787:0:38:0:(import.c:65:import_set_state_nolock()) ffff8d677cc6b000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788684541.566792:0:38:0:(import.c:665:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff8d677cc6b000 using connection 192.168.206.144@tcp/0@lo 00000100:00100000:2.0:1788684541.566811:0:38:0:(import.c:870:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff8d66479a5500 x1875571085925504/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788684541.566873:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d66479a5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3623:1875571085924736:0@lo:400:kworker.0 00000100:00100000:2.0:1788684541.566931:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788684541.566961:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d66479a7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3623:1875571085925632:0@lo:400:kworker.0 00000100:00100000:2.0:1788684541.566985:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788684541.567002:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d66479a4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3623:1875571085926144:0@lo:400:kworker.0 00000100:00100000:2.0:1788684541.567035:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788684541.567066:0:3623:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1788684541.567073:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d66479a6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3623:1875571085925120:0@lo:400:kworker.0 00000100:00100000:2.0:1788684541.567094:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788684541.567110:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d66479a7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3623:1875571085925760:0@lo:400:kworker.0 00000100:00100000:2.0:1788684541.567130:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788684541.567168:0:24164:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085924736 00000100:00100000:2.0:1788684541.567174:0:24164:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085924736 00000100:00100000:2.0:1788684541.567215:0:24164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1788684541.567223:0:24164:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d66479a4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3623:x1875571085924736:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788684541.567272:0:24164:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d66479a4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3623:x1875571085924736:12345-0@lo:400:kworker.0 Request processed in 50us (341us total) trans 0 rc 0/0 00000100:00100000:2.0:1788684541.567280:0:24164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1788684541.567304:0:22732:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085925632 00000100:00100000:2.0:1788684541.567307:0:22732:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085925632 00000100:00100000:2.0:1788684541.567329:0:22732:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085926144 00000100:00100000:2.0:1788684541.567332:0:22732:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085926144 00000100:00100000:2.0:1788684541.567352:0:22732:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085925120 00000100:00100000:2.0:1788684541.567355:0:22732:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085925120 00000100:00100000:2.0:1788684541.567363:0:22732:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085925760 00000100:00100000:2.0:1788684541.567386:0:22732:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085925760 00000100:00100000:2.0:1788684541.567403:0:22732:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1788684541.567408:0:22732:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d66479a5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3623:x1875571085925632:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788684541.567445:0:22732:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d66479a5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3623:x1875571085925632:12345-0@lo:400:kworker.0 Request processed in 36us (459us total) trans 0 rc 0/0 00000100:00100000:2.0:1788684541.567451:0:22732:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1788684541.567462:0:22732:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1788684541.567468:0:22732:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d66479a5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3623:x1875571085926144:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788684541.567493:0:22732:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d66479a5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3623:x1875571085926144:12345-0@lo:400:kworker.0 Request processed in 26us (457us total) trans 0 rc 0/0 00000100:00100000:2.0:1788684541.567498:0:22732:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1788684541.567508:0:22732:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1788684541.567514:0:22732:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d66479a6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3623:x1875571085925120:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788684541.567539:0:22732:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d66479a6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3623:x1875571085925120:12345-0@lo:400:kworker.0 Request processed in 25us (444us total) trans 0 rc 0/0 00000100:00100000:2.0:1788684541.567551:0:22732:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1788684541.567565:0:22732:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1788684541.567570:0:22732:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6647a62a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3623:x1875571085925760:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788684541.567598:0:22732:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6647a62a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3623:x1875571085925760:12345-0@lo:400:kworker.0 Request processed in 28us (468us total) trans 0 rc 0/0 00000100:00100000:2.0:1788684541.567604:0:22732:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00080000:2.0:1788684541.567633:0:22728:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788684541.567636:0:22728:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788684541.567646:0:3622:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d66479a6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3622:1875571085924864:0@lo:8:kworker.0 00000100:00100000:2.0:1788684541.567671:0:3622:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788684541.567699:0:3622:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d66479a4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3622:1875571085924992:0@lo:8:kworker.0 00000100:00100000:2.0:1788684541.567731:0:3622:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788684541.567748:0:3622:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d66479a5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3622:1875571085925504:0@lo:8:kworker.0 00000100:00100000:2.0:1788684541.567767:0:3622:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788684541.567792:0:24241:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085924864 00000100:00100000:2.0:1788684541.567796:0:24241:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085924864 00000100:00100000:2.0:1788684541.567812:0:24241:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085924992 00000100:00100000:2.0:1788684541.567815:0:24241:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085924992 00000100:00100000:2.0:1788684541.567822:0:24241:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085925504 00000100:00100000:2.0:1788684541.567824:0:24241:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085925504 00000100:00100000:2.0:1788684541.567832:0:24241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1788684541.567837:0:24241:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6647a63b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3622:x1875571085924864:12345-0@lo:8:kworker.0 00010000:00080000:2.0:1788684541.567861:0:24241:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 622 last 0 00000020:00000080:2.0:1788684541.567890:0:24241:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x44bac02bd54ae017 00002000:00100000:2.0:1788684541.567904:0:24241:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff8d6646cbe000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a02 ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:2.0:1788684541.567908:0:24241:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00002000:00100000:2.0:1788684541.567916:0:24241:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:2.0:1788684541.567983:0:24241:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1788684541.568020:0:24241:0:(import.c:65:import_set_state_nolock()) ffff8d6646cba800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788684541.568057:0:24241:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6647a63b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3622:x1875571085924864:12345-0@lo:8:kworker.0 Request processed in 219us (384us total) trans 0 rc 0/0 00000100:00100000:2.0:1788684541.568064:0:24241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1788684541.568076:0:24241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1788684541.568080:0:24241:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6647a61c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3622:x1875571085924992:12345-0@lo:8:kworker.0 00010000:00080000:2.0:1788684541.568094:0:24241:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 622 last 0 00000020:00000080:2.0:1788684541.568109:0:24241:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x44bac02bd54ae01e 00002000:00100000:2.0:1788684541.568115:0:24241:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff8d6646cbd000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a02 ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:2.0:1788684541.568118:0:24241:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00002000:00100000:2.0:1788684541.568120:0:24241:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:2.0:1788684541.568248:0:24241:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1788684541.568260:0:24241:0:(import.c:65:import_set_state_nolock()) ffff8d6646cbc000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788684541.568288:0:24241:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6647a61c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3622:x1875571085924992:12345-0@lo:8:kworker.0 Request processed in 206us (555us total) trans 0 rc 0/0 00000100:00100000:2.0:1788684541.568294:0:24241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1788684541.568306:0:24241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1788684541.568310:0:24241:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6647a61500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3622:x1875571085925504:12345-0@lo:8:kworker.0 00010000:00080000:2.0:1788684541.568322:0:24241:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 622 last 0 00000020:00000080:2.0:1788684541.568335:0:24241:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x44bac02bd54ae025 00002000:00100000:2.0:1788684541.568341:0:24241:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0001-mdtlov_UUID/ffff8d6646cbc800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a02 ocd_grant: 0 ocd_index: 1 ocd_group 1 00002000:00080000:2.0:1788684541.568344:0:24241:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 1 00002000:00100000:2.0:1788684541.568345:0:24241:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:2.0:1788684541.568388:0:24241:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 1 00000100:00080000:2.0:1788684541.568405:0:24241:0:(import.c:65:import_set_state_nolock()) ffff8d6646cbf000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788684541.568432:0:24241:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6647a61500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+6:3622:x1875571085925504:12345-0@lo:8:kworker.0 Request processed in 120us (663us total) trans 0 rc 0/0 00000100:00100000:2.0:1788684541.568438:0:24241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00010000:00080000:2.0:1788684541.568484:0:3623:0:(ldlm_request.c:1670:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d66479a6d80 x1875571085925120/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788684557 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788684541.568498:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d66479a6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3623:1875571085925120:0@lo:400:kworker.0 00010000:00080000:2.0:1788684541.568510:0:3623:0:(ldlm_request.c:1670:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d66479a7100 x1875571085925760/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788684557 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788684541.568518:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d66479a7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3623:1875571085925760:0@lo:400:kworker.0 00000100:00100000:2.0:1788684541.568529:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d66479a5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3623:1875571085924736:0@lo:400:kworker.0 00010000:00080000:2.0:1788684541.568538:0:3623:0:(ldlm_request.c:1670:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d66479a7480 x1875571085925632/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788684557 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788684541.568547:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d66479a7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3623:1875571085925632:0@lo:400:kworker.0 00010000:00080000:2.0:1788684541.568557:0:3623:0:(ldlm_request.c:1670:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d66479a4380 x1875571085926144/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788684557 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788684541.568565:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d66479a4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3623:1875571085926144:0@lo:400:kworker.0 00010000:00080000:2.0:1788684541.568601:0:3622:0:(ldlm_request.c:1670:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d66479a6300 x1875571085924864/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788684566 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788684541.568608:0:3622:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1788684541.568616:0:3622:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 3 00000100:00080000:2.0:1788684541.568623:0:3622:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:2.0:1788684541.568628:0:3622:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:2.0:1788684541.568637:0:3622:0:(import.c:65:import_set_state_nolock()) ffff8d677fab9000 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:2.0:1788684541.568653:0:3622:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:2.0:1788684541.568659:0:3622:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d66479a6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3622:1875571085924864:0@lo:8:kworker.0 00010000:00080000:2.0:1788684541.568673:0:3622:0:(ldlm_request.c:1670:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d66479a4a80 x1875571085924992/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788684566 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788684541.568679:0:3622:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1788684541.568683:0:3622:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 3 00000100:00080000:2.0:1788684541.568687:0:3622:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:2.0:1788684541.568689:0:3622:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:2.0:1788684541.568691:0:3622:0:(import.c:65:import_set_state_nolock()) ffff8d6775fa5800 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:2.0:1788684541.568700:0:3622:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:2.0:1788684541.568703:0:3622:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d66479a4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3622:1875571085924992:0@lo:8:kworker.0 00010000:00080000:2.0:1788684541.568715:0:3622:0:(ldlm_request.c:1670:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d66479a5500 x1875571085925504/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788684566 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1788684541.568723:0:3622:0:(import.c:1176:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0001: connect to target with instance 3 00000100:00080000:2.0:1788684541.568727:0:3622:0:(import.c:1000:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0001: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:2.0:1788684541.568729:0:3622:0:(import.c:1257:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:2.0:1788684541.568731:0:3622:0:(import.c:65:import_set_state_nolock()) ffff8d677cc6b000 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:2.0:1788684541.568741:0:3622:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:2.0:1788684541.568744:0:3622:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d66479a5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3622:1875571085925504:0@lo:8:kworker.0 00000004:00080000:2.0:1788684541.568787:0:22757:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x280000401:0x5:0x0] 00000100:00100000:2.0:1788684541.568802:0:22757:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6647a62d80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:22757:1875571085926400:0@lo:5:osp-pre-0-0.0 00000100:00100000:2.0:1788684541.568826:0:22757:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788684541.568840:0:22757:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d677708f9c0 going to sleep for 11 seconds 00000004:00080000:2.0:1788684541.568853:0:22756:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:2.0:1788684541.568905:0:22756:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 622562538451ns, next at 0ns, rc = 0 00080000:00080000:2.0:1788684541.568919:0:22756:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0000: async commit OSD 00000004:00080000:2.0:1788684541.568951:0:22759:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x2c0000401:0x22:0x0] 00000100:00100000:2.0:1788684541.568964:0:22759:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6647a60700 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:22759:1875571085926656:0@lo:5:osp-pre-1-0.0 00000100:00100000:2.0:1788684541.568985:0:22759:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788684541.568999:0:22759:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d677708fd80 going to sleep for 11 seconds 00000004:00080000:2.0:1788684541.569034:0:23475:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0001: going to cleanup orphans since [0x2c0000400:0x1:0x0] 00000100:00100000:2.0:1788684541.569046:0:23475:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6647a62300 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:23475:1875571085926912:0@lo:7:osp-pre-1-1.0 00000100:00100000:2.0:1788684541.569066:0:23475:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788684541.569080:0:23475:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d677708f180 going to sleep for 11 seconds 00000004:00080000:2.0:1788684541.569090:0:23474:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:2.0:1788684541.569127:0:23474:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 622562760469ns, next at 0ns, rc = 0 00080000:00080000:2.0:1788684541.569131:0:23474:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0001: async commit OSD 00000100:00100000:2.0:1788684541.569338:0:24238:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085926400 00000100:00100000:2.0:1788684541.569344:0:24238:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085926400 00000100:00100000:2.0:1788684541.569397:0:24238:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085926656 00000100:00100000:2.0:1788684541.569400:0:24238:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085926656 00000100:00100000:2.0:1788684541.569409:0:24238:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085926912 00000100:00100000:2.0:1788684541.569411:0:24238:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085926912 00000100:00100000:2.0:1788684541.569423:0:24238:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788684541.569429:0:24238:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6647a60380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:22757:x1875571085926400:12345-0@lo:5:osp-pre-0-0.0 00000100:00100000:3.0:1788684541.569649:0:3626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d66479a6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:cebd1789-51a4-46ff-b167-6b1633e930a1:3626:1875571085924608:0@lo:400:kworker.0 00000100:00100000:3.0:1788684541.569686:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788684541.569705:0:3626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d66479a4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3626:1875571085925376:0@lo:400:kworker.0 00000100:00100000:3.0:1788684541.569728:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788684541.569738:0:3626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d66479a4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3626:1875571085926016:0@lo:400:kworker.0 00000100:00100000:3.0:1788684541.569760:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788684541.569777:0:3626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6647a63480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3626:1875571085926784:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788684541.569814:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788684541.569836:0:3626:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:3.0:1788684541.569842:0:3626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d66479a7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3626:1875571085925248:0@lo:400:kworker.0 00000100:00100000:3.0:1788684541.569865:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788684541.569884:0:3626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d66479a5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3626:1875571085925888:0@lo:400:kworker.0 00000100:00100000:3.0:1788684541.569919:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788684541.569936:0:3626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6647a60000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3626:1875571085926528:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788684541.569972:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788684541.569999:0:22725:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085924608 00000100:00100000:3.0:1788684541.570004:0:22725:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085924608 00000100:00100000:3.0:1788684541.570045:0:22725:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:3.0:1788684541.570051:0:22725:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67511ac050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cebd1789-51a4-46ff-b167-6b1633e930a1+24:3626:x1875571085924608:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788684541.570092:0:22725:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67511ac050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cebd1789-51a4-46ff-b167-6b1633e930a1+24:3626:x1875571085924608:12345-0@lo:400:kworker.0 Request processed in 41us (405us total) trans 0 rc 0/0 00000100:00100000:3.0:1788684541.570099:0:22725:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:3.0:1788684541.570129:0:22737:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085925248 00000100:00100000:3.0:1788684541.570132:0:22737:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085925248 00000100:00100000:3.0:1788684541.570154:0:22737:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1788684541.570160:0:22737:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6647908700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3626:x1875571085925248:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788684541.570188:0:22737:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6647908700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3626:x1875571085925248:12345-0@lo:400:kworker.0 Request processed in 29us (323us total) trans 0 rc 0/0 00000100:00100000:3.0:1788684541.570194:0:22737:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1788684541.570224:0:3626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d66479a7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3626:1875571085925248:0@lo:400:kworker.0 00000100:00100000:3.0:1788684541.570233:0:3626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d66479a6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:cebd1789-51a4-46ff-b167-6b1633e930a1:3626:1875571085924608:0@lo:400:kworker.0 00000100:00100000:3.0:1788684541.570451:0:24240:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085925376 00000100:00100000:3.0:1788684541.570456:0:24240:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085925376 00000100:00100000:3.0:1788684541.570477:0:24240:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788684541.570482:0:24240:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6647909180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3626:x1875571085925376:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788684541.570516:0:24240:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6647909180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3626:x1875571085925376:12345-0@lo:400:kworker.0 Request processed in 34us (787us total) trans 0 rc 0/0 00000100:00100000:3.0:1788684541.570531:0:24240:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788684541.571927:0:24240:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1788684541.571943:0:24240:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6647a63100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:22759:x1875571085926656:12345-0@lo:5:osp-pre-1-0.0 00000100:00100000:3.0:1788684541.572173:0:3624:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6647a60a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3624:1875571085926272:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788684541.572227:0:3624:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1788684541.572268:0:22728:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788684541.572273:0:22728:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1788684541.572317:0:3626:0:(ldlm_request.c:1670:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d66479a4e00 x1875571085925376/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788684557 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788684541.572331:0:3626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d66479a4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3626:1875571085925376:0@lo:400:kworker.0 00000100:00100000:3.0:1788684541.572443:0:24243:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085926784 00000100:00100000:3.0:1788684541.572449:0:24243:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085926784 00000100:00100000:3.0:1788684541.572475:0:24243:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085926528 00000100:00100000:3.0:1788684541.572478:0:24243:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085926528 00000100:00100000:3.0:1788684541.572487:0:24243:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085926272 00000100:00100000:3.0:1788684541.572489:0:24243:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085926272 00000100:00100000:3.0:1788684541.572500:0:24243:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788684541.572506:0:24243:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6647909c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+7:3626:x1875571085926784:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1788684541.572543:0:24243:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3915849728 avail 3684327424 00000100:00100000:3.0:1788684541.572588:0:24243:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6647909c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+7:3626:x1875571085926784:12345-0@lo:13:osp-pre-1-1.0 Request processed in 82us (2773us total) trans 0 rc 0/0 00000100:00100000:3.0:1788684541.572595:0:24243:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788684541.572608:0:24243:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788684541.572613:0:24243:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d66477edc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3626:x1875571085926528:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788684541.572622:0:24243:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3915849728 avail 3684327424 00000100:00100000:3.0:1788684541.572655:0:24243:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d66477edc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3626:x1875571085926528:12345-0@lo:13:osp-pre-1-0.0 Request processed in 42us (2682us total) trans 0 rc 0/0 00000100:00100000:3.0:1788684541.572661:0:24243:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788684541.572672:0:24243:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788684541.572677:0:24243:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d66477ee300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3624:x1875571085926272:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788684541.572690:0:24243:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923513344 avail 3691991040 00000100:00100000:3.0:1788684541.572720:0:24243:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d66477ee300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3624:x1875571085926272:12345-0@lo:13:osp-pre-0-0.0 Request processed in 43us (493us total) trans 0 rc 0/0 00000100:00100000:3.0:1788684541.572726:0:24243:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788684541.572760:0:22733:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085926016 00000100:00100000:3.0:1788684541.572764:0:22733:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085926016 00000100:00100000:3.0:1788684541.572800:0:22733:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085925888 00000100:00100000:3.0:1788684541.572803:0:22733:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085925888 00000100:00100000:3.0:1788684541.572824:0:22733:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1788684541.572829:0:22733:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d664790b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3626:x1875571085926016:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788684541.572869:0:22733:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d664790b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3626:x1875571085926016:12345-0@lo:400:kworker.0 Request processed in 39us (3107us total) trans 0 rc 0/0 00000100:00100000:3.0:1788684541.572876:0:22733:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1788684541.572890:0:22733:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1788684541.572897:0:22733:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d664790a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3626:x1875571085925888:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788684541.572926:0:22733:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d664790a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3626:x1875571085925888:12345-0@lo:400:kworker.0 Request processed in 30us (3006us total) trans 0 rc 0/0 00000100:00100000:3.0:1788684541.572932:0:22733:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000004:00080000:1.0:1788684541.572938:0:22758:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000100:00080000:3.0:1788684541.572948:0:22728:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1788684541.572952:0:22728:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:3.0:1788684541.572971:0:3624:0:(ldlm_request.c:1670:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d6647a60a80 x1875571085926272/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788684557 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788684541.573001:0:3624:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6647a60a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3624:1875571085926272:0@lo:13:osp-pre-0-0.0 00000004:00080000:1.0:1788684541.573047:0:22758:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 622566680101ns, next at 0ns, rc = 0 00010000:00080000:3.0:1788684541.573052:0:3626:0:(ldlm_request.c:1670:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d66479a5180 x1875571085925888/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788684557 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00080000:00080000:1.0:1788684541.573056:0:22758:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0000: async commit OSD 00000100:00100000:3.0:1788684541.573067:0:3626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d66479a5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3626:1875571085925888:0@lo:400:kworker.0 00010000:00080000:3.0:1788684541.573081:0:3626:0:(ldlm_request.c:1670:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d6647a60000 x1875571085926528/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788684557 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788684541.573092:0:3626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6647a60000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3626:1875571085926528:0@lo:13:osp-pre-1-0.0 00010000:00080000:3.0:1788684541.573103:0:3626:0:(ldlm_request.c:1670:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d66479a4700 x1875571085926016/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788684557 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788684541.573110:0:3626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d66479a4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3626:1875571085926016:0@lo:400:kworker.0 00010000:00080000:3.0:1788684541.573120:0:3626:0:(ldlm_request.c:1670:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d6647a63480 x1875571085926784/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788684557 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788684541.573131:0:3626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6647a63480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3626:1875571085926784:0@lo:13:osp-pre-1-1.0 00002000:00080000:3.0:1788684541.585041:0:24240:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x2c0000401 00002000:00080000:3.0:1788684541.585063:0:24240:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 65 -> diff = -31 00002000:02000040:3.0:1788684541.585070:0:24240:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x2c0000401:35 to 0x2c0000401:65) 00000004:00080000:2.0:1788684541.588452:0:23464:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 1 committed 00000004:00080000:3.0:1788684541.597806:0:22711:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00002000:00010000:2.0:1788684541.598456:0:24240:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x41:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788684541.598467:0:24240:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000174c6641/0x44bac02bd54ae02c lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684541.598484:0:24240:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x41:0x0].0x0 since=622s v=(0 0) 00010000:00010000:2.0:1788684541.598490:0:24240:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x41:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788684541.598498:0:24240:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000174c6641/0x44bac02bd54ae02c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684541.598526:0:24240:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000174c6641/0x44bac02bd54ae02c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684541.598608:0:24240:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000174c6641/0x44bac02bd54ae02c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684541.598616:0:24240:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000174c6641/0x44bac02bd54ae02c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684541.598787:0:24240:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788684541.599248:0:22720:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788684541.599256:0:22720:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000174c6641/0x44bac02bd54ae02c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684541.599266:0:22720:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d66476d5600 already unused, calling callback (ffffffffc0cae340) 00010000:00010000:3.0:1788684541.599277:0:22720:0:(ldlm_request.c:377:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000174c6641/0x44bac02bd54ae02c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684541.599287:0:22720:0:(ldlm_request.c:1415:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000174c6641/0x44bac02bd54ae02c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684541.599306:0:22720:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000174c6641/0x44bac02bd54ae02c lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684541.599314:0:22720:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000174c6641/0x44bac02bd54ae02c lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684541.599335:0:22720:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788684541.599337:0:22720:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788684541.599339:0:22720:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788684541.600282:0:24240:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x40:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788684541.600291:0:24240:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ce34e32a/0x44bac02bd54ae033 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684541.600305:0:24240:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x40:0x0].0x0 since=622s v=(0 0) 00010000:00010000:2.0:1788684541.600309:0:24240:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x40:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788684541.600315:0:24240:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ce34e32a/0x44bac02bd54ae033 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684541.600327:0:24240:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ce34e32a/0x44bac02bd54ae033 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684541.600335:0:24240:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ce34e32a/0x44bac02bd54ae033 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684541.600354:0:24240:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ce34e32a/0x44bac02bd54ae033 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684541.600397:0:24240:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000004:00080000:0.0:1788684541.600664:0:22711:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00002000:00010000:2.0:1788684541.601357:0:24240:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788684541.601446:0:22721:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788684541.601454:0:22721:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ce34e32a/0x44bac02bd54ae033 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684541.601466:0:22721:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d66476d4a00 already unused, calling callback (ffffffffc0cae340) 00010000:00010000:3.0:1788684541.601471:0:22721:0:(ldlm_request.c:377:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ce34e32a/0x44bac02bd54ae033 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684541.601480:0:22721:0:(ldlm_request.c:1415:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ce34e32a/0x44bac02bd54ae033 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684541.601500:0:22721:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ce34e32a/0x44bac02bd54ae033 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684541.601518:0:22721:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ce34e32a/0x44bac02bd54ae033 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684541.601537:0:24240:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000057030853/0x44bac02bd54ae03a lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684541.601548:0:24240:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3f:0x0].0x0 since=622s v=(0 0) 00010000:00010000:2.0:1788684541.601552:0:24240:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788684541.601557:0:24240:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000057030853/0x44bac02bd54ae03a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684541.601568:0:24240:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000057030853/0x44bac02bd54ae03a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684541.601577:0:24240:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000057030853/0x44bac02bd54ae03a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684541.601585:0:24240:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000057030853/0x44bac02bd54ae03a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684541.601605:0:24240:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788684541.601689:0:22720:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788684541.601728:0:22721:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788684541.601731:0:22721:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788684541.601733:0:22721:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00080000:1.0:1788684541.602476:0:24238:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x280000401 00002000:00080000:1.0:1788684541.602484:0:24238:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 65 -> diff = -60 00002000:02000040:1.0:1788684541.602494:0:24238:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000401:6 to 0x280000401:65) 00002000:00010000:2.0:1788684541.602731:0:24240:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788684541.602738:0:24240:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005cf9e752/0x44bac02bd54ae041 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684541.602756:0:24240:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3e:0x0].0x0 since=622s v=(0 0) 00010000:00010000:2.0:1788684541.602759:0:24240:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788684541.602765:0:24240:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005cf9e752/0x44bac02bd54ae041 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684541.602777:0:24240:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005cf9e752/0x44bac02bd54ae041 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684541.602786:0:24240:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005cf9e752/0x44bac02bd54ae041 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684541.602793:0:24240:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005cf9e752/0x44bac02bd54ae041 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684541.602809:0:24240:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788684541.602818:0:22721:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788684541.602823:0:22721:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005cf9e752/0x44bac02bd54ae041 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684541.602829:0:22721:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d66476d5200 already unused, calling callback (ffffffffc0cae340) 00010000:00010000:2.0:1788684541.602833:0:22721:0:(ldlm_request.c:377:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005cf9e752/0x44bac02bd54ae041 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684541.602841:0:22721:0:(ldlm_request.c:1415:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005cf9e752/0x44bac02bd54ae041 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684541.602865:0:22721:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005cf9e752/0x44bac02bd54ae041 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684541.602872:0:22721:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005cf9e752/0x44bac02bd54ae041 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684541.602887:0:22721:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788684541.602888:0:22721:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788684541.602890:0:22721:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788684541.603304:0:24240:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788684541.603310:0:24240:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f6cf42f0/0x44bac02bd54ae048 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684541.603319:0:24240:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3d:0x0].0x0 since=622s v=(0 0) 00010000:00010000:2.0:1788684541.603323:0:24240:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788684541.603327:0:24240:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f6cf42f0/0x44bac02bd54ae048 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684541.603337:0:24240:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f6cf42f0/0x44bac02bd54ae048 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684541.603345:0:24240:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f6cf42f0/0x44bac02bd54ae048 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684541.603353:0:24240:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f6cf42f0/0x44bac02bd54ae048 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684541.603729:0:24240:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788684541.603740:0:22721:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788684541.603745:0:22721:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f6cf42f0/0x44bac02bd54ae048 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684541.603753:0:22721:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d66476d4000 already unused, calling callback (ffffffffc0cae340) 00010000:00010000:2.0:1788684541.603757:0:22721:0:(ldlm_request.c:377:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f6cf42f0/0x44bac02bd54ae048 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684541.603764:0:22721:0:(ldlm_request.c:1415:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f6cf42f0/0x44bac02bd54ae048 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684541.603776:0:22721:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f6cf42f0/0x44bac02bd54ae048 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684541.603783:0:22721:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f6cf42f0/0x44bac02bd54ae048 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684541.603796:0:22721:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788684541.603798:0:22721:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788684541.603799:0:22721:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788684541.604196:0:24240:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788684541.604204:0:24240:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ed99a2a7/0x44bac02bd54ae04f lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684541.604216:0:24240:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3c:0x0].0x0 since=622s v=(0 0) 00010000:00010000:0.0:1788684541.604220:0:24240:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788684541.604225:0:24240:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ed99a2a7/0x44bac02bd54ae04f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684541.604237:0:24240:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ed99a2a7/0x44bac02bd54ae04f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684541.604251:0:24240:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ed99a2a7/0x44bac02bd54ae04f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684541.604259:0:24240:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ed99a2a7/0x44bac02bd54ae04f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684541.604276:0:24240:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1788684541.604581:0:24240:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788684541.604587:0:24240:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000bf67b20/0x44bac02bd54ae056 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684541.604596:0:24240:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3b:0x0].0x0 since=622s v=(0 0) 00010000:00010000:0.0:1788684541.604600:0:24240:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788684541.604605:0:24240:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000bf67b20/0x44bac02bd54ae056 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684541.604610:0:22721:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788684541.604615:0:24240:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000bf67b20/0x44bac02bd54ae056 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684541.604618:0:22721:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ed99a2a7/0x44bac02bd54ae04f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684541.604629:0:24240:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000bf67b20/0x44bac02bd54ae056 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684541.604634:0:22721:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d6765f61200 already unused, calling callback (ffffffffc0cae340) 00010000:00010000:0.0:1788684541.604639:0:24240:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000000bf67b20/0x44bac02bd54ae056 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684541.604648:0:22721:0:(ldlm_request.c:377:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ed99a2a7/0x44bac02bd54ae04f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684541.604671:0:22721:0:(ldlm_request.c:1415:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ed99a2a7/0x44bac02bd54ae04f lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684541.604672:0:24240:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788684541.604711:0:25183:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788684541.604722:0:22720:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000057030853/0x44bac02bd54ae03a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684541.604732:0:22720:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d66476d5a00 already unused, calling callback (ffffffffc0cae340) 00010000:00010000:3.0:1788684541.604736:0:22720:0:(ldlm_request.c:377:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000057030853/0x44bac02bd54ae03a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684541.604745:0:22720:0:(ldlm_request.c:1415:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000057030853/0x44bac02bd54ae03a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684541.604759:0:22720:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000057030853/0x44bac02bd54ae03a lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684541.604767:0:22720:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000057030853/0x44bac02bd54ae03a lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684541.604782:0:22720:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788684541.604784:0:22720:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788684541.604785:0:22720:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788684541.604958:0:22721:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ed99a2a7/0x44bac02bd54ae04f lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684541.604965:0:22721:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ed99a2a7/0x44bac02bd54ae04f lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788684541.604969:0:24240:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788684541.604976:0:24240:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000dee53192/0x44bac02bd54ae05d lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684541.604985:0:24240:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3a:0x0].0x0 since=622s v=(0 0) 00010000:00010000:0.0:1788684541.604988:0:24240:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788684541.604989:0:22721:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788684541.604993:0:22721:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788684541.604993:0:24240:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000dee53192/0x44bac02bd54ae05d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684541.604997:0:22721:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788684541.605006:0:24240:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000dee53192/0x44bac02bd54ae05d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684541.605025:0:24240:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000dee53192/0x44bac02bd54ae05d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684541.605033:0:24240:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000dee53192/0x44bac02bd54ae05d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684541.605108:0:24240:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1788684541.605507:0:24240:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x39:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788684541.605512:0:24240:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000051015539/0x44bac02bd54ae064 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684541.605520:0:24240:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x39:0x0].0x0 since=622s v=(0 0) 00010000:00010000:0.0:1788684541.605528:0:24240:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x39:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788684541.605642:0:22720:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788684541.605648:0:22720:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000dee53192/0x44bac02bd54ae05d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684541.605655:0:22720:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d6765f61800 already unused, calling callback (ffffffffc0cae340) 00010000:00010000:3.0:1788684541.605659:0:22720:0:(ldlm_request.c:377:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000dee53192/0x44bac02bd54ae05d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684541.605667:0:22720:0:(ldlm_request.c:1415:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000dee53192/0x44bac02bd54ae05d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684541.605677:0:22720:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000dee53192/0x44bac02bd54ae05d lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684541.605683:0:22720:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000dee53192/0x44bac02bd54ae05d lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684541.605697:0:22720:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788684541.605698:0:22720:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788684541.605699:0:22720:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788684541.605727:0:24240:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000051015539/0x44bac02bd54ae064 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684541.605738:0:24240:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000051015539/0x44bac02bd54ae064 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684541.605747:0:24240:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000051015539/0x44bac02bd54ae064 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684541.605754:0:24240:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000051015539/0x44bac02bd54ae064 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684541.605805:0:24240:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788684541.606677:0:22721:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788684541.606686:0:22721:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000051015539/0x44bac02bd54ae064 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684541.606696:0:22721:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d6765f60800 already unused, calling callback (ffffffffc0cae340) 00010000:00010000:3.0:1788684541.606700:0:22721:0:(ldlm_request.c:377:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000051015539/0x44bac02bd54ae064 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684541.606725:0:22721:0:(ldlm_request.c:1415:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000051015539/0x44bac02bd54ae064 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684541.606740:0:22721:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000051015539/0x44bac02bd54ae064 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684541.606747:0:22721:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000051015539/0x44bac02bd54ae064 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684541.606764:0:22721:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788684541.606766:0:22721:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788684541.606768:0:22721:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788684541.608120:0:24240:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x38:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788684541.608134:0:24240:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006773d9d7/0x44bac02bd54ae06b lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684541.608152:0:24240:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x38:0x0].0x0 since=622s v=(0 0) 00010000:00010000:0.0:1788684541.608157:0:24240:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x38:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788684541.608164:0:24240:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006773d9d7/0x44bac02bd54ae06b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684541.608178:0:24240:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006773d9d7/0x44bac02bd54ae06b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684541.608189:0:24240:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006773d9d7/0x44bac02bd54ae06b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684541.608205:0:24240:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006773d9d7/0x44bac02bd54ae06b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684541.608233:0:24240:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1788684541.608631:0:24240:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x37:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788684541.608638:0:24240:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d19b1e01/0x44bac02bd54ae072 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684541.608647:0:24240:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x37:0x0].0x0 since=622s v=(0 0) 00010000:00010000:0.0:1788684541.608651:0:24240:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x37:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788684541.608655:0:24240:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d19b1e01/0x44bac02bd54ae072 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684541.608665:0:24240:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d19b1e01/0x44bac02bd54ae072 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684541.608674:0:24240:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d19b1e01/0x44bac02bd54ae072 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684541.608682:0:24240:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d19b1e01/0x44bac02bd54ae072 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684541.608699:0:24240:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1788684541.608708:0:22721:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788684541.608714:0:22721:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006773d9d7/0x44bac02bd54ae06b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684541.608727:0:22721:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d6765f60000 already unused, calling callback (ffffffffc0cae340) 00010000:00010000:0.0:1788684541.608731:0:22721:0:(ldlm_request.c:377:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006773d9d7/0x44bac02bd54ae06b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684541.608739:0:22721:0:(ldlm_request.c:1415:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006773d9d7/0x44bac02bd54ae06b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684541.608754:0:22721:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006773d9d7/0x44bac02bd54ae06b lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684541.608762:0:22721:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006773d9d7/0x44bac02bd54ae06b lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684541.608776:0:22721:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788684541.608779:0:22721:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d19b1e01/0x44bac02bd54ae072 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684541.608785:0:22721:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d6765f60c00 already unused, calling callback (ffffffffc0cae340) 00010000:00010000:0.0:1788684541.608787:0:22721:0:(ldlm_request.c:377:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d19b1e01/0x44bac02bd54ae072 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684541.608793:0:22721:0:(ldlm_request.c:1415:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d19b1e01/0x44bac02bd54ae072 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684541.608801:0:22721:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d19b1e01/0x44bac02bd54ae072 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684541.608812:0:22721:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d19b1e01/0x44bac02bd54ae072 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684541.608823:0:22721:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788684541.608825:0:22721:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788684541.608826:0:22721:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788684541.609296:0:22720:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788684541.609820:0:24240:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x36:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788684541.609827:0:24240:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001dd0a305/0x44bac02bd54ae079 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684541.609841:0:24240:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x36:0x0].0x0 since=622s v=(0 0) 00010000:00010000:0.0:1788684541.609846:0:24240:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x36:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788684541.609851:0:24240:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001dd0a305/0x44bac02bd54ae079 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684541.609862:0:24240:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001dd0a305/0x44bac02bd54ae079 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684541.609872:0:24240:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001dd0a305/0x44bac02bd54ae079 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684541.609880:0:24240:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001dd0a305/0x44bac02bd54ae079 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684541.609907:0:24240:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788684541.610401:0:22721:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788684541.610409:0:22721:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001dd0a305/0x44bac02bd54ae079 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684541.610419:0:22721:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d6765f60a00 already unused, calling callback (ffffffffc0cae340) 00010000:00010000:3.0:1788684541.610424:0:22721:0:(ldlm_request.c:377:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001dd0a305/0x44bac02bd54ae079 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684541.610434:0:22721:0:(ldlm_request.c:1415:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001dd0a305/0x44bac02bd54ae079 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684541.610450:0:22721:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001dd0a305/0x44bac02bd54ae079 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684541.610465:0:22721:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001dd0a305/0x44bac02bd54ae079 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684541.610483:0:22721:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788684541.610485:0:22721:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788684541.610486:0:22721:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788684541.613182:0:24240:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x35:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788684541.613208:0:24240:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000be4aed53/0x44bac02bd54ae080 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684541.613227:0:24240:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x35:0x0].0x0 since=622s v=(0 0) 00010000:00010000:0.0:1788684541.613232:0:24240:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x35:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788684541.613239:0:24240:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000be4aed53/0x44bac02bd54ae080 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684541.613255:0:24240:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000be4aed53/0x44bac02bd54ae080 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684541.613266:0:24240:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000be4aed53/0x44bac02bd54ae080 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684541.613273:0:24240:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000be4aed53/0x44bac02bd54ae080 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684541.613442:0:24240:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788684541.613453:0:22720:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788684541.613459:0:22720:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000be4aed53/0x44bac02bd54ae080 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684541.613467:0:22720:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d6765f61a00 already unused, calling callback (ffffffffc0cae340) 00010000:00010000:0.0:1788684541.613473:0:22720:0:(ldlm_request.c:377:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000be4aed53/0x44bac02bd54ae080 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684541.613482:0:22720:0:(ldlm_request.c:1415:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000be4aed53/0x44bac02bd54ae080 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684541.613505:0:22720:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000be4aed53/0x44bac02bd54ae080 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684541.613513:0:22720:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000be4aed53/0x44bac02bd54ae080 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684541.613530:0:22720:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788684541.613532:0:22720:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788684541.613534:0:22720:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788684541.614512:0:24240:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x34:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788684541.614523:0:24240:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000687212fd/0x44bac02bd54ae087 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684541.614537:0:24240:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x34:0x0].0x0 since=622s v=(0 0) 00010000:00010000:0.0:1788684541.614541:0:24240:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x34:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788684541.614546:0:24240:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000687212fd/0x44bac02bd54ae087 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684541.614558:0:24240:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000687212fd/0x44bac02bd54ae087 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684541.614567:0:24240:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000687212fd/0x44bac02bd54ae087 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684541.614574:0:24240:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000687212fd/0x44bac02bd54ae087 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684541.616403:0:24240:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788684541.616777:0:25184:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788684541.616786:0:25184:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000687212fd/0x44bac02bd54ae087 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684541.616802:0:25184:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d6765f60400 already unused, calling callback (ffffffffc0cae340) 00010000:00010000:0.0:1788684541.616806:0:25183:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000000bf67b20/0x44bac02bd54ae056 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684541.616808:0:25184:0:(ldlm_request.c:377:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000687212fd/0x44bac02bd54ae087 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684541.616815:0:25183:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d6765f60e00 already unused, calling callback (ffffffffc0cae340) 00010000:00010000:1.0:1788684541.616821:0:25184:0:(ldlm_request.c:1415:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000687212fd/0x44bac02bd54ae087 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684541.616846:0:25184:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000687212fd/0x44bac02bd54ae087 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684541.616853:0:25184:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000687212fd/0x44bac02bd54ae087 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684541.616877:0:25184:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788684541.616879:0:25184:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788684541.616904:0:25183:0:(ldlm_request.c:377:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000000bf67b20/0x44bac02bd54ae056 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684541.616913:0:25183:0:(ldlm_request.c:1415:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000000bf67b20/0x44bac02bd54ae056 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684541.616924:0:25183:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000000bf67b20/0x44bac02bd54ae056 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684541.616931:0:25183:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000bf67b20/0x44bac02bd54ae056 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684541.616945:0:25183:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788684541.616946:0:25183:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788684541.617981:0:22721:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788684541.618082:0:25183:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788684541.618147:0:25184:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788684541.618221:0:24240:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x33:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788684541.618230:0:24240:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000eb34edc0/0x44bac02bd54ae08e lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788684541.618236:0:24238:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x41:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788684541.618247:0:24238:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d928c4ea/0x44bac02bd54ae095 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684541.618248:0:24240:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x33:0x0].0x0 since=622s v=(0 0) 00010000:00010000:2.0:1788684541.618257:0:24240:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x33:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788684541.618264:0:24238:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x41:0x0].0x0 since=622s v=(0 0) 00010000:00010000:2.0:1788684541.618267:0:24240:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000eb34edc0/0x44bac02bd54ae08e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684541.618280:0:24238:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x41:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788684541.618286:0:24238:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d928c4ea/0x44bac02bd54ae095 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684541.618288:0:24240:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000eb34edc0/0x44bac02bd54ae08e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684541.618314:0:24238:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d928c4ea/0x44bac02bd54ae095 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684541.618328:0:24240:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000eb34edc0/0x44bac02bd54ae08e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684541.618330:0:24238:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d928c4ea/0x44bac02bd54ae095 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684541.618350:0:24240:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000eb34edc0/0x44bac02bd54ae08e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684541.618351:0:24238:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d928c4ea/0x44bac02bd54ae095 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684541.618409:0:24240:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788684541.618505:0:24238:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1788684541.618512:0:22721:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788684541.618518:0:22721:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000eb34edc0/0x44bac02bd54ae08e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684541.618525:0:22721:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d66476d4800 already unused, calling callback (ffffffffc0cae340) 00010000:00010000:2.0:1788684541.618529:0:22721:0:(ldlm_request.c:377:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000eb34edc0/0x44bac02bd54ae08e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684541.618538:0:22721:0:(ldlm_request.c:1415:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000eb34edc0/0x44bac02bd54ae08e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684541.618551:0:22721:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000eb34edc0/0x44bac02bd54ae08e lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684541.618559:0:22721:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000eb34edc0/0x44bac02bd54ae08e lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684541.618573:0:22721:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788684541.618582:0:22721:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d928c4ea/0x44bac02bd54ae095 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684541.618588:0:22721:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d6765f61c00 already unused, calling callback (ffffffffc0cae340) 00010000:00010000:2.0:1788684541.618592:0:22721:0:(ldlm_request.c:377:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d928c4ea/0x44bac02bd54ae095 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684541.618599:0:22721:0:(ldlm_request.c:1415:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d928c4ea/0x44bac02bd54ae095 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684541.618612:0:22721:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d928c4ea/0x44bac02bd54ae095 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684541.618619:0:22721:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d928c4ea/0x44bac02bd54ae095 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684541.618632:0:22721:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788684541.618634:0:22721:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788684541.618636:0:22721:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788684541.618695:0:22720:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788684541.618973:0:24238:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x40:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788684541.618979:0:24238:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000877ec05/0x44bac02bd54ae09c lrc: 3/0,1 mode: --/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684541.618988:0:24238:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x40:0x0].0x0 since=622s v=(0 0) 00010000:00010000:0.0:1788684541.618992:0:24238:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x40:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788684541.618997:0:24238:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000877ec05/0x44bac02bd54ae09c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684541.619021:0:24238:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000877ec05/0x44bac02bd54ae09c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684541.619030:0:24238:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000877ec05/0x44bac02bd54ae09c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684541.619045:0:24238:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000877ec05/0x44bac02bd54ae09c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684541.619095:0:24238:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788684541.619346:0:25184:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788684541.619352:0:25184:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000877ec05/0x44bac02bd54ae09c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684541.619360:0:25184:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d6765f60200 already unused, calling callback (ffffffffc0cae340) 00010000:00010000:1.0:1788684541.619493:0:25184:0:(ldlm_request.c:377:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000877ec05/0x44bac02bd54ae09c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684541.619515:0:25184:0:(ldlm_request.c:1415:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000877ec05/0x44bac02bd54ae09c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788684541.619577:0:24238:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788684541.619584:0:24238:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000051015539/0x44bac02bd54ae0a3 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684541.619593:0:24238:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3f:0x0].0x0 since=622s v=(0 0) 00010000:00010000:0.0:1788684541.619597:0:24238:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788684541.619601:0:24238:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000051015539/0x44bac02bd54ae0a3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684541.619612:0:24238:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000051015539/0x44bac02bd54ae0a3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684541.619619:0:24238:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000051015539/0x44bac02bd54ae0a3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684541.619626:0:24238:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000051015539/0x44bac02bd54ae0a3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684541.619641:0:24238:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788684541.619716:0:25184:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000877ec05/0x44bac02bd54ae09c lrc: 1/0,0 mode: --/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684541.619724:0:25184:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000877ec05/0x44bac02bd54ae09c lrc: 0/0,0 mode: --/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684541.619731:0:25183:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788684541.619738:0:25183:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000051015539/0x44bac02bd54ae0a3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684541.619750:0:25184:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788684541.619752:0:25183:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d6765f60800 already unused, calling callback (ffffffffc0cae340) 00010000:00010000:1.0:1788684541.619754:0:25184:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788684541.619758:0:25184:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788684541.619758:0:25183:0:(ldlm_request.c:377:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000051015539/0x44bac02bd54ae0a3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684541.619769:0:25183:0:(ldlm_request.c:1415:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000051015539/0x44bac02bd54ae0a3 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684541.619781:0:25183:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000051015539/0x44bac02bd54ae0a3 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684541.619789:0:25183:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000051015539/0x44bac02bd54ae0a3 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684541.619801:0:25183:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788684541.619803:0:25183:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788684541.619805:0:25183:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788684541.620032:0:24238:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788684541.620038:0:24238:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000dee53192/0x44bac02bd54ae0aa lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684541.620046:0:24238:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3e:0x0].0x0 since=622s v=(0 0) 00010000:00010000:0.0:1788684541.620049:0:24238:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788684541.620053:0:24238:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000dee53192/0x44bac02bd54ae0aa lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684541.620062:0:24238:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000dee53192/0x44bac02bd54ae0aa lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684541.620087:0:24238:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000dee53192/0x44bac02bd54ae0aa lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684541.620094:0:24238:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000dee53192/0x44bac02bd54ae0aa lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684541.620116:0:24238:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1788684541.620261:0:24240:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x32:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788684541.620267:0:24240:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000035eb46a9/0x44bac02bd54ae0b1 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684541.620276:0:24240:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x32:0x0].0x0 since=622s v=(0 0) 00010000:00010000:2.0:1788684541.620279:0:24240:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x32:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788684541.620283:0:24240:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000035eb46a9/0x44bac02bd54ae0b1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684541.620438:0:24240:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000035eb46a9/0x44bac02bd54ae0b1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684541.620448:0:24240:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000035eb46a9/0x44bac02bd54ae0b1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684541.620456:0:24240:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000035eb46a9/0x44bac02bd54ae0b1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788684541.620472:0:24238:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788684541.620474:0:24240:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1788684541.620483:0:24238:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003b19a594/0x44bac02bd54ae0b8 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684541.620487:0:22720:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788684541.620495:0:22720:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000dee53192/0x44bac02bd54ae0aa lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684541.620496:0:24238:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3d:0x0].0x0 since=622s v=(0 0) 00010000:00010000:0.0:1788684541.620504:0:24238:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788684541.620513:0:22720:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d6765f61800 already unused, calling callback (ffffffffc0cae340) 00010000:00010000:0.0:1788684541.620513:0:24238:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003b19a594/0x44bac02bd54ae0b8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684541.620520:0:22720:0:(ldlm_request.c:377:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000dee53192/0x44bac02bd54ae0aa lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684541.620530:0:24238:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003b19a594/0x44bac02bd54ae0b8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684541.620539:0:24238:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003b19a594/0x44bac02bd54ae0b8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684541.620547:0:24238:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003b19a594/0x44bac02bd54ae0b8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684541.620570:0:24238:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1788684541.620598:0:22720:0:(ldlm_request.c:1415:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000dee53192/0x44bac02bd54ae0aa lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684541.620615:0:22720:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000dee53192/0x44bac02bd54ae0aa lrc: 1/0,0 mode: --/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684541.620624:0:22720:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000dee53192/0x44bac02bd54ae0aa lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684541.620648:0:22720:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788684541.620652:0:22720:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000035eb46a9/0x44bac02bd54ae0b1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684541.620659:0:22720:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d66476d5400 already unused, calling callback (ffffffffc0cae340) 00010000:00010000:2.0:1788684541.620663:0:22720:0:(ldlm_request.c:377:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000035eb46a9/0x44bac02bd54ae0b1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684541.620670:0:22720:0:(ldlm_request.c:1415:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000035eb46a9/0x44bac02bd54ae0b1 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684541.620681:0:22720:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000035eb46a9/0x44bac02bd54ae0b1 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684541.620689:0:22720:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000035eb46a9/0x44bac02bd54ae0b1 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684541.620700:0:22720:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788684541.620703:0:22720:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003b19a594/0x44bac02bd54ae0b8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684541.620708:0:22720:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d6765f61600 already unused, calling callback (ffffffffc0cae340) 00010000:00010000:2.0:1788684541.620711:0:22720:0:(ldlm_request.c:377:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003b19a594/0x44bac02bd54ae0b8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684541.620728:0:22720:0:(ldlm_request.c:1415:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003b19a594/0x44bac02bd54ae0b8 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684541.620736:0:22720:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003b19a594/0x44bac02bd54ae0b8 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684541.620742:0:22720:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003b19a594/0x44bac02bd54ae0b8 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684541.620755:0:22720:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788684541.620756:0:22720:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788684541.620758:0:22720:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788684541.620856:0:24238:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788684541.620862:0:24238:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005441ed55/0x44bac02bd54ae0bf lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684541.620878:0:24238:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3c:0x0].0x0 since=622s v=(0 0) 00010000:00010000:0.0:1788684541.620882:0:24238:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788684541.620887:0:24238:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005441ed55/0x44bac02bd54ae0bf lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684541.620897:0:24238:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005441ed55/0x44bac02bd54ae0bf lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684541.620905:0:24238:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005441ed55/0x44bac02bd54ae0bf lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684541.620912:0:24238:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005441ed55/0x44bac02bd54ae0bf lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684541.620930:0:24238:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788684541.621030:0:25183:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788684541.621037:0:25183:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005441ed55/0x44bac02bd54ae0bf lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684541.621045:0:25183:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d6765f61000 already unused, calling callback (ffffffffc0cae340) 00010000:00010000:2.0:1788684541.621048:0:25183:0:(ldlm_request.c:377:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005441ed55/0x44bac02bd54ae0bf lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684541.621198:0:25183:0:(ldlm_request.c:1415:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005441ed55/0x44bac02bd54ae0bf lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684541.621210:0:25183:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005441ed55/0x44bac02bd54ae0bf lrc: 1/0,0 mode: --/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684541.621252:0:25183:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005441ed55/0x44bac02bd54ae0bf lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684541.621267:0:25183:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788684541.621269:0:25183:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788684541.621271:0:25183:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788684541.621297:0:22721:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788684541.621303:0:25184:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788684541.621414:0:24240:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x31:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788684541.621420:0:24240:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e04d19ad/0x44bac02bd54ae0c6 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684541.621428:0:24240:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x31:0x0].0x0 since=622s v=(0 0) 00010000:00010000:0.0:1788684541.621440:0:24240:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x31:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788684541.621444:0:24240:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e04d19ad/0x44bac02bd54ae0c6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684541.621455:0:24240:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e04d19ad/0x44bac02bd54ae0c6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684541.621463:0:24240:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e04d19ad/0x44bac02bd54ae0c6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684541.621470:0:24240:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e04d19ad/0x44bac02bd54ae0c6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684541.621497:0:24240:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1788684541.621665:0:24238:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788684541.621671:0:24238:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002633d471/0x44bac02bd54ae0cd lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684541.621679:0:24238:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3b:0x0].0x0 since=622s v=(0 0) 00010000:00010000:1.0:1788684541.621681:0:24238:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788684541.621685:0:24238:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002633d471/0x44bac02bd54ae0cd lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684541.621694:0:24238:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002633d471/0x44bac02bd54ae0cd lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684541.621714:0:24238:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002633d471/0x44bac02bd54ae0cd lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684541.621721:0:24238:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002633d471/0x44bac02bd54ae0cd lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684541.621739:0:24238:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1788684541.622042:0:25183:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788684541.622048:0:25183:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e04d19ad/0x44bac02bd54ae0c6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684541.622056:0:25183:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d6765f61400 already unused, calling callback (ffffffffc0cae340) 00010000:00010000:0.0:1788684541.622060:0:25183:0:(ldlm_request.c:377:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e04d19ad/0x44bac02bd54ae0c6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788684541.622200:0:24238:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788684541.622206:0:24238:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004a3ca456/0x44bac02bd54ae0d4 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684541.622213:0:24238:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3a:0x0].0x0 since=622s v=(0 0) 00010000:00010000:1.0:1788684541.622216:0:24238:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788684541.622220:0:24238:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004a3ca456/0x44bac02bd54ae0d4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684541.622228:0:24238:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004a3ca456/0x44bac02bd54ae0d4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684541.622235:0:24238:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004a3ca456/0x44bac02bd54ae0d4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684541.622241:0:24238:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004a3ca456/0x44bac02bd54ae0d4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684541.622265:0:24238:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1788684541.622478:0:25183:0:(ldlm_request.c:1415:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e04d19ad/0x44bac02bd54ae0c6 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684541.622496:0:25183:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e04d19ad/0x44bac02bd54ae0c6 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684541.622515:0:25183:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e04d19ad/0x44bac02bd54ae0c6 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684541.622532:0:25183:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788684541.622536:0:25183:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002633d471/0x44bac02bd54ae0cd lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684541.622543:0:25183:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d6746cb2200 already unused, calling callback (ffffffffc0cae340) 00010000:00010000:0.0:1788684541.622547:0:25183:0:(ldlm_request.c:377:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002633d471/0x44bac02bd54ae0cd lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684541.622554:0:25183:0:(ldlm_request.c:1415:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002633d471/0x44bac02bd54ae0cd lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684541.622564:0:25183:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002633d471/0x44bac02bd54ae0cd lrc: 1/0,0 mode: --/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684541.622572:0:25183:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002633d471/0x44bac02bd54ae0cd lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684541.622584:0:25183:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788684541.622587:0:25183:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004a3ca456/0x44bac02bd54ae0d4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684541.622594:0:25183:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d6746cb3c00 already unused, calling callback (ffffffffc0cae340) 00010000:00010000:0.0:1788684541.622603:0:25183:0:(ldlm_request.c:377:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004a3ca456/0x44bac02bd54ae0d4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684541.622611:0:25183:0:(ldlm_request.c:1415:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004a3ca456/0x44bac02bd54ae0d4 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684541.622620:0:25183:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004a3ca456/0x44bac02bd54ae0d4 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684541.622627:0:25183:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004a3ca456/0x44bac02bd54ae0d4 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684541.622640:0:25183:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788684541.622642:0:25183:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788684541.622644:0:25183:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788684541.622731:0:24238:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x39:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788684541.622737:0:24238:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e3f41fd9/0x44bac02bd54ae0db lrc: 3/0,1 mode: --/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684541.622746:0:24238:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x39:0x0].0x0 since=622s v=(0 0) 00010000:00010000:1.0:1788684541.622750:0:24238:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x39:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788684541.622754:0:24238:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e3f41fd9/0x44bac02bd54ae0db lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684541.622763:0:24238:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e3f41fd9/0x44bac02bd54ae0db lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684541.622771:0:24238:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e3f41fd9/0x44bac02bd54ae0db lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684541.622778:0:24238:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e3f41fd9/0x44bac02bd54ae0db lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684541.622797:0:24238:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788684541.622892:0:22721:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788684541.622897:0:22721:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e3f41fd9/0x44bac02bd54ae0db lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684541.622904:0:22721:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d6746cb2600 already unused, calling callback (ffffffffc0cae340) 00010000:00010000:1.0:1788684541.622913:0:22721:0:(ldlm_request.c:377:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e3f41fd9/0x44bac02bd54ae0db lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684541.622921:0:22721:0:(ldlm_request.c:1415:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e3f41fd9/0x44bac02bd54ae0db lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684541.622932:0:22721:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e3f41fd9/0x44bac02bd54ae0db lrc: 1/0,0 mode: --/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684541.622939:0:22721:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e3f41fd9/0x44bac02bd54ae0db lrc: 0/0,0 mode: --/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684541.622951:0:22721:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788684541.622953:0:22721:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788684541.622955:0:22721:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788684541.623038:0:24240:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x30:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788684541.623043:0:24240:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cd9564fd/0x44bac02bd54ae0e2 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684541.623052:0:24240:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x30:0x0].0x0 since=622s v=(0 0) 00010000:00010000:1.0:1788684541.623054:0:24240:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x30:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788684541.623058:0:24240:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000cd9564fd/0x44bac02bd54ae0e2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684541.623180:0:22720:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788684541.623301:0:24240:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000cd9564fd/0x44bac02bd54ae0e2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684541.623312:0:24240:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cd9564fd/0x44bac02bd54ae0e2 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684541.623324:0:24240:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000cd9564fd/0x44bac02bd54ae0e2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684541.623426:0:24240:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788684541.624744:0:25183:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788684541.624755:0:25183:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000cd9564fd/0x44bac02bd54ae0e2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684541.624768:0:25183:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d6746cb3400 already unused, calling callback (ffffffffc0cae340) 00010000:00010000:0.0:1788684541.624773:0:25183:0:(ldlm_request.c:377:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000cd9564fd/0x44bac02bd54ae0e2 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684541.624782:0:25183:0:(ldlm_request.c:1415:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000cd9564fd/0x44bac02bd54ae0e2 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684541.624799:0:25183:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000cd9564fd/0x44bac02bd54ae0e2 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684541.624815:0:25183:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000cd9564fd/0x44bac02bd54ae0e2 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684541.624835:0:25183:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788684541.624837:0:25183:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788684541.624839:0:25183:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788684541.624846:0:25184:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788684541.625417:0:24240:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788684541.625426:0:24240:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d7765819/0x44bac02bd54ae0e9 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684541.625437:0:24240:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2f:0x0].0x0 since=622s v=(0 0) 00010000:00010000:1.0:1788684541.625441:0:24240:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788684541.625447:0:24240:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d7765819/0x44bac02bd54ae0e9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684541.625460:0:24240:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d7765819/0x44bac02bd54ae0e9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684541.625469:0:24240:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d7765819/0x44bac02bd54ae0e9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684541.625478:0:24240:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d7765819/0x44bac02bd54ae0e9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684541.625495:0:24240:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1788684541.625840:0:24240:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788684541.625847:0:24240:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000291a4b32/0x44bac02bd54ae0f0 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684541.625862:0:24240:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2e:0x0].0x0 since=622s v=(0 0) 00010000:00010000:1.0:1788684541.625865:0:24240:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788684541.625870:0:24240:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000291a4b32/0x44bac02bd54ae0f0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684541.625892:0:24240:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000291a4b32/0x44bac02bd54ae0f0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684541.625901:0:24240:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000291a4b32/0x44bac02bd54ae0f0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684541.625908:0:24240:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000291a4b32/0x44bac02bd54ae0f0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684541.625925:0:24240:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1788684541.625934:0:22720:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788684541.625938:0:22720:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d7765819/0x44bac02bd54ae0e9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684541.625946:0:22720:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d6746cb2e00 already unused, calling callback (ffffffffc0cae340) 00010000:00010000:1.0:1788684541.625951:0:22720:0:(ldlm_request.c:377:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d7765819/0x44bac02bd54ae0e9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684541.625959:0:22720:0:(ldlm_request.c:1415:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d7765819/0x44bac02bd54ae0e9 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684541.625985:0:22720:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d7765819/0x44bac02bd54ae0e9 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684541.625993:0:22720:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d7765819/0x44bac02bd54ae0e9 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684541.626020:0:22720:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788684541.626024:0:22720:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000291a4b32/0x44bac02bd54ae0f0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684541.626031:0:22720:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d6746cb3800 already unused, calling callback (ffffffffc0cae340) 00010000:00010000:1.0:1788684541.626035:0:22720:0:(ldlm_request.c:377:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000291a4b32/0x44bac02bd54ae0f0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684541.626043:0:22720:0:(ldlm_request.c:1415:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000291a4b32/0x44bac02bd54ae0f0 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684541.626053:0:22720:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000291a4b32/0x44bac02bd54ae0f0 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684541.626061:0:22720:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000291a4b32/0x44bac02bd54ae0f0 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684541.626193:0:22720:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788684541.626196:0:22720:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788684541.626203:0:22720:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788684541.626494:0:22721:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788684541.626594:0:24240:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788684541.626600:0:24240:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cef5a20d/0x44bac02bd54ae0f7 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684541.626610:0:24240:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2d:0x0].0x0 since=622s v=(0 0) 00010000:00010000:1.0:1788684541.626614:0:24240:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788684541.626618:0:24240:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000cef5a20d/0x44bac02bd54ae0f7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684541.626629:0:24240:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000cef5a20d/0x44bac02bd54ae0f7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684541.626638:0:24240:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cef5a20d/0x44bac02bd54ae0f7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684541.626647:0:24240:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000cef5a20d/0x44bac02bd54ae0f7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684541.626668:0:24240:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788684541.626925:0:25183:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788684541.626932:0:25183:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000cef5a20d/0x44bac02bd54ae0f7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684541.626941:0:25183:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d6746cb3600 already unused, calling callback (ffffffffc0cae340) 00010000:00010000:0.0:1788684541.626945:0:25183:0:(ldlm_request.c:377:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000cef5a20d/0x44bac02bd54ae0f7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684541.626954:0:25183:0:(ldlm_request.c:1415:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000cef5a20d/0x44bac02bd54ae0f7 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684541.626968:0:25183:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000cef5a20d/0x44bac02bd54ae0f7 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684541.626976:0:25183:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000cef5a20d/0x44bac02bd54ae0f7 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684541.626993:0:25183:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788684541.627001:0:25183:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788684541.627003:0:25183:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788684541.627103:0:24240:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788684541.627108:0:24240:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a2bded57/0x44bac02bd54ae0fe lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684541.627117:0:24240:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2c:0x0].0x0 since=622s v=(0 0) 00010000:00010000:1.0:1788684541.627120:0:24240:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788684541.627125:0:24240:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a2bded57/0x44bac02bd54ae0fe lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684541.627148:0:24240:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a2bded57/0x44bac02bd54ae0fe lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684541.627157:0:24240:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a2bded57/0x44bac02bd54ae0fe lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684541.627165:0:24240:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a2bded57/0x44bac02bd54ae0fe lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684541.627186:0:24240:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788684541.627509:0:25184:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788684541.627515:0:25184:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a2bded57/0x44bac02bd54ae0fe lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684541.627522:0:25184:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d6746cb2800 already unused, calling callback (ffffffffc0cae340) 00010000:00010000:0.0:1788684541.627526:0:25184:0:(ldlm_request.c:377:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a2bded57/0x44bac02bd54ae0fe lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684541.627533:0:25184:0:(ldlm_request.c:1415:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a2bded57/0x44bac02bd54ae0fe lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684541.627544:0:25184:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a2bded57/0x44bac02bd54ae0fe lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684541.627552:0:25184:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a2bded57/0x44bac02bd54ae0fe lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684541.627566:0:25184:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788684541.627568:0:25184:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788684541.627570:0:25184:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788684541.627652:0:24240:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788684541.627658:0:24240:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b0545a37/0x44bac02bd54ae105 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684541.627667:0:24240:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2b:0x0].0x0 since=622s v=(0 0) 00010000:00010000:1.0:1788684541.627670:0:24240:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788684541.627675:0:24240:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b0545a37/0x44bac02bd54ae105 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684541.627685:0:24240:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b0545a37/0x44bac02bd54ae105 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684541.627694:0:24240:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b0545a37/0x44bac02bd54ae105 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684541.627713:0:24240:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b0545a37/0x44bac02bd54ae105 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684541.627777:0:24240:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1788684541.628344:0:24238:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x38:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788684541.628352:0:24238:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d2297ed4/0x44bac02bd54ae10c lrc: 3/0,1 mode: --/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684541.628362:0:24238:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x38:0x0].0x0 since=622s v=(0 0) 00010000:00010000:3.0:1788684541.628389:0:24238:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x38:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788684541.628394:0:24238:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d2297ed4/0x44bac02bd54ae10c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684541.628407:0:24238:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d2297ed4/0x44bac02bd54ae10c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684541.628416:0:24238:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d2297ed4/0x44bac02bd54ae10c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684541.628422:0:24238:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d2297ed4/0x44bac02bd54ae10c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788684541.629303:0:24240:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788684541.629312:0:24240:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000096fcff35/0x44bac02bd54ae113 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684541.629322:0:24240:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2a:0x0].0x0 since=622s v=(0 0) 00010000:00010000:2.0:1788684541.629325:0:24240:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788684541.629330:0:24240:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000096fcff35/0x44bac02bd54ae113 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684541.629340:0:24240:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000096fcff35/0x44bac02bd54ae113 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684541.629349:0:24240:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000096fcff35/0x44bac02bd54ae113 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684541.629356:0:24240:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000096fcff35/0x44bac02bd54ae113 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684541.629635:0:22720:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1788684541.629643:0:22720:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b0545a37/0x44bac02bd54ae105 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684541.629651:0:22720:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d66477b0200 already unused, calling callback (ffffffffc0cae340) 00010000:00010000:0.0:1788684541.629656:0:22720:0:(ldlm_request.c:377:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b0545a37/0x44bac02bd54ae105 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684541.629671:0:22720:0:(ldlm_request.c:1415:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b0545a37/0x44bac02bd54ae105 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684541.629687:0:22720:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b0545a37/0x44bac02bd54ae105 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684541.629695:0:22720:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b0545a37/0x44bac02bd54ae105 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684541.629711:0:22720:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788684541.629714:0:22720:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d2297ed4/0x44bac02bd54ae10c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684541.629720:0:22720:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d66479a1a00 already unused, calling callback (ffffffffc0cae340) 00010000:00010000:0.0:1788684541.629723:0:22720:0:(ldlm_request.c:377:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d2297ed4/0x44bac02bd54ae10c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684541.629730:0:22720:0:(ldlm_request.c:1415:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d2297ed4/0x44bac02bd54ae10c lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684541.629740:0:22720:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d2297ed4/0x44bac02bd54ae10c lrc: 2/0,0 mode: --/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684541.629748:0:22720:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788684541.629751:0:22720:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000096fcff35/0x44bac02bd54ae113 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684541.629762:0:22720:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d66476d4400 already unused, calling callback (ffffffffc0cae340) 00010000:00010000:0.0:1788684541.629766:0:22720:0:(ldlm_request.c:377:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000096fcff35/0x44bac02bd54ae113 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684541.629773:0:22720:0:(ldlm_request.c:1415:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000096fcff35/0x44bac02bd54ae113 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684541.629784:0:22720:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000096fcff35/0x44bac02bd54ae113 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684541.629792:0:22720:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788684541.629793:0:22720:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788684541.629795:0:22720:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788684541.629993:0:24238:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1788684541.630000:0:24238:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d2297ed4/0x44bac02bd54ae10c lrc: 0/0,0 mode: --/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788684541.630531:0:24238:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x37:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788684541.630538:0:24238:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000035ead228/0x44bac02bd54ae11a lrc: 3/0,1 mode: --/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684541.630550:0:24238:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x37:0x0].0x0 since=622s v=(0 0) 00010000:00010000:3.0:1788684541.630554:0:24238:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x37:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788684541.630559:0:24238:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000035ead228/0x44bac02bd54ae11a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684541.630571:0:24238:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000035ead228/0x44bac02bd54ae11a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684541.630581:0:24238:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000035ead228/0x44bac02bd54ae11a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684541.630590:0:24238:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000035ead228/0x44bac02bd54ae11a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684541.630604:0:24238:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1788684541.630854:0:24238:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x36:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788684541.630861:0:24238:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000394703aa/0x44bac02bd54ae121 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684541.630870:0:24238:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x36:0x0].0x0 since=622s v=(0 0) 00010000:00010000:3.0:1788684541.630932:0:24238:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x36:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788684541.630942:0:24238:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000394703aa/0x44bac02bd54ae121 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684541.630952:0:24238:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000394703aa/0x44bac02bd54ae121 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684541.630960:0:24238:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000394703aa/0x44bac02bd54ae121 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684541.630968:0:24238:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000394703aa/0x44bac02bd54ae121 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684541.630980:0:24238:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:3.0:1788684541.631301:0:24238:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x35:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788684541.631307:0:24238:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000048cc06f6/0x44bac02bd54ae128 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684541.631316:0:24238:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x35:0x0].0x0 since=622s v=(0 0) 00010000:00010000:3.0:1788684541.631319:0:24238:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x35:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788684541.631323:0:24238:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000048cc06f6/0x44bac02bd54ae128 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684541.631331:0:24238:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000048cc06f6/0x44bac02bd54ae128 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684541.631339:0:24238:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000048cc06f6/0x44bac02bd54ae128 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684541.631359:0:24238:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000048cc06f6/0x44bac02bd54ae128 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684541.631404:0:24238:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:3.0:1788684541.631417:0:22720:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1788684541.631422:0:22720:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000035ead228/0x44bac02bd54ae11a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684541.631431:0:22720:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d66479a1000 already unused, calling callback (ffffffffc0cae340) 00010000:00010000:3.0:1788684541.631435:0:22720:0:(ldlm_request.c:377:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000035ead228/0x44bac02bd54ae11a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684541.631445:0:22720:0:(ldlm_request.c:1415:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000035ead228/0x44bac02bd54ae11a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684541.631461:0:22720:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000035ead228/0x44bac02bd54ae11a lrc: 1/0,0 mode: --/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684541.631470:0:22720:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000035ead228/0x44bac02bd54ae11a lrc: 0/0,0 mode: --/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684541.631487:0:22720:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788684541.631491:0:22720:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000394703aa/0x44bac02bd54ae121 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684541.631507:0:22720:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d66479a0e00 already unused, calling callback (ffffffffc0cae340) 00010000:00010000:3.0:1788684541.631510:0:22720:0:(ldlm_request.c:377:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000394703aa/0x44bac02bd54ae121 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684541.631517:0:22720:0:(ldlm_request.c:1415:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000394703aa/0x44bac02bd54ae121 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684541.631527:0:22720:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000394703aa/0x44bac02bd54ae121 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684541.631533:0:22720:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000394703aa/0x44bac02bd54ae121 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684541.631544:0:22720:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788684541.631547:0:22720:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000048cc06f6/0x44bac02bd54ae128 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684541.631552:0:22720:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d66479a0800 already unused, calling callback (ffffffffc0cae340) 00010000:00010000:3.0:1788684541.631555:0:22720:0:(ldlm_request.c:377:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000048cc06f6/0x44bac02bd54ae128 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684541.631561:0:22720:0:(ldlm_request.c:1415:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000048cc06f6/0x44bac02bd54ae128 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684541.631569:0:22720:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000048cc06f6/0x44bac02bd54ae128 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684541.631581:0:22720:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000048cc06f6/0x44bac02bd54ae128 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684541.631595:0:22720:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788684541.631596:0:22720:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788684541.631598:0:22720:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788684541.631853:0:25183:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788684541.631859:0:22721:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788684541.631864:0:25184:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788684541.632133:0:24238:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x34:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788684541.632140:0:24238:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007d8afab2/0x44bac02bd54ae12f lrc: 3/0,1 mode: --/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684541.632150:0:24238:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x34:0x0].0x0 since=622s v=(0 0) 00010000:00010000:3.0:1788684541.632153:0:24238:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x34:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788684541.632157:0:24238:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007d8afab2/0x44bac02bd54ae12f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684541.632166:0:24238:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007d8afab2/0x44bac02bd54ae12f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684541.632174:0:24238:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007d8afab2/0x44bac02bd54ae12f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684541.632181:0:24238:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007d8afab2/0x44bac02bd54ae12f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684541.632195:0:24238:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788684541.632202:0:22720:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788684541.632211:0:22720:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007d8afab2/0x44bac02bd54ae12f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684541.632217:0:22720:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d66479a1e00 already unused, calling callback (ffffffffc0cae340) 00010000:00010000:3.0:1788684541.632221:0:22720:0:(ldlm_request.c:377:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007d8afab2/0x44bac02bd54ae12f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684541.632228:0:22720:0:(ldlm_request.c:1415:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007d8afab2/0x44bac02bd54ae12f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684541.632240:0:22720:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007d8afab2/0x44bac02bd54ae12f lrc: 1/0,0 mode: --/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684541.632246:0:22720:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007d8afab2/0x44bac02bd54ae12f lrc: 0/0,0 mode: --/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684541.632258:0:22720:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788684541.632260:0:22720:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788684541.632261:0:22720:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788684541.632596:0:24238:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x33:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788684541.632602:0:24238:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ab502818/0x44bac02bd54ae136 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684541.632610:0:24238:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x33:0x0].0x0 since=622s v=(0 0) 00010000:00010000:3.0:1788684541.632613:0:24238:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x33:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788684541.632617:0:24238:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ab502818/0x44bac02bd54ae136 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684541.632636:0:24238:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ab502818/0x44bac02bd54ae136 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684541.632645:0:24238:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ab502818/0x44bac02bd54ae136 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684541.632651:0:24238:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ab502818/0x44bac02bd54ae136 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684541.632662:0:24238:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1788684541.632950:0:24238:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x32:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788684541.632955:0:24238:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fcb727a5/0x44bac02bd54ae13d lrc: 3/0,1 mode: --/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684541.632963:0:24238:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x32:0x0].0x0 since=622s v=(0 0) 00010000:00010000:3.0:1788684541.632966:0:24238:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x32:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788684541.632970:0:24238:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fcb727a5/0x44bac02bd54ae13d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684541.632979:0:24238:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fcb727a5/0x44bac02bd54ae13d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684541.632988:0:24238:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fcb727a5/0x44bac02bd54ae13d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684541.633014:0:24238:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000fcb727a5/0x44bac02bd54ae13d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684541.633028:0:24238:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1788684541.633224:0:25183:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788684541.633230:0:25183:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ab502818/0x44bac02bd54ae136 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684541.633238:0:25183:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d66479a1400 already unused, calling callback (ffffffffc0cae340) 00010000:00010000:0.0:1788684541.633243:0:25183:0:(ldlm_request.c:377:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ab502818/0x44bac02bd54ae136 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684541.633251:0:25183:0:(ldlm_request.c:1415:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ab502818/0x44bac02bd54ae136 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684541.633276:0:25183:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ab502818/0x44bac02bd54ae136 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684541.633284:0:25183:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ab502818/0x44bac02bd54ae136 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684541.633299:0:25183:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788684541.633302:0:25183:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000fcb727a5/0x44bac02bd54ae13d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684541.633308:0:25183:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d6647890e00 already unused, calling callback (ffffffffc0cae340) 00010000:00010000:0.0:1788684541.633311:0:25183:0:(ldlm_request.c:377:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000fcb727a5/0x44bac02bd54ae13d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684541.633319:0:25183:0:(ldlm_request.c:1415:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000fcb727a5/0x44bac02bd54ae13d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684541.633328:0:25183:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000fcb727a5/0x44bac02bd54ae13d lrc: 1/0,0 mode: --/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684541.633334:0:25183:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fcb727a5/0x44bac02bd54ae13d lrc: 0/0,0 mode: --/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684541.633345:0:25183:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788684541.633346:0:25183:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788684541.633352:0:25183:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788684541.633357:0:22721:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788684541.633634:0:24238:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x31:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788684541.633640:0:24238:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000045572ce1/0x44bac02bd54ae144 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684541.633649:0:24238:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x31:0x0].0x0 since=622s v=(0 0) 00010000:00010000:3.0:1788684541.633652:0:24238:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x31:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788684541.633657:0:24238:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000045572ce1/0x44bac02bd54ae144 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684541.633666:0:24238:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000045572ce1/0x44bac02bd54ae144 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684541.633674:0:24238:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000045572ce1/0x44bac02bd54ae144 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684541.633681:0:24238:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000045572ce1/0x44bac02bd54ae144 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684541.633727:0:24238:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788684541.633975:0:24240:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788684541.633987:0:24240:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000096fcff35/0x44bac02bd54ae113 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684541.634060:0:25183:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788684541.634065:0:25183:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000045572ce1/0x44bac02bd54ae144 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684541.634081:0:25183:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d6647891e00 already unused, calling callback (ffffffffc0cae340) 00010000:00010000:2.0:1788684541.634085:0:25183:0:(ldlm_request.c:377:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000045572ce1/0x44bac02bd54ae144 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684541.634094:0:25183:0:(ldlm_request.c:1415:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000045572ce1/0x44bac02bd54ae144 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684541.634106:0:25183:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000045572ce1/0x44bac02bd54ae144 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684541.634113:0:25183:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000045572ce1/0x44bac02bd54ae144 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684541.634126:0:25183:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788684541.634127:0:25183:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788684541.634129:0:25183:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788684541.634502:0:24240:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x29:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788684541.634509:0:24240:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000035eb46a9/0x44bac02bd54ae14b lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684541.634518:0:24240:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x29:0x0].0x0 since=622s v=(0 0) 00010000:00010000:2.0:1788684541.634525:0:24240:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x29:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788684541.634530:0:24240:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000035eb46a9/0x44bac02bd54ae14b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684541.634542:0:24240:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000035eb46a9/0x44bac02bd54ae14b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684541.634550:0:24240:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000035eb46a9/0x44bac02bd54ae14b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684541.634557:0:24240:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000035eb46a9/0x44bac02bd54ae14b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684541.634575:0:24240:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1788684541.634802:0:24240:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x28:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788684541.634807:0:24240:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000eb34edc0/0x44bac02bd54ae152 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684541.634815:0:24240:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x28:0x0].0x0 since=622s v=(0 0) 00010000:00010000:2.0:1788684541.634818:0:24240:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x28:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788684541.634822:0:24240:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000eb34edc0/0x44bac02bd54ae152 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684541.634831:0:24240:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000eb34edc0/0x44bac02bd54ae152 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684541.634838:0:24240:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000eb34edc0/0x44bac02bd54ae152 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684541.634851:0:24240:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000eb34edc0/0x44bac02bd54ae152 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684541.634862:0:24240:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1788684541.634868:0:25183:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788684541.634883:0:25183:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000035eb46a9/0x44bac02bd54ae14b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684541.634890:0:25183:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d66476d5400 already unused, calling callback (ffffffffc0cae340) 00010000:00010000:2.0:1788684541.634895:0:25183:0:(ldlm_request.c:377:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000035eb46a9/0x44bac02bd54ae14b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684541.634902:0:25183:0:(ldlm_request.c:1415:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000035eb46a9/0x44bac02bd54ae14b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684541.634914:0:25183:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000035eb46a9/0x44bac02bd54ae14b lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684541.634921:0:25183:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000035eb46a9/0x44bac02bd54ae14b lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684541.634933:0:25183:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788684541.634936:0:25183:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000eb34edc0/0x44bac02bd54ae152 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684541.634952:0:25183:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d66476d4800 already unused, calling callback (ffffffffc0cae340) 00010000:00010000:2.0:1788684541.634955:0:25183:0:(ldlm_request.c:377:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000eb34edc0/0x44bac02bd54ae152 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684541.634973:0:25183:0:(ldlm_request.c:1415:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000eb34edc0/0x44bac02bd54ae152 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684541.634983:0:25183:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000eb34edc0/0x44bac02bd54ae152 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684541.634990:0:25183:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000eb34edc0/0x44bac02bd54ae152 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684541.634999:0:25183:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788684541.635001:0:25183:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788684541.635002:0:25183:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788684541.635572:0:22720:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788684541.635661:0:24238:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x30:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788684541.635667:0:24238:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f6cf42f0/0x44bac02bd54ae159 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684541.635677:0:24238:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x30:0x0].0x0 since=622s v=(0 0) 00010000:00010000:2.0:1788684541.635680:0:24238:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x30:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788684541.635684:0:24238:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f6cf42f0/0x44bac02bd54ae159 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684541.635694:0:24238:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f6cf42f0/0x44bac02bd54ae159 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684541.635707:0:24238:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f6cf42f0/0x44bac02bd54ae159 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684541.635714:0:24238:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f6cf42f0/0x44bac02bd54ae159 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684541.635725:0:24238:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788684541.635731:0:25183:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788684541.635735:0:25183:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f6cf42f0/0x44bac02bd54ae159 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684541.635741:0:25183:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d66476d4000 already unused, calling callback (ffffffffc0cae340) 00010000:00010000:2.0:1788684541.635745:0:25183:0:(ldlm_request.c:377:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f6cf42f0/0x44bac02bd54ae159 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684541.635753:0:25183:0:(ldlm_request.c:1415:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f6cf42f0/0x44bac02bd54ae159 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684541.635763:0:25183:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f6cf42f0/0x44bac02bd54ae159 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684541.635770:0:25183:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f6cf42f0/0x44bac02bd54ae159 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684541.635781:0:25183:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788684541.635786:0:25183:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788684541.635788:0:25183:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788684541.636096:0:24240:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x27:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788684541.636108:0:24240:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e0f61310/0x44bac02bd54ae160 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684541.636116:0:24240:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x27:0x0].0x0 since=622s v=(0 0) 00010000:00010000:3.0:1788684541.636119:0:24240:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x27:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788684541.636122:0:24240:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e0f61310/0x44bac02bd54ae160 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684541.636132:0:24240:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e0f61310/0x44bac02bd54ae160 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684541.636139:0:24240:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e0f61310/0x44bac02bd54ae160 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684541.636145:0:24240:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e0f61310/0x44bac02bd54ae160 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684541.636159:0:24240:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788684541.636637:0:22720:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788684541.636644:0:22720:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e0f61310/0x44bac02bd54ae160 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684541.636653:0:22720:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d6647890800 already unused, calling callback (ffffffffc0cae340) 00010000:00010000:2.0:1788684541.636656:0:22720:0:(ldlm_request.c:377:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e0f61310/0x44bac02bd54ae160 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684541.636665:0:22720:0:(ldlm_request.c:1415:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e0f61310/0x44bac02bd54ae160 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684541.636678:0:22720:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e0f61310/0x44bac02bd54ae160 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684541.636686:0:22720:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e0f61310/0x44bac02bd54ae160 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684541.636703:0:22720:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788684541.636705:0:22720:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788684541.636706:0:22720:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788684541.636817:0:24238:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788684541.636822:0:24238:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003ab08c33/0x44bac02bd54ae167 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684541.636831:0:24238:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2f:0x0].0x0 since=622s v=(0 0) 00010000:00010000:3.0:1788684541.636834:0:24238:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788684541.636839:0:24238:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003ab08c33/0x44bac02bd54ae167 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684541.636849:0:24238:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003ab08c33/0x44bac02bd54ae167 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684541.636863:0:24238:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003ab08c33/0x44bac02bd54ae167 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684541.636870:0:24238:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003ab08c33/0x44bac02bd54ae167 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684541.636894:0:24238:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1788684541.637273:0:24238:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788684541.637279:0:24238:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007e2d3009/0x44bac02bd54ae16e lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684541.637288:0:24238:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2e:0x0].0x0 since=622s v=(0 0) 00010000:00010000:3.0:1788684541.637291:0:24238:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788684541.637296:0:24238:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007e2d3009/0x44bac02bd54ae16e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684541.637306:0:24238:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007e2d3009/0x44bac02bd54ae16e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684541.637314:0:24238:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007e2d3009/0x44bac02bd54ae16e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684541.637322:0:24238:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007e2d3009/0x44bac02bd54ae16e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684541.637349:0:24238:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1788684541.637357:0:22720:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788684541.637361:0:22720:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003ab08c33/0x44bac02bd54ae167 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684541.637399:0:22720:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d6647891c00 already unused, calling callback (ffffffffc0cae340) 00010000:00010000:3.0:1788684541.637403:0:22720:0:(ldlm_request.c:377:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003ab08c33/0x44bac02bd54ae167 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684541.637412:0:22720:0:(ldlm_request.c:1415:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003ab08c33/0x44bac02bd54ae167 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684541.637424:0:22720:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003ab08c33/0x44bac02bd54ae167 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684541.637432:0:22720:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003ab08c33/0x44bac02bd54ae167 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684541.637445:0:22720:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788684541.637449:0:22720:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007e2d3009/0x44bac02bd54ae16e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684541.637455:0:22720:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d6647890600 already unused, calling callback (ffffffffc0cae340) 00010000:00010000:3.0:1788684541.637459:0:22720:0:(ldlm_request.c:377:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007e2d3009/0x44bac02bd54ae16e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684541.637478:0:22720:0:(ldlm_request.c:1415:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007e2d3009/0x44bac02bd54ae16e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684541.637488:0:22720:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007e2d3009/0x44bac02bd54ae16e lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684541.637495:0:22720:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007e2d3009/0x44bac02bd54ae16e lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684541.637507:0:22720:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788684541.637509:0:22720:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788684541.637511:0:22720:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788684541.637759:0:25183:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788684541.637801:0:24240:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x26:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788684541.637807:0:24240:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005cf9e752/0x44bac02bd54ae175 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684541.637816:0:24240:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x26:0x0].0x0 since=622s v=(0 0) 00010000:00010000:2.0:1788684541.637825:0:24240:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x26:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788684541.637830:0:24240:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005cf9e752/0x44bac02bd54ae175 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684541.637839:0:24240:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005cf9e752/0x44bac02bd54ae175 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684541.637848:0:24240:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005cf9e752/0x44bac02bd54ae175 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684541.637855:0:24240:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005cf9e752/0x44bac02bd54ae175 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684541.637885:0:24240:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1788684541.638258:0:24240:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x25:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788684541.638264:0:24240:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000017d9b66f/0x44bac02bd54ae17c lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684541.638272:0:24240:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x25:0x0].0x0 since=622s v=(0 0) 00010000:00010000:2.0:1788684541.638276:0:24240:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x25:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788684541.638280:0:24240:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000017d9b66f/0x44bac02bd54ae17c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684541.638289:0:24240:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000017d9b66f/0x44bac02bd54ae17c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684541.638296:0:24240:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000017d9b66f/0x44bac02bd54ae17c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684541.638309:0:24240:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000017d9b66f/0x44bac02bd54ae17c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684541.638322:0:24240:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1788684541.638330:0:25183:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788684541.638334:0:25183:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005cf9e752/0x44bac02bd54ae175 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684541.638341:0:25183:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d66476d5200 already unused, calling callback (ffffffffc0cae340) 00010000:00010000:2.0:1788684541.638345:0:25183:0:(ldlm_request.c:377:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005cf9e752/0x44bac02bd54ae175 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684541.638353:0:25183:0:(ldlm_request.c:1415:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005cf9e752/0x44bac02bd54ae175 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684541.638381:0:25183:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005cf9e752/0x44bac02bd54ae175 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684541.638389:0:25183:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005cf9e752/0x44bac02bd54ae175 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684541.638404:0:25183:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788684541.638407:0:25183:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000017d9b66f/0x44bac02bd54ae17c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684541.638424:0:25183:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d66476d4600 already unused, calling callback (ffffffffc0cae340) 00010000:00010000:2.0:1788684541.638427:0:25183:0:(ldlm_request.c:377:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000017d9b66f/0x44bac02bd54ae17c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684541.638435:0:25183:0:(ldlm_request.c:1415:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000017d9b66f/0x44bac02bd54ae17c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684541.638445:0:25183:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000017d9b66f/0x44bac02bd54ae17c lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684541.638451:0:25183:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000017d9b66f/0x44bac02bd54ae17c lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684541.638464:0:25183:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788684541.638466:0:25183:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788684541.638468:0:25183:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788684541.638726:0:22720:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788684541.638768:0:24238:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788684541.638774:0:24238:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ecec689b/0x44bac02bd54ae183 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684541.638783:0:24238:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2d:0x0].0x0 since=622s v=(0 0) 00010000:00010000:3.0:1788684541.638786:0:24238:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788684541.638790:0:24238:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ecec689b/0x44bac02bd54ae183 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684541.638798:0:24238:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ecec689b/0x44bac02bd54ae183 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684541.638805:0:24238:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ecec689b/0x44bac02bd54ae183 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684541.638821:0:24238:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ecec689b/0x44bac02bd54ae183 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684541.638839:0:24238:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788684541.638951:0:25183:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788684541.638956:0:25183:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ecec689b/0x44bac02bd54ae183 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684541.638964:0:25183:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d6647891800 already unused, calling callback (ffffffffc0cae340) 00010000:00010000:2.0:1788684541.638967:0:25183:0:(ldlm_request.c:377:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ecec689b/0x44bac02bd54ae183 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684541.638975:0:25183:0:(ldlm_request.c:1415:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ecec689b/0x44bac02bd54ae183 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684541.638994:0:25183:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ecec689b/0x44bac02bd54ae183 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684541.639002:0:25183:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ecec689b/0x44bac02bd54ae183 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684541.639029:0:25183:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788684541.639031:0:25183:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788684541.639033:0:25183:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788684541.639147:0:24240:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x24:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788684541.639153:0:24240:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000057030853/0x44bac02bd54ae18a lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684541.639161:0:24240:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x24:0x0].0x0 since=622s v=(0 0) 00010000:00010000:2.0:1788684541.639164:0:24240:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x24:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788684541.639169:0:24240:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000057030853/0x44bac02bd54ae18a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684541.639178:0:24240:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000057030853/0x44bac02bd54ae18a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684541.639187:0:24240:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000057030853/0x44bac02bd54ae18a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684541.639195:0:24240:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000057030853/0x44bac02bd54ae18a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684541.639224:0:24240:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788684541.639596:0:22720:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788684541.639602:0:22720:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000057030853/0x44bac02bd54ae18a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684541.639610:0:22720:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d66476d5a00 already unused, calling callback (ffffffffc0cae340) 00010000:00010000:3.0:1788684541.639614:0:22720:0:(ldlm_request.c:377:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000057030853/0x44bac02bd54ae18a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684541.639622:0:22720:0:(ldlm_request.c:1415:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000057030853/0x44bac02bd54ae18a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684541.639635:0:22720:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000057030853/0x44bac02bd54ae18a lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684541.639643:0:22720:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000057030853/0x44bac02bd54ae18a lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684541.639657:0:22720:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788684541.639659:0:22720:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788684541.639660:0:22720:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788684541.640272:0:24240:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x23:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788684541.640280:0:24240:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ce34e32a/0x44bac02bd54ae191 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684541.640290:0:24240:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x23:0x0].0x0 since=622s v=(0 0) 00010000:00010000:2.0:1788684541.640294:0:24240:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x23:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788684541.640299:0:24240:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ce34e32a/0x44bac02bd54ae191 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684541.640309:0:24240:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ce34e32a/0x44bac02bd54ae191 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684541.640317:0:24240:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ce34e32a/0x44bac02bd54ae191 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684541.640323:0:24240:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ce34e32a/0x44bac02bd54ae191 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684541.640338:0:24240:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788684541.640346:0:25183:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788684541.640350:0:25183:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ce34e32a/0x44bac02bd54ae191 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684541.640357:0:25183:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d66476d4a00 already unused, calling callback (ffffffffc0cae340) 00010000:00010000:2.0:1788684541.640381:0:25183:0:(ldlm_request.c:377:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ce34e32a/0x44bac02bd54ae191 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684541.640388:0:25183:0:(ldlm_request.c:1415:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ce34e32a/0x44bac02bd54ae191 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684541.640400:0:25183:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ce34e32a/0x44bac02bd54ae191 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684541.640407:0:25183:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ce34e32a/0x44bac02bd54ae191 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24240 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684541.640421:0:25183:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788684541.640422:0:25183:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788684541.640424:0:25183:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00080000:2.0:1788684541.640468:0:24240:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0001: after destroy: set last_id to 0x2c0000401:34 00000100:00100000:2.0:1788684541.640549:0:24240:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6647a63100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:22759:x1875571085926656:12345-0@lo:5:osp-pre-1-0.0 Request processed in 68609us (71560us total) trans 0 rc 0/0 00000100:00100000:2.0:1788684541.640558:0:24240:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1788684541.640609:0:22759:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6647a60700 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:22759:1875571085926656:0@lo:5:osp-pre-1-0.0 00000004:00080000:2.0:1788684541.640636:0:22759:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x2c0000401:0x41:0x0] from OST, last_created [0x2c0000401:0x41:0x0]last_used is [0x2c0000401:0x22:0x0] 00000100:00100000:2.0:1788684541.640681:0:22759:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6647a60700 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:22759:1875571085927040:0@lo:5:osp-pre-1-0.0 00000100:00100000:2.0:1788684541.640715:0:22759:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788684541.640786:0:22759:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d6647bd9c00 going to sleep for 11 seconds 00000100:00100000:2.0:1788684541.640803:0:24240:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085927040 00000100:00100000:2.0:1788684541.640809:0:24240:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085927040 00000100:00100000:2.0:1788684541.640857:0:24240:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1788684541.640866:0:24240:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6647a61880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+6:23475:x1875571085926912:12345-0@lo:7:osp-pre-1-1.0 00010000:00010000:0.0:1788684541.641196:0:25184:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788684541.641204:0:22721:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788684541.644277:0:24238:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788684541.644299:0:24238:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000eded0393/0x44bac02bd54ae198 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684541.644315:0:24238:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2c:0x0].0x0 since=622s v=(0 0) 00010000:00010000:3.0:1788684541.644320:0:24238:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788684541.644327:0:24238:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000eded0393/0x44bac02bd54ae198 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684541.644342:0:24238:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000eded0393/0x44bac02bd54ae198 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684541.644353:0:24238:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000eded0393/0x44bac02bd54ae198 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684541.644361:0:24238:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000eded0393/0x44bac02bd54ae198 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684541.646787:0:24238:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788684541.646806:0:22720:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788684541.646815:0:22720:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000eded0393/0x44bac02bd54ae198 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684541.646826:0:22720:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d6647891200 already unused, calling callback (ffffffffc0cae340) 00010000:00010000:2.0:1788684541.646832:0:22720:0:(ldlm_request.c:377:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000eded0393/0x44bac02bd54ae198 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684541.646845:0:22720:0:(ldlm_request.c:1415:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000eded0393/0x44bac02bd54ae198 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684541.646866:0:22720:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000eded0393/0x44bac02bd54ae198 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684541.646874:0:22720:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000eded0393/0x44bac02bd54ae198 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684541.646895:0:22720:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788684541.646898:0:22720:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788684541.646905:0:22720:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788684541.649698:0:24238:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788684541.649710:0:24238:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f52e6150/0x44bac02bd54ae19f lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684541.649726:0:24238:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2b:0x0].0x0 since=622s v=(0 0) 00010000:00010000:3.0:1788684541.649730:0:24238:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788684541.649789:0:24238:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f52e6150/0x44bac02bd54ae19f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684541.649806:0:24238:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f52e6150/0x44bac02bd54ae19f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684541.649824:0:24238:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f52e6150/0x44bac02bd54ae19f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684541.649833:0:24238:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f52e6150/0x44bac02bd54ae19f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684541.649850:0:24238:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788684541.650317:0:25183:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788684541.650325:0:25183:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f52e6150/0x44bac02bd54ae19f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684541.650335:0:25183:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d6647891000 already unused, calling callback (ffffffffc0cae340) 00010000:00010000:2.0:1788684541.650347:0:25183:0:(ldlm_request.c:377:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f52e6150/0x44bac02bd54ae19f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684541.650358:0:25183:0:(ldlm_request.c:1415:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f52e6150/0x44bac02bd54ae19f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684541.650442:0:25183:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f52e6150/0x44bac02bd54ae19f lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684541.650451:0:25183:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f52e6150/0x44bac02bd54ae19f lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684541.650476:0:25183:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788684541.650479:0:25183:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788684541.650481:0:25183:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00080000:3.0:1788684541.650630:0:24240:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x2c0000400 00002000:00080000:3.0:1788684541.650636:0:24240:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0001: LAST FID is [0x2c0000400:0x41:0x0] 00000100:00100000:3.0:1788684541.650716:0:24240:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6647a61880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+6:23475:x1875571085926912:12345-0@lo:7:osp-pre-1-1.0 Request processed in 9848us (81645us total) trans 0 rc 0/0 00000100:00100000:3.0:1788684541.650725:0:24240:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1788684541.650963:0:23475:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6647a62300 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:23475:1875571085926912:0@lo:7:osp-pre-1-1.0 00000004:00080000:3.0:1788684541.650978:0:23475:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0001-osc-MDT0001: Got last_fid [0x2c0000400:0x41:0x0] 00000100:00100000:3.0:1788684541.651032:0:23475:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d66477ef800 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:23475:1875571085927168:0@lo:5:osp-pre-1-1.0 00000100:00100000:3.0:1788684541.651070:0:23475:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788684541.651100:0:23475:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d6647a8ae40 going to sleep for 11 seconds 00000100:00100000:3.0:1788684541.651117:0:24240:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085927168 00000100:00100000:3.0:1788684541.651125:0:24240:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085927168 00000100:00100000:3.0:1788684541.651238:0:24240:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1788684541.651248:0:24240:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6647a61180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:22759:x1875571085927040:12345-0@lo:5:osp-pre-1-0.0 00002000:00080000:3.0:1788684541.651286:0:24240:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000401 at 66 00002000:00010000:0.0:1788684541.651460:0:24238:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788684541.651470:0:24238:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e04d19ad/0x44bac02bd54ae1a6 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684541.651485:0:24238:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2a:0x0].0x0 since=622s v=(0 0) 00010000:00010000:0.0:1788684541.651489:0:24238:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788684541.651495:0:24238:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e04d19ad/0x44bac02bd54ae1a6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684541.651507:0:24238:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e04d19ad/0x44bac02bd54ae1a6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684541.651516:0:24238:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e04d19ad/0x44bac02bd54ae1a6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684541.652271:0:24238:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e04d19ad/0x44bac02bd54ae1a6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684541.652345:0:24238:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788684541.653065:0:25184:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788684541.653073:0:25184:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e04d19ad/0x44bac02bd54ae1a6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684541.653082:0:25184:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d6765f61400 already unused, calling callback (ffffffffc0cae340) 00010000:00010000:2.0:1788684541.653088:0:25184:0:(ldlm_request.c:377:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e04d19ad/0x44bac02bd54ae1a6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684541.653098:0:25184:0:(ldlm_request.c:1415:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e04d19ad/0x44bac02bd54ae1a6 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684541.653116:0:25184:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e04d19ad/0x44bac02bd54ae1a6 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684541.653131:0:25184:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e04d19ad/0x44bac02bd54ae1a6 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684541.653150:0:25184:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788684541.653152:0:25184:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788684541.653154:0:25184:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788684541.656813:0:24238:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x29:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788684541.656827:0:24238:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007e2d3009/0x44bac02bd54ae1ad lrc: 3/0,1 mode: --/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684541.656855:0:24238:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x29:0x0].0x0 since=622s v=(0 0) 00010000:00010000:3.0:1788684541.656860:0:24238:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x29:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788684541.656866:0:24238:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007e2d3009/0x44bac02bd54ae1ad lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684541.656880:0:24238:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007e2d3009/0x44bac02bd54ae1ad lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684541.656891:0:24238:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007e2d3009/0x44bac02bd54ae1ad lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684541.656899:0:24238:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007e2d3009/0x44bac02bd54ae1ad lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684541.656920:0:24238:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1788684541.657412:0:24238:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x28:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788684541.657418:0:24238:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003ab08c33/0x44bac02bd54ae1b4 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684541.657426:0:24238:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x28:0x0].0x0 since=622s v=(0 0) 00010000:00010000:3.0:1788684541.657430:0:24238:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x28:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788684541.657435:0:24238:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003ab08c33/0x44bac02bd54ae1b4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684541.657445:0:24238:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003ab08c33/0x44bac02bd54ae1b4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684541.657469:0:24238:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003ab08c33/0x44bac02bd54ae1b4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684541.657476:0:24238:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003ab08c33/0x44bac02bd54ae1b4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684541.657497:0:24238:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1788684541.657513:0:22720:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788684541.657529:0:22720:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007e2d3009/0x44bac02bd54ae1ad lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684541.657550:0:22720:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d6647890600 already unused, calling callback (ffffffffc0cae340) 00010000:00010000:2.0:1788684541.657562:0:22720:0:(ldlm_request.c:377:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007e2d3009/0x44bac02bd54ae1ad lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684541.657575:0:22720:0:(ldlm_request.c:1415:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007e2d3009/0x44bac02bd54ae1ad lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684541.657593:0:22720:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007e2d3009/0x44bac02bd54ae1ad lrc: 1/0,0 mode: --/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684541.657602:0:22720:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007e2d3009/0x44bac02bd54ae1ad lrc: 0/0,0 mode: --/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684541.657620:0:22720:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788684541.657624:0:22720:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003ab08c33/0x44bac02bd54ae1b4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684541.657641:0:22720:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d6647891c00 already unused, calling callback (ffffffffc0cae340) 00010000:00010000:2.0:1788684541.657645:0:22720:0:(ldlm_request.c:377:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003ab08c33/0x44bac02bd54ae1b4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684541.657653:0:22720:0:(ldlm_request.c:1415:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003ab08c33/0x44bac02bd54ae1b4 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684541.657663:0:22720:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003ab08c33/0x44bac02bd54ae1b4 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684541.657671:0:22720:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003ab08c33/0x44bac02bd54ae1b4 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684541.657685:0:22720:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788684541.657687:0:22720:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788684541.657689:0:22720:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788684541.657761:0:24238:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x27:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788684541.657767:0:24238:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cd166f76/0x44bac02bd54ae1bb lrc: 3/0,1 mode: --/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684541.657775:0:24238:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x27:0x0].0x0 since=622s v=(0 0) 00010000:00010000:3.0:1788684541.657778:0:24238:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x27:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788684541.657782:0:24238:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000cd166f76/0x44bac02bd54ae1bb lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684541.657791:0:24238:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000cd166f76/0x44bac02bd54ae1bb lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684541.657799:0:24238:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cd166f76/0x44bac02bd54ae1bb lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684541.657805:0:24238:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000cd166f76/0x44bac02bd54ae1bb lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684541.657833:0:24238:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788684541.657841:0:25183:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788684541.657849:0:25183:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000cd166f76/0x44bac02bd54ae1bb lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684541.657850:0:22721:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788684541.657860:0:25183:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d6647890400 already unused, calling callback (ffffffffc0cae340) 00010000:00010000:2.0:1788684541.657864:0:25183:0:(ldlm_request.c:377:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000cd166f76/0x44bac02bd54ae1bb lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684541.657874:0:25183:0:(ldlm_request.c:1415:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000cd166f76/0x44bac02bd54ae1bb lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684541.657892:0:25183:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000cd166f76/0x44bac02bd54ae1bb lrc: 1/0,0 mode: --/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684541.657899:0:25183:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000cd166f76/0x44bac02bd54ae1bb lrc: 0/0,0 mode: --/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684541.658041:0:25183:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788684541.658044:0:25183:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788684541.658047:0:25183:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788684541.658192:0:24238:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x26:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788684541.658198:0:24238:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009379845d/0x44bac02bd54ae1c2 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684541.658206:0:24238:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x26:0x0].0x0 since=622s v=(0 0) 00010000:00010000:3.0:1788684541.658210:0:24238:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x26:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788684541.658214:0:24238:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009379845d/0x44bac02bd54ae1c2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684541.658234:0:24238:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009379845d/0x44bac02bd54ae1c2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684541.658242:0:24238:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009379845d/0x44bac02bd54ae1c2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684541.658248:0:24238:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009379845d/0x44bac02bd54ae1c2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684541.658266:0:24238:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1788684541.658632:0:24238:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x25:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788684541.658639:0:24238:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000038396e1c/0x44bac02bd54ae1c9 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684541.658646:0:24238:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x25:0x0].0x0 since=622s v=(0 0) 00010000:00010000:3.0:1788684541.658655:0:24238:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x25:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788684541.658660:0:24238:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000038396e1c/0x44bac02bd54ae1c9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684541.658669:0:24238:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000038396e1c/0x44bac02bd54ae1c9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684541.658676:0:24238:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000038396e1c/0x44bac02bd54ae1c9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684541.658684:0:24238:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000038396e1c/0x44bac02bd54ae1c9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684541.658701:0:24238:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:3.0:1788684541.659145:0:24238:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x24:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788684541.659151:0:24238:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008cbf5325/0x44bac02bd54ae1d0 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684541.659160:0:24238:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x24:0x0].0x0 since=622s v=(0 0) 00010000:00010000:3.0:1788684541.659163:0:24238:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x24:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788684541.659167:0:24238:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008cbf5325/0x44bac02bd54ae1d0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684541.659175:0:24238:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008cbf5325/0x44bac02bd54ae1d0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684541.659183:0:24238:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008cbf5325/0x44bac02bd54ae1d0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684541.659196:0:24238:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008cbf5325/0x44bac02bd54ae1d0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684541.659208:0:24238:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:1.0:1788684541.659405:0:22720:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1788684541.659410:0:25184:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788684541.659412:0:22720:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009379845d/0x44bac02bd54ae1c2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684541.659415:0:25184:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000038396e1c/0x44bac02bd54ae1c9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684541.659421:0:22720:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d6647891a00 already unused, calling callback (ffffffffc0cae340) 00010000:00010000:1.0:1788684541.659426:0:22720:0:(ldlm_request.c:377:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009379845d/0x44bac02bd54ae1c2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684541.659433:0:25184:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d6647891600 already unused, calling callback (ffffffffc0cae340) 00010000:00010000:1.0:1788684541.659435:0:22720:0:(ldlm_request.c:1415:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009379845d/0x44bac02bd54ae1c2 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684541.659436:0:25184:0:(ldlm_request.c:377:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000038396e1c/0x44bac02bd54ae1c9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684541.659444:0:25184:0:(ldlm_request.c:1415:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000038396e1c/0x44bac02bd54ae1c9 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684541.659451:0:22720:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009379845d/0x44bac02bd54ae1c2 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684541.659453:0:25184:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000038396e1c/0x44bac02bd54ae1c9 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684541.659459:0:22720:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009379845d/0x44bac02bd54ae1c2 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684541.659461:0:25184:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000038396e1c/0x44bac02bd54ae1c9 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684541.659474:0:22720:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788684541.659474:0:25184:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788684541.659476:0:25184:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788684541.659477:0:22720:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008cbf5325/0x44bac02bd54ae1d0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684541.659478:0:25184:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788684541.659483:0:22721:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788684541.659492:0:22720:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d6647890000 already unused, calling callback (ffffffffc0cae340) 00010000:00010000:1.0:1788684541.659495:0:22720:0:(ldlm_request.c:377:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008cbf5325/0x44bac02bd54ae1d0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684541.659502:0:22720:0:(ldlm_request.c:1415:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008cbf5325/0x44bac02bd54ae1d0 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684541.659511:0:22720:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008cbf5325/0x44bac02bd54ae1d0 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684541.659518:0:22720:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008cbf5325/0x44bac02bd54ae1d0 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684541.659529:0:22720:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788684541.659530:0:22720:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788684541.659532:0:22720:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788684541.667486:0:24238:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x23:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788684541.667500:0:24238:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000051015539/0x44bac02bd54ae1d7 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684541.667516:0:24238:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x23:0x0].0x0 since=622s v=(0 0) 00010000:00010000:0.0:1788684541.667533:0:24238:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x23:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788684541.667539:0:24238:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000051015539/0x44bac02bd54ae1d7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684541.667570:0:24238:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000051015539/0x44bac02bd54ae1d7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684541.667581:0:24238:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000051015539/0x44bac02bd54ae1d7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684541.667588:0:24238:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000051015539/0x44bac02bd54ae1d7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684541.667611:0:24238:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788684541.667639:0:25183:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788684541.667656:0:25183:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000051015539/0x44bac02bd54ae1d7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684541.667668:0:25183:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d6765f60800 already unused, calling callback (ffffffffc0cae340) 00010000:00010000:2.0:1788684541.667673:0:25183:0:(ldlm_request.c:377:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000051015539/0x44bac02bd54ae1d7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684541.667684:0:25183:0:(ldlm_request.c:1415:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000051015539/0x44bac02bd54ae1d7 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684541.667701:0:25183:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000051015539/0x44bac02bd54ae1d7 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684541.667710:0:25183:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000051015539/0x44bac02bd54ae1d7 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684541.667740:0:25183:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788684541.667742:0:25183:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788684541.667744:0:25183:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788684541.668355:0:24238:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x22:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788684541.668395:0:24238:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000bf67b20/0x44bac02bd54ae1de lrc: 3/0,1 mode: --/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684541.668406:0:24238:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x22:0x0].0x0 since=622s v=(0 0) 00010000:00010000:0.0:1788684541.668409:0:24238:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788684541.668414:0:24238:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000bf67b20/0x44bac02bd54ae1de lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684541.668423:0:24238:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000bf67b20/0x44bac02bd54ae1de lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684541.668431:0:24238:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000bf67b20/0x44bac02bd54ae1de lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684541.668452:0:24238:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000bf67b20/0x44bac02bd54ae1de lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684541.668471:0:24238:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788684541.670452:0:25184:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788684541.670466:0:25184:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000bf67b20/0x44bac02bd54ae1de lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684541.670477:0:25184:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d6765f60e00 already unused, calling callback (ffffffffc0cae340) 00010000:00010000:3.0:1788684541.670482:0:25184:0:(ldlm_request.c:377:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000bf67b20/0x44bac02bd54ae1de lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684541.670493:0:25184:0:(ldlm_request.c:1415:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000bf67b20/0x44bac02bd54ae1de lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684541.670513:0:25184:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000bf67b20/0x44bac02bd54ae1de lrc: 1/0,0 mode: --/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684541.670532:0:25184:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000bf67b20/0x44bac02bd54ae1de lrc: 0/0,0 mode: --/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24238 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684541.670558:0:25184:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788684541.670560:0:25184:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788684541.670562:0:25184:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00080000:0.0:1788684541.670805:0:24238:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0000: after destroy: set last_id to 0x280000401:5 00000100:00100000:0.0:1788684541.671021:0:24238:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6647a60380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:22757:x1875571085926400:12345-0@lo:5:osp-pre-0-0.0 Request processed in 101578us (102179us total) trans 0 rc 0/0 00000100:00100000:0.0:1788684541.671031:0:24238:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1788684541.671062:0:24238:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1788684541.672462:0:22757:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6647a62d80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:22757:1875571085926400:0@lo:5:osp-pre-0-0.0 00000004:00080000:3.0:1788684541.672497:0:22757:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x280000401:0x41:0x0] from OST, last_created [0x280000401:0x41:0x0]last_used is [0x280000401:0x5:0x0] 00000100:00100000:0.0:1788684541.672631:0:24238:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d66477eed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:23475:x1875571085927168:12345-0@lo:5:osp-pre-1-1.0 00002000:00080000:0.0:1788684541.672664:0:24238:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 65 -> diff = 0 00000100:00100000:0.0:1788684541.672726:0:24238:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d66477eed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:23475:x1875571085927168:12345-0@lo:5:osp-pre-1-1.0 Request processed in 1657us (21657us total) trans 0 rc 0/0 00000100:00100000:0.0:1788684541.672734:0:24238:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1788684541.672771:0:23475:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d66477ef800 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:23475:1875571085927168:0@lo:5:osp-pre-1-1.0 00000004:00080000:0.0:1788684541.672780:0:23475:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0001: Got last_id [0x2c0000400:0x41:0x0] from OST, last_created [0x2c0000400:0x41:0x0]last_used is [0x2c0000400:0x41:0x0] 00000100:00100000:0.0:1788684541.672821:0:23475:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d67450b3480 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:23475:1875571085927296:0@lo:5:osp-pre-1-1.0 00000100:00100000:0.0:1788684541.672855:0:23475:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788684541.673431:0:22757:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d66477edf80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:22757:1875571085927424:0@lo:5:osp-pre-0-0.0 00000100:00100000:1.0:1788684541.673779:0:24241:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085927296 00000100:00100000:1.0:1788684541.673787:0:24241:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085927296 00000100:00100000:1.0:1788684541.673831:0:24241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1788684541.673840:0:24241:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67450b3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+6:23475:x1875571085927296:12345-0@lo:5:osp-pre-1-1.0 00002000:00080000:1.0:1788684541.673885:0:24241:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000400 at 66 00000100:00100000:3.0:1788684541.674178:0:22757:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788684541.674204:0:24763:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 4 min 3 max 116 00000100:00100000:3.0:1788684541.674212:0:22757:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d6742845e40 going to sleep for 11 seconds 00000100:00100000:1.0:1788684541.674213:0:24763:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_004' 00000001:00080000:1.0:1788684541.674762:0:25054:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 12884901889 is committed 00000001:00100000:1.0:1788684541.674800:0:25054:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000001:00100000:1.0:1788684541.674805:0:25054:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:1.0:1788684541.674926:0:24240:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6647a61180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:22759:x1875571085927040:12345-0@lo:5:osp-pre-1-0.0 Request processed in 23679us (34209us total) trans 12884901889 rc 0/0 00000100:00100000:1.0:1788684541.674934:0:24240:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1788684541.674954:0:24240:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085927424 00000100:00100000:1.0:1788684541.674958:0:24240:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085927424 00000100:00100000:1.0:1788684541.674981:0:24240:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1788684541.674987:0:24240:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d66477ee680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:22757:x1875571085927424:12345-0@lo:5:osp-pre-0-0.0 00002000:00080000:1.0:1788684541.675022:0:24240:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000401 at 66 00000100:00100000:0.0:1788684541.675313:0:23475:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d67460443c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788684541.675691:0:22759:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 12884901889 gen 2 00000100:00100000:0.0:1788684541.675699:0:22759:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6647a60700 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:22759:1875571085927040:0@lo:5:osp-pre-1-0.0 00000004:00080000:0.0:1788684541.675713:0:22759:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x2c0000401:0x41:0x0]-[0x2c0000401:0x61:0x0] 00000001:00080000:1.0:1788684541.691176:0:24235:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 12884901890 is committed 00000001:00100000:1.0:1788684541.691219:0:24235:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:0.0:1788684541.691729:0:24240:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d66477ee680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:22757:x1875571085927424:12345-0@lo:5:osp-pre-0-0.0 Request processed in 16736us (17547us total) trans 12884901890 rc 0/0 00000100:00100000:2.0:1788684541.691972:0:22757:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 12884901890 gen 2 00000100:00100000:2.0:1788684541.691982:0:22757:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d66477edf80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:22757:1875571085927424:0@lo:5:osp-pre-0-0.0 00000004:00080000:2.0:1788684541.691999:0:22757:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x280000401:0x41:0x0]-[0x280000401:0x61:0x0] 00000100:00100000:0.0:1788684541.692851:0:24240:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1788684541.695162:0:24241:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67450b3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+6:23475:x1875571085927296:12345-0@lo:5:osp-pre-1-1.0 Request processed in 21317us (22299us total) trans 12884901890 rc 0/0 00000100:00100000:2.0:1788684541.695174:0:24241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1788684541.695337:0:23475:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d67450b3480 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:23475:1875571085927296:0@lo:5:osp-pre-1-1.0 00000004:00080000:0.0:1788684541.695353:0:23475:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0001: current precreated pool: [0x2c0000400:0x41:0x0]-[0x2c0000400:0x61:0x0] 00000100:00100000:0.0:1788684541.695411:0:23475:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d67450b1f80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0000-lwp-MDT0001_UUID:23475:1875571085927552:0@lo:900:osp-pre-1-1.0 00000100:00100000:0.0:1788684541.695447:0:23475:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788684541.695478:0:23475:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d67460443c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788684541.695784:0:22743:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085927552 00000100:00100000:2.0:1788684541.695792:0:22743:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085927552 00000100:00100000:2.0:1788684541.695843:0:22743:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788684541.695853:0:22743:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67450b0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:23475:x1875571085927552:12345-0@lo:900:osp-pre-1-1.0 00000100:00100000:2.0:1788684541.696036:0:22743:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67450b0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:23475:x1875571085927552:12345-0@lo:900:osp-pre-1-1.0 Request processed in 183us (586us total) trans 0 rc 0/0 00000100:00100000:2.0:1788684541.696043:0:22743:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:3.0:1788684541.696105:0:23475:0:(ldlm_request.c:1670:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d67450b1f80 x1875571085927552/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1788684557 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788684541.696117:0:23475:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d67450b1f80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0000-lwp-MDT0001_UUID:23475:1875571085927552:0@lo:900:osp-pre-1-1.0 00000040:00080000:0.0:1788684541.886769:0:23489:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1788684542.653761:0:22721:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788684543.621728:0:3624:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788684543.621752:0:3624:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d677fab5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3624:1875571085927680:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788684543.621860:0:3624:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788684543.622780:0:24243:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085927680 00000100:00100000:1.0:1788684543.622792:0:24243:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085927680 00000100:00100000:1.0:1788684543.622903:0:24243:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788684543.622917:0:24243:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67450b1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3624:x1875571085927680:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1788684543.622948:0:24243:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923513344 avail 3691991040 00000100:00100000:1.0:1788684543.623030:0:24243:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67450b1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3624:x1875571085927680:12345-0@lo:13:osp-pre-0-1.0 Request processed in 118us (1169us total) trans 0 rc 0/0 00000100:00100000:1.0:1788684543.623037:0:24243:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788684543.623092:0:3624:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d677fab5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3624:1875571085927680:0@lo:13:osp-pre-0-1.0 00000100:00080000:3.0:1788684543.623261:0:22728:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1788684543.677730:0:22720:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788684544.720465:0:25183:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788684545.150069:0:3624:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6647a61f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3624:1875571085927808:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788684545.150193:0:3624:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788684545.150321:0:22738:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085927808 00000100:00100000:2.0:1788684545.150330:0:22738:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085927808 00000100:00100000:2.0:1788684545.150403:0:22738:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1788684545.150413:0:22738:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67450b1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3624:x1875571085927808:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1788684545.150460:0:22738:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:2.0:1788684545.150529:0:22738:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67450b1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3624:x1875571085927808:12345-0@lo:41:osp-pre-1-0.0 Request processed in 118us (335us total) trans 0 rc 0/0 00000100:00100000:2.0:1788684545.150537:0:22738:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1788684545.150582:0:3624:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6647a61f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3624:1875571085927808:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788684545.151528:0:3626:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788684545.151543:0:3626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d66477ed880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3626:1875571085927936:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788684545.151615:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788684545.151656:0:24164:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085927936 00000100:00100000:3.0:1788684545.151662:0:24164:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085927936 00000100:00100000:3.0:1788684545.151699:0:24164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1788684545.151707:0:24164:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d66477ece00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3626:x1875571085927936:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1788684545.151732:0:24164:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446309888 avail 1300070400 00000100:00100000:3.0:1788684545.151802:0:24164:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d66477ece00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3626:x1875571085927936:12345-0@lo:41:osp-pre-0-1.0 Request processed in 95us (187us total) trans 0 rc 0/0 00000100:00100000:3.0:1788684545.152124:0:24164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1788684545.152169:0:3626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d66477ed880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3626:1875571085927936:0@lo:41:osp-pre-0-1.0 00010000:00010000:3.0:1788684545.726216:0:25184:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1788684545.852618:0:25412:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg644-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000100:00100000:1.0:1788684546.685773:0:3625:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d677fab4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3625:1875571085928448:0@lo:400:kworker.0 00000100:00100000:1.0:1788684546.685867:0:3625:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788684546.685922:0:3625:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d677fab6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3625:1875571085928960:0@lo:400:kworker.0 00000100:00100000:1.0:1788684546.685944:0:3625:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788684546.685970:0:3625:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d677fab7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3625:1875571085929472:0@lo:400:kworker.0 00000100:00100000:0.0:1788684546.686175:0:3626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d677fab5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:cebd1789-51a4-46ff-b167-6b1633e930a1:3626:1875571085928064:0@lo:400:kworker.0 00000100:00100000:0.0:1788684546.686227:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788684546.686259:0:3626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d677fab4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3626:1875571085928576:0@lo:400:kworker.0 00000100:00100000:0.0:1788684546.686306:0:24238:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085928448 00000100:00100000:0.0:1788684546.686315:0:24238:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085928448 00000100:00100000:0.0:1788684546.686402:0:24238:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085928960 00000100:00100000:0.0:1788684546.686405:0:24238:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085928960 00000100:00100000:0.0:1788684546.686429:0:24238:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788684546.686437:0:24238:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6747a6d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3625:x1875571085928448:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788684546.686493:0:24238:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6747a6d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3625:x1875571085928448:12345-0@lo:400:kworker.0 Request processed in 56us (626us total) trans 0 rc 0/0 00000100:00100000:0.0:1788684546.686500:0:24238:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788684546.686526:0:24238:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788684546.686531:0:24238:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6747a6c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:3625:x1875571085928960:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788684546.686562:0:24238:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6747a6c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:3625:x1875571085928960:12345-0@lo:400:kworker.0 Request processed in 31us (617us total) trans 0 rc 0/0 00000100:00100000:0.0:1788684546.686568:0:24238:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788684546.686591:0:22726:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085928064 00000100:00100000:0.0:1788684546.686594:0:22726:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085928064 00000100:00100000:0.0:1788684546.686621:0:22726:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:0.0:1788684546.686627:0:22726:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67511aec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cebd1789-51a4-46ff-b167-6b1633e930a1+24:3626:x1875571085928064:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788684546.686660:0:22726:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67511aec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cebd1789-51a4-46ff-b167-6b1633e930a1+24:3626:x1875571085928064:12345-0@lo:400:kworker.0 Request processed in 33us (433us total) trans 0 rc 0/0 00000100:00100000:0.0:1788684546.686666:0:22726:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00080000:0.0:1788684546.686691:0:22728:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788684546.687570:0:3625:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788684546.687683:0:3625:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d677fab4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3625:1875571085928448:0@lo:400:kworker.0 00000100:00100000:1.0:1788684546.687699:0:3625:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d677fab6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3625:1875571085928960:0@lo:400:kworker.0 00000100:00100000:1.0:1788684546.687744:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d677fab4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3623:1875571085928192:0@lo:400:kworker.0 00000100:00100000:1.0:1788684546.687799:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788684546.687821:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d677fab7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3623:1875571085928704:0@lo:400:kworker.0 00000100:00100000:1.0:1788684546.687854:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788684546.687875:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d677fab7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3623:1875571085929216:0@lo:400:kworker.0 00000100:00100000:1.0:1788684546.687904:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788684546.687929:0:3623:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:1.0:1788684546.687937:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d677fab4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3623:1875571085928320:0@lo:400:kworker.0 00000100:00100000:1.0:1788684546.687967:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788684546.688002:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d677fab5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3623:1875571085928832:0@lo:400:kworker.0 00000100:00100000:1.0:1788684546.688053:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788684546.688070:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d677fab6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3623:1875571085929344:0@lo:400:kworker.0 00000100:00100000:1.0:1788684546.688089:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788684546.688123:0:22733:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085929472 00000100:00100000:1.0:1788684546.688130:0:22733:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085929472 00000100:00100000:1.0:1788684546.688177:0:22733:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085929216 00000100:00100000:1.0:1788684546.688181:0:22733:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085929216 00000100:00100000:1.0:1788684546.688195:0:22733:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085929344 00000100:00100000:1.0:1788684546.688198:0:22733:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085929344 00000100:00100000:1.0:1788684546.688213:0:22733:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1788684546.688221:0:22733:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6747a6dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3625:x1875571085929472:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788684546.688283:0:22733:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6747a6dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3625:x1875571085929472:12345-0@lo:400:kworker.0 Request processed in 62us (720us total) trans 0 rc 0/0 00000100:00100000:1.0:1788684546.688290:0:22733:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1788684546.688307:0:22733:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1788684546.688313:0:22733:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6747a6e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3623:x1875571085929216:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788684546.688347:0:22733:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6747a6e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3623:x1875571085929216:12345-0@lo:400:kworker.0 Request processed in 35us (442us total) trans 0 rc 0/0 00000100:00100000:1.0:1788684546.688355:0:22733:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1788684546.688399:0:22733:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1788684546.688406:0:22733:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6747a6df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3623:x1875571085929344:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788684546.688438:0:22733:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6747a6df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3623:x1875571085929344:12345-0@lo:400:kworker.0 Request processed in 33us (347us total) trans 0 rc 0/0 00000100:00100000:1.0:1788684546.688444:0:22733:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1788684546.688465:0:24164:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085928192 00000100:00100000:1.0:1788684546.688469:0:24164:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085928192 00000100:00100000:1.0:1788684546.688494:0:24164:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085928704 00000100:00100000:1.0:1788684546.688497:0:24164:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085928704 00000100:00100000:1.0:1788684546.688513:0:24164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1788684546.688518:0:24164:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6747a6ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3623:x1875571085928192:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788684546.688553:0:24164:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6747a6ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3623:x1875571085928192:12345-0@lo:400:kworker.0 Request processed in 34us (754us total) trans 0 rc 0/0 00000100:00100000:1.0:1788684546.688559:0:24164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1788684546.688572:0:24164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1788684546.688579:0:24164:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6747a6d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3623:x1875571085928704:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788684546.688612:0:24164:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6747a6d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3623:x1875571085928704:12345-0@lo:400:kworker.0 Request processed in 34us (757us total) trans 0 rc 0/0 00000100:00100000:1.0:1788684546.688630:0:24164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00010000:00080000:1.0:1788684546.688674:0:3623:0:(ldlm_request.c:1670:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d677fab6d80 x1875571085929344/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788684562 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788684546.688686:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d677fab6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3623:1875571085929344:0@lo:400:kworker.0 00000100:00100000:1.0:1788684546.688699:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d677fab4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3623:1875571085928192:0@lo:400:kworker.0 00000100:00100000:1.0:1788684546.688711:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d677fab7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3623:1875571085928704:0@lo:400:kworker.0 00010000:00080000:1.0:1788684546.688721:0:3623:0:(ldlm_request.c:1670:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d677fab7480 x1875571085929216/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788684562 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788684546.688730:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d677fab7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3623:1875571085929216:0@lo:400:kworker.0 00010000:00080000:1.0:1788684546.688766:0:3625:0:(ldlm_request.c:1670:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d677fab7b80 x1875571085929472/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788684562 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788684546.688774:0:3625:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d677fab7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3625:1875571085929472:0@lo:400:kworker.0 00000100:00100000:0.0:1788684546.689485:0:3624:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788684546.689505:0:3624:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d67450b2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3624:1875571085929728:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788684546.689572:0:3624:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788684546.689639:0:24243:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085929728 00000100:00100000:0.0:1788684546.689647:0:24243:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085929728 00000100:00100000:0.0:1788684546.689703:0:24243:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788684546.689713:0:24243:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67450b0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3624:x1875571085929728:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1788684546.689752:0:24243:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3915849728 avail 3684327424 00000100:00100000:0.0:1788684546.689802:0:24243:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67450b0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3624:x1875571085929728:12345-0@lo:13:osp-pre-1-1.0 Request processed in 90us (229us total) trans 0 rc 0/0 00000100:00100000:0.0:1788684546.689809:0:24243:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00080000:0.0:1788684546.689832:0:22728:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788684546.689838:0:22728:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788684546.689852:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788684546.689893:0:3626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d677fab5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3626:1875571085929088:0@lo:400:kworker.0 00000100:00100000:0.0:1788684546.689923:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788684546.689943:0:3626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d677fab6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3626:1875571085929600:0@lo:400:kworker.0 00000100:00100000:0.0:1788684546.689969:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788684546.690012:0:3626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d677fab5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:cebd1789-51a4-46ff-b167-6b1633e930a1:3626:1875571085928064:0@lo:400:kworker.0 00000100:00100000:0.0:1788684546.690044:0:22732:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085928576 00000100:00100000:0.0:1788684546.690047:0:22732:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085928576 00000100:00100000:0.0:1788684546.690068:0:22732:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085929088 00000100:00100000:0.0:1788684546.690071:0:22732:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085929088 00000100:00100000:0.0:1788684546.690082:0:22732:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085929600 00000100:00100000:0.0:1788684546.690084:0:22732:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085929600 00000100:00100000:0.0:1788684546.690107:0:22732:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1788684546.690113:0:22732:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d664859ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3626:x1875571085928576:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788684546.690153:0:22732:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d664859ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3626:x1875571085928576:12345-0@lo:400:kworker.0 Request processed in 40us (300us total) trans 0 rc 0/0 00000100:00100000:0.0:1788684546.690160:0:22732:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1788684546.690172:0:22732:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1788684546.690178:0:22732:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d674698e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3626:x1875571085929088:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788684546.690205:0:22732:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d674698e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3626:x1875571085929088:12345-0@lo:400:kworker.0 Request processed in 27us (282us total) trans 0 rc 0/0 00000100:00100000:0.0:1788684546.690211:0:22732:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1788684546.690220:0:22732:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1788684546.690226:0:22732:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d674698ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3626:x1875571085929600:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788684546.690250:0:22732:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d674698ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3626:x1875571085929600:12345-0@lo:400:kworker.0 Request processed in 25us (280us total) trans 0 rc 0/0 00000100:00100000:0.0:1788684546.690256:0:22732:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00080000:0.0:1788684546.690292:0:22728:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788684546.690324:0:3624:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d67450b2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3624:1875571085929728:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788684546.690347:0:24238:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085928320 00000100:00100000:0.0:1788684546.690351:0:24238:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085928320 00000100:00100000:0.0:1788684546.690402:0:24238:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085928832 00000100:00100000:0.0:1788684546.690406:0:24238:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085928832 00000100:00100000:0.0:1788684546.690425:0:24238:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788684546.690431:0:24238:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6747a6f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3623:x1875571085928320:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788684546.690471:0:24238:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6747a6f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3623:x1875571085928320:12345-0@lo:400:kworker.0 Request processed in 41us (2504us total) trans 0 rc 0/0 00000100:00100000:0.0:1788684546.690478:0:24238:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788684546.690488:0:24238:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788684546.690494:0:24238:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6747a6d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3623:x1875571085928832:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788684546.690523:0:24238:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6747a6d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3623:x1875571085928832:12345-0@lo:400:kworker.0 Request processed in 28us (2470us total) trans 0 rc 0/0 00000100:00100000:0.0:1788684546.690529:0:24238:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00080000:0.0:1788684546.690550:0:22728:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1788684546.690570:0:3626:0:(ldlm_request.c:1670:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d677fab4e00 x1875571085928576/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788684562 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788684546.690580:0:3626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d677fab4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3626:1875571085928576:0@lo:400:kworker.0 00010000:00080000:0.0:1788684546.690590:0:3626:0:(ldlm_request.c:1670:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d677fab5500 x1875571085929088/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788684562 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788684546.690597:0:3626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d677fab5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3626:1875571085929088:0@lo:400:kworker.0 00010000:00080000:0.0:1788684546.690607:0:3626:0:(ldlm_request.c:1670:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d677fab6300 x1875571085929600/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788684562 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788684546.690629:0:3626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d677fab6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3626:1875571085929600:0@lo:400:kworker.0 00000100:00100000:0.0:1788684546.690674:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d677fab4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3623:1875571085928320:0@lo:400:kworker.0 00000100:00100000:0.0:1788684546.690687:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d677fab5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3623:1875571085928832:0@lo:400:kworker.0 00000100:00100000:0.0:1788684546.694736:0:3624:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6647a61f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3624:1875571085929856:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788684546.694827:0:3624:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788684546.694899:0:24243:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085929856 00000100:00100000:0.0:1788684546.694907:0:24243:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085929856 00000100:00100000:0.0:1788684546.694952:0:24243:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788684546.694962:0:24243:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d674698d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3624:x1875571085929856:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788684546.695001:0:24243:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3915849728 avail 3684327424 00000100:00100000:0.0:1788684546.695051:0:24243:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d674698d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3624:x1875571085929856:12345-0@lo:13:osp-pre-1-0.0 Request processed in 90us (225us total) trans 0 rc 0/0 00000100:00100000:0.0:1788684546.695058:0:24243:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788684546.695108:0:3624:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6647a61f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3624:1875571085929856:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788684546.695133:0:3626:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788684546.695140:0:3626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6647a60e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3626:1875571085929984:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788684546.695163:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788684546.695183:0:24243:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085929984 00000100:00100000:0.0:1788684546.695187:0:24243:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085929984 00000100:00100000:0.0:1788684546.695204:0:24243:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1788684546.695210:0:24243:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d674698e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3626:x1875571085929984:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788684546.695230:0:24243:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923513344 avail 3691991040 00000100:00100000:0.0:1788684546.695261:0:24243:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d674698e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3626:x1875571085929984:12345-0@lo:13:osp-pre-0-0.0 Request processed in 51us (97us total) trans 0 rc 0/0 00000100:00100000:0.0:1788684546.697931:0:24243:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1788684546.698110:0:3626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6647a60e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3626:1875571085929984:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1788684546.749728:0:22721:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:0.0:1788684547.048022:0:25464:0:(tgt_mount.c:2350:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1788684547.048701:0:25464:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=81009431 00000001:00080000:1.0:1788684547.202264:0:25054:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 12884901890 is committed 00010000:00010000:3.0:1788684547.774844:0:22720:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:1.0:1788684547.833578:0:25514:0:(tgt_mount.c:2350:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1788684547.833830:0:25514:0:(tgt_mount.c:2365:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:0.0:1788684548.106806:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:3.0:1788684548.106943:0:22727:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073236224 00000100:00100000:3.0:1788684548.106971:0:22727:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073236224 00000100:00100000:3.0:1788684548.107036:0:22727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 116 00000100:00100000:3.0:1788684548.107046:0:22727:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67511ad050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0+-99:2389:x1875571073236224:12345-192.168.206.44@tcp:250:mount.lustre.0 00010000:00080000:3.0:1788684548.107083:0:22727:0:(ldlm_lib.c:1444:target_handle_connect()) MGS: connection from 9f969391-6479-4864-94e2-df3227346f88@192.168.206.44@tcp t0 exp 0000000000000000 cur 629 last 0 00000020:00000080:3.0:1788684548.107119:0:22727:0:(genops.c:1385:class_connect()) connect: client 9f969391-6479-4864-94e2-df3227346f88, cookie 0x44bac02bd54ae1e5 00000100:00080000:3.0:1788684548.107297:0:22727:0:(import.c:65:import_set_state_nolock()) ffff8d66474d2000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788684548.107666:0:22727:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67511ad050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9f969391-6479-4864-94e2-df3227346f88+5:2389:x1875571073236224:12345-192.168.206.44@tcp:250:mount.lustre.0 Request processed in 619us (874us total) trans 0 rc 0/0 00000100:00100000:3.0:1788684548.107675:0:22727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 116 00000100:00100000:3.0:1788684548.118017:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:0.0:1788684548.118800:0:22725:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073236352 00000100:00100000:0.0:1788684548.118816:0:22725:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073236352 00000100:00100000:0.0:1788684548.118902:0:22725:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 117 00000100:00100000:0.0:1788684548.118913:0:22725:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67511af050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9f969391-6479-4864-94e2-df3227346f88+5:18052:x1875571073236352:12345-192.168.206.44@tcp:101:mount.lustre.0 00010000:00010000:0.0:1788684548.118934:0:22725:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788684548.118959:0:22725:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d6765f60200/0x44bac02bd54ae1ec lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0xb726964c63ed3fee expref: -99 pid: 22725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684548.119007:0:22725:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d6765f60200/0x44bac02bd54ae1ec lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3fee expref: 6 pid: 22725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684548.119020:0:22725:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d6765f60200/0x44bac02bd54ae1ec lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3fee expref: 6 pid: 22725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684548.119032:0:22725:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d6765f60200, rc 0) 00000100:00100000:0.0:1788684548.119117:0:22725:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67511af050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9f969391-6479-4864-94e2-df3227346f88+6:18052:x1875571073236352:12345-192.168.206.44@tcp:101:mount.lustre.0 Request processed in 206us (1113us total) trans 0 rc 0/0 00000100:00100000:0.0:1788684548.119125:0:22725:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 117 00000100:00100000:1.0:1788684548.127674:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:0.0:1788684548.127898:0:22726:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073236480 00000100:00100000:0.0:1788684548.127909:0:22726:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073236480 00000100:00100000:0.0:1788684548.127989:0:22726:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 118 00000100:00100000:0.0:1788684548.128001:0:22726:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67511ae050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9f969391-6479-4864-94e2-df3227346f88+6:18052:x1875571073236480:12345-192.168.206.44@tcp:501:mount.lustre.0 00000100:00100000:0.0:1788684548.133535:0:22726:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67511ae050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9f969391-6479-4864-94e2-df3227346f88+6:18052:x1875571073236480:12345-192.168.206.44@tcp:501:mount.lustre.0 Request processed in 5522us (5860us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788684548.133553:0:22726:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 118 00000100:00100000:1.0:1788684548.144036:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:3.0:1788684548.144120:0:22727:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073236608 00000100:00100000:3.0:1788684548.144132:0:22727:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073236608 00000100:00100000:3.0:1788684548.144252:0:22727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 119 00000100:00100000:3.0:1788684548.144265:0:22727:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67511af850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9f969391-6479-4864-94e2-df3227346f88+6:18052:x1875571073236608:12345-192.168.206.44@tcp:101:mount.lustre.0 00010000:00010000:3.0:1788684548.144285:0:22727:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788684548.144308:0:22727:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d6647891400/0x44bac02bd54ae1f3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: local remote: 0xb726964c63ed3ff5 expref: -99 pid: 22727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684548.144345:0:22727:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d6647891400/0x44bac02bd54ae1f3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000000 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3ff5 expref: 7 pid: 22727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684548.144358:0:22727:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d6647891400/0x44bac02bd54ae1f3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 192.168.206.44@tcp remote: 0xb726964c63ed3ff5 expref: 7 pid: 22727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684548.144418:0:22727:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d6647891400, rc 0) 00000100:00100000:3.0:1788684548.144480:0:22727:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67511af850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9f969391-6479-4864-94e2-df3227346f88+7:18052:x1875571073236608:12345-192.168.206.44@tcp:101:mount.lustre.0 Request processed in 217us (457us total) trans 0 rc 0/0 00000100:00100000:3.0:1788684548.144509:0:22727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 119 00000100:00100000:3.0:1788684548.147259:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:0.0:1788684548.147469:0:22726:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073236736 00000100:00100000:0.0:1788684548.147481:0:22726:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073236736 00000100:00100000:0.0:1788684548.147545:0:22726:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 120 00000100:00100000:0.0:1788684548.147556:0:22726:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d677fb5d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9f969391-6479-4864-94e2-df3227346f88+7:18052:x1875571073236736:12345-192.168.206.44@tcp:501:mount.lustre.0 00000100:00100000:0.0:1788684548.147942:0:22726:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d677fb5d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9f969391-6479-4864-94e2-df3227346f88+8:18052:x1875571073236736:12345-192.168.206.44@tcp:501:mount.lustre.0 Request processed in 386us (697us total) trans 0 rc 0/0 00000100:00100000:0.0:1788684548.147951:0:22726:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 120 00000100:00100000:1.0:1788684548.150480:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:3.0:1788684548.150593:0:22727:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073236864 00000100:00100000:3.0:1788684548.150604:0:22727:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073236864 00000100:00100000:3.0:1788684548.150663:0:22727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 121 00000100:00100000:3.0:1788684548.150673:0:22727:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d677fb5ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9f969391-6479-4864-94e2-df3227346f88+8:18052:x1875571073236864:12345-192.168.206.44@tcp:503:mount.lustre.0 00000100:00100000:3.0:1788684548.150866:0:22727:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d677fb5ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9f969391-6479-4864-94e2-df3227346f88+8:18052:x1875571073236864:12345-192.168.206.44@tcp:503:mount.lustre.0 Request processed in 194us (400us total) trans 0 rc 0/0 00000100:00100000:3.0:1788684548.150875:0:22727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 121 00000100:00100000:1.0:1788684548.154525:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:0.0:1788684548.154624:0:22726:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073236992 00000100:00100000:0.0:1788684548.154636:0:22726:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073236992 00000100:00100000:0.0:1788684548.154699:0:22726:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 122 00000100:00100000:0.0:1788684548.154709:0:22726:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d677fb5f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9f969391-6479-4864-94e2-df3227346f88+8:18070:x1875571073236992:12345-192.168.206.44@tcp:502:llog_process_th.0 00000100:00100000:0.0:1788684548.154898:0:22726:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d677fb5f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9f969391-6479-4864-94e2-df3227346f88+8:18070:x1875571073236992:12345-192.168.206.44@tcp:502:llog_process_th.0 Request processed in 189us (386us total) trans 0 rc 0/0 00000100:00100000:0.0:1788684548.154906:0:22726:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 122 00000100:00100000:2.0:1788684548.180515:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:0.0:1788684548.180612:0:22725:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073237120 00000100:00100000:0.0:1788684548.180624:0:22725:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073237120 00000100:00100000:0.0:1788684548.180697:0:22725:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 123 00000100:00100000:0.0:1788684548.180707:0:22725:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d677fb5c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9f969391-6479-4864-94e2-df3227346f88+8:18070:x1875571073237120:12345-192.168.206.44@tcp:502:llog_process_th.0 00000100:00100000:0.0:1788684548.180919:0:22725:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d677fb5c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9f969391-6479-4864-94e2-df3227346f88+8:18070:x1875571073237120:12345-192.168.206.44@tcp:502:llog_process_th.0 Request processed in 212us (416us total) trans 0 rc 0/0 00000100:00100000:0.0:1788684548.180932:0:22725:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 123 00000100:00100000:1.0:1788684548.187563:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:3.0:1788684548.187905:0:22727:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073237248 00000100:00100000:3.0:1788684548.187916:0:22727:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073237248 00000100:00100000:3.0:1788684548.187997:0:22727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 124 00000100:00100000:3.0:1788684548.188010:0:22727:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d677fad8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9f969391-6479-4864-94e2-df3227346f88+8:18070:x1875571073237248:12345-192.168.206.44@tcp:502:llog_process_th.0 00000100:00100000:3.0:1788684548.188219:0:22727:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d677fad8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9f969391-6479-4864-94e2-df3227346f88+8:18070:x1875571073237248:12345-192.168.206.44@tcp:502:llog_process_th.0 Request processed in 211us (670us total) trans 0 rc 0/0 00000100:00100000:3.0:1788684548.188229:0:22727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 124 00000100:00100000:2.0:1788684548.207055:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:1.0:1788684548.214578:0:22726:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073237376 00000100:00100000:1.0:1788684548.214598:0:22726:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073237376 00000100:00100000:2.0:1788684548.217993:0:22726:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 125 00000100:00100000:2.0:1788684548.218025:0:22726:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d677fad9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9f969391-6479-4864-94e2-df3227346f88+8:18052:x1875571073237376:12345-192.168.206.44@tcp:101:mount.lustre.0 00010000:00010000:2.0:1788684548.218050:0:22726:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788684548.218072:0:22726:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d66476d4600/0x44bac02bd54ae1fa lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xb726964c63ed4026 expref: -99 pid: 22726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684548.218115:0:22726:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d66476d4600/0x44bac02bd54ae1fa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.206.44@tcp remote: 0xb726964c63ed4026 expref: 9 pid: 22726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684548.218128:0:22726:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d66476d4600/0x44bac02bd54ae1fa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.206.44@tcp remote: 0xb726964c63ed4026 expref: 9 pid: 22726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684548.218138:0:22726:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d66476d4600, rc 0) 00000100:00100000:2.0:1788684548.218611:0:22726:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d677fad9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9f969391-6479-4864-94e2-df3227346f88+9:18052:x1875571073237376:12345-192.168.206.44@tcp:101:mount.lustre.0 Request processed in 599us (11566us total) trans 0 rc 0/0 00000100:00100000:2.0:1788684548.218620:0:22726:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 125 00000100:00100000:2.0:1788684548.233077:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:0.0:1788684548.235445:0:22725:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073237504 00000100:00100000:0.0:1788684548.235467:0:22725:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073237504 00000100:00100000:0.0:1788684548.235573:0:22725:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 126 00000100:00100000:0.0:1788684548.235584:0:22725:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d677fad8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9f969391-6479-4864-94e2-df3227346f88+9:18052:x1875571073237504:12345-192.168.206.44@tcp:256:mount.lustre.0 20000000:01000000:0.0:1788684548.235616:0:22725:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:0.0:1788684548.235645:0:22725:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:0.0:1788684548.235649:0:22725:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:0.0:1788684548.235653:0:22725:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:0.0:1788684548.235656:0:22725:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/256/255. 20000000:01000000:0.0:1788684548.235659:0:22725:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 14 00000100:00100000:0.0:1788684548.242062:0:22725:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d677fad8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9f969391-6479-4864-94e2-df3227346f88+9:18052:x1875571073237504:12345-192.168.206.44@tcp:256:mount.lustre.0 Request processed in 6465us (9107us total) trans 0 rc 0/0 00000100:00100000:0.0:1788684548.242079:0:22725:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 126 00000100:00100000:2.0:1788684548.249799:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:0.0:1788684548.249986:0:22726:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073237632 00000100:00100000:0.0:1788684548.249998:0:22726:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073237632 00000100:00100000:0.0:1788684548.250068:0:22726:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 127 00000100:00100000:0.0:1788684548.250079:0:22726:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d664108c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9f969391-6479-4864-94e2-df3227346f88+9:18052:x1875571073237632:12345-192.168.206.44@tcp:101:mount.lustre.0 00010000:00010000:0.0:1788684548.250102:0:22726:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788684548.250124:0:22726:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d6765f60400/0x44bac02bd54ae201 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xb726964c63ed402d expref: -99 pid: 22726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684548.250159:0:22726:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d6765f60400/0x44bac02bd54ae201 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.206.44@tcp remote: 0xb726964c63ed402d expref: 10 pid: 22726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684548.250171:0:22726:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d6765f60400/0x44bac02bd54ae201 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.206.44@tcp remote: 0xb726964c63ed402d expref: 10 pid: 22726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684548.250181:0:22726:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d6765f60400, rc 0) 00000100:00100000:0.0:1788684548.250281:0:22726:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d664108c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9f969391-6479-4864-94e2-df3227346f88+10:18052:x1875571073237632:12345-192.168.206.44@tcp:101:mount.lustre.0 Request processed in 200us (494us total) trans 0 rc 0/0 00000100:00100000:0.0:1788684548.250289:0:22726:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 127 00000100:00100000:2.0:1788684548.252663:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:0.0:1788684548.252823:0:22725:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073237760 00000100:00100000:0.0:1788684548.252834:0:22725:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073237760 00000100:00100000:0.0:1788684548.252913:0:22725:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 128 00000100:00100000:0.0:1788684548.252924:0:22725:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6746d87450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9f969391-6479-4864-94e2-df3227346f88+10:18052:x1875571073237760:12345-192.168.206.44@tcp:501:mount.lustre.0 00000100:00100000:0.0:1788684548.253135:0:22725:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6746d87450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9f969391-6479-4864-94e2-df3227346f88+10:18052:x1875571073237760:12345-192.168.206.44@tcp:501:mount.lustre.0 Request processed in 212us (491us total) trans 0 rc 0/0 00000100:00100000:0.0:1788684548.253144:0:22725:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 128 00000100:00100000:1.0:1788684548.255467:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:3.0:1788684548.255618:0:22727:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073237888 00000100:00100000:3.0:1788684548.255629:0:22727:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073237888 00000100:00100000:3.0:1788684548.255677:0:22727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 129 00000100:00100000:3.0:1788684548.255688:0:22727:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6746d86850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9f969391-6479-4864-94e2-df3227346f88+10:18052:x1875571073237888:12345-192.168.206.44@tcp:503:mount.lustre.0 00000100:00100000:3.0:1788684548.255882:0:22727:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6746d86850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9f969391-6479-4864-94e2-df3227346f88+10:18052:x1875571073237888:12345-192.168.206.44@tcp:503:mount.lustre.0 Request processed in 194us (428us total) trans 0 rc 0/0 00000100:00100000:3.0:1788684548.255890:0:22727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 129 00000100:00100000:1.0:1788684548.258894:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:2.0:1788684548.259046:0:22726:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073238016 00000100:00100000:2.0:1788684548.259056:0:22726:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073238016 00000100:00100000:2.0:1788684548.259112:0:22726:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 130 00000100:00100000:2.0:1788684548.259121:0:22726:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6746d84850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9f969391-6479-4864-94e2-df3227346f88+10:18075:x1875571073238016:12345-192.168.206.44@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788684548.259304:0:22726:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6746d84850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9f969391-6479-4864-94e2-df3227346f88+10:18075:x1875571073238016:12345-192.168.206.44@tcp:502:llog_process_th.0 Request processed in 183us (420us total) trans 0 rc 0/0 00000100:00100000:2.0:1788684548.259321:0:22726:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 130 00000100:00100000:3.0:1788684548.264773:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:0.0:1788684548.265254:0:22725:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073238144 00000100:00100000:0.0:1788684548.265268:0:22725:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073238144 00000100:00100000:0.0:1788684548.265345:0:22725:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 131 00000100:00100000:0.0:1788684548.265357:0:22725:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6746d84450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9f969391-6479-4864-94e2-df3227346f88+10:18075:x1875571073238144:12345-192.168.206.44@tcp:502:llog_process_th.0 00000100:00100000:0.0:1788684548.265711:0:22725:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6746d84450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9f969391-6479-4864-94e2-df3227346f88+10:18075:x1875571073238144:12345-192.168.206.44@tcp:502:llog_process_th.0 Request processed in 354us (951us total) trans 0 rc 0/0 00000100:00100000:0.0:1788684548.265720:0:22725:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 131 00000100:00100000:0.0:1788684548.270157:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:0.0:1788684548.270277:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:2.0:1788684548.270443:0:22733:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073238272 00000100:00100000:2.0:1788684548.270455:0:22733:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073238272 00000100:00100000:2.0:1788684548.270517:0:22733:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073238528 00000100:00100000:2.0:1788684548.270521:0:22733:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073238528 00000100:00100000:2.0:1788684548.270549:0:22733:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 7 00000100:00100000:2.0:1788684548.270559:0:22733:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d674698c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2389:x1875571073238272:12345-192.168.206.44@tcp:38:mount.lustre.0 00010000:00080000:2.0:1788684548.270595:0:22733:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from 4099400f-835c-46aa-bd1f-63cdd511e591@192.168.206.44@tcp t0 exp 0000000000000000 cur 629 last 0 00000020:00000080:2.0:1788684548.270656:0:22733:0:(genops.c:1385:class_connect()) connect: client 4099400f-835c-46aa-bd1f-63cdd511e591, cookie 0x44bac02bd54ae208 00000004:00100000:2.0:1788684548.270688:0:22733:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00100000:3.0:1788684548.270704:0:22734:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 8 00000100:00100000:3.0:1788684548.270711:0:22734:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d674698f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2389:x1875571073238528:12345-192.168.206.44@tcp:38:mount.lustre.0 00010000:00080000:3.0:1788684548.270728:0:22734:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0001: connection from 4099400f-835c-46aa-bd1f-63cdd511e591@192.168.206.44@tcp t0 exp 0000000000000000 cur 629 last 0 00000020:00000080:3.0:1788684548.270767:0:22734:0:(genops.c:1385:class_connect()) connect: client 4099400f-835c-46aa-bd1f-63cdd511e591, cookie 0x44bac02bd54ae20f 00000004:00100000:3.0:1788684548.270782:0:22734:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0001: cli supports cksum type f7, return f7 00000100:00080000:2.0:1788684548.271077:0:22733:0:(import.c:65:import_set_state_nolock()) ffff8d67667bd800 : changing import state from RECOVER to FULL 00000100:00080000:3.0:1788684548.271267:0:22734:0:(import.c:65:import_set_state_nolock()) ffff8d66474d6000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788684548.271742:0:22733:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d674698c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4099400f-835c-46aa-bd1f-63cdd511e591+6:2389:x1875571073238272:12345-192.168.206.44@tcp:38:mount.lustre.0 Request processed in 1180us (1596us total) trans 0 rc 0/0 00000100:00100000:2.0:1788684548.271752:0:22733:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 7 00000100:00100000:3.0:1788684548.276392:0:22734:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d674698f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4099400f-835c-46aa-bd1f-63cdd511e591+6:2389:x1875571073238528:12345-192.168.206.44@tcp:38:mount.lustre.0 Request processed in 5643us (6078us total) trans 0 rc 0/0 00000100:00100000:3.0:1788684548.276411:0:22734:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 8 00000100:00100000:1.0:1788684548.281199:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:0.0:1788684548.281286:0:23765:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073238400 00000100:00100000:0.0:1788684548.281297:0:23765:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073238400 00000100:00080000:2.0:1788684548.281475:0:22728:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788684548.281570:0:23765:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 9 00000100:00100000:0.0:1788684548.281584:0:23765:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6747a6c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4099400f-835c-46aa-bd1f-63cdd511e591+6:0:x1875571073238400:12345-192.168.206.44@tcp:41:mount.lustre.0 00000004:00000024:0.0:1788684548.281630:0:23765:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446309888 avail 1300070400 00000100:00100000:0.0:1788684548.281742:0:23765:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6747a6c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4099400f-835c-46aa-bd1f-63cdd511e591+6:0:x1875571073238400:12345-192.168.206.44@tcp:41:mount.lustre.0 Request processed in 162us (557us total) trans 0 rc 0/0 00000100:00100000:0.0:1788684548.281772:0:23765:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 9 00000100:00100000:0.0:1788684548.283073:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:2.0:1788684548.283314:0:22733:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073238784 00000100:00100000:2.0:1788684548.283323:0:22733:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073238784 00000100:00100000:2.0:1788684548.283414:0:22733:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 10 00000100:00100000:2.0:1788684548.283426:0:22733:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d674698ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4099400f-835c-46aa-bd1f-63cdd511e591+6:18052:x1875571073238784:12345-192.168.206.44@tcp:41:mount.lustre.0 00000004:00000024:2.0:1788684548.283454:0:22733:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446309888 avail 1300070400 00000100:00100000:2.0:1788684548.283523:0:22733:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d674698ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4099400f-835c-46aa-bd1f-63cdd511e591+6:18052:x1875571073238784:12345-192.168.206.44@tcp:41:mount.lustre.0 Request processed in 100us (458us total) trans 0 rc 0/0 00000100:00100000:2.0:1788684548.283530:0:22733:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 10 00000100:00100000:1.0:1788684548.286224:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:1.0:1788684548.286325:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:0.0:1788684548.288776:0:22732:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073238656 00000100:00100000:0.0:1788684548.288792:0:22732:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073238656 00000100:00100000:2.0:1788684548.290025:0:23765:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073238912 00000100:00100000:2.0:1788684548.290038:0:23765:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073238912 00000100:00100000:2.0:1788684548.290602:0:23765:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 11 00000100:00100000:2.0:1788684548.290634:0:23765:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6747a6e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4099400f-835c-46aa-bd1f-63cdd511e591+6:18052:x1875571073238912:12345-192.168.206.44@tcp:40:mount.lustre.0 00000100:00100000:2.0:1788684548.290760:0:23765:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6747a6e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4099400f-835c-46aa-bd1f-63cdd511e591+6:18052:x1875571073238912:12345-192.168.206.44@tcp:40:mount.lustre.0 Request processed in 127us (4433us total) trans 0 rc 0/0 00000100:00100000:2.0:1788684548.290768:0:23765:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 11 00000100:00080000:1.0:1788684548.291145:0:22728:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788684548.291255:0:22733:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 12 00000100:00100000:0.0:1788684548.291268:0:22733:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6747a6f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4099400f-835c-46aa-bd1f-63cdd511e591+6:0:x1875571073238656:12345-192.168.206.44@tcp:41:mount.lustre.0 00000004:00000024:0.0:1788684548.291306:0:22733:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446461440 avail 1300221952 00000100:00100000:0.0:1788684548.291436:0:22733:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6747a6f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4099400f-835c-46aa-bd1f-63cdd511e591+6:0:x1875571073238656:12345-192.168.206.44@tcp:41:mount.lustre.0 Request processed in 171us (5224us total) trans 0 rc 0/0 00000100:00100000:0.0:1788684548.291444:0:22733:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 12 00000100:00100000:0.0:1788684548.302748:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:0.0:1788684548.302819:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:2.0:1788684548.302896:0:22743:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073239296 00000100:00100000:2.0:1788684548.302914:0:22743:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073239296 00000100:00100000:0.0:1788684548.302968:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:1.0:1788684548.303215:0:24238:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073239040 00000100:00100000:1.0:1788684548.303225:0:24238:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073239040 00000100:00100000:1.0:1788684548.303263:0:24238:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073239168 00000100:00100000:1.0:1788684548.303266:0:24238:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073239168 00000100:00100000:1.0:1788684548.303287:0:24238:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 17 00000100:00100000:1.0:1788684548.303295:0:24238:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d674698dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2389:x1875571073239040:12345-192.168.206.44@tcp:8:mount.lustre.0 00010000:00080000:1.0:1788684548.303330:0:24238:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from 4099400f-835c-46aa-bd1f-63cdd511e591@192.168.206.44@tcp t0 exp 0000000000000000 cur 629 last 0 00000020:00000080:1.0:1788684548.303361:0:24238:0:(genops.c:1385:class_connect()) connect: client 4099400f-835c-46aa-bd1f-63cdd511e591, cookie 0x44bac02bd54ae216 00002000:00100000:1.0:1788684548.303396:0:24238:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 4099400f-835c-46aa-bd1f-63cdd511e591/ffff8d6646c9f000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a02 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1788684548.303414:0:24238:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00000100:00100000:2.0:1788684548.303470:0:22743:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 3 00000100:00100000:2.0:1788684548.303486:0:22743:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d674698df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:4099400f-835c-46aa-bd1f-63cdd511e591+6:18052:x1875571073239296:12345-192.168.206.44@tcp:900:mount.lustre.0 00000100:00100000:2.0:1788684548.303566:0:22743:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d674698df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:4099400f-835c-46aa-bd1f-63cdd511e591+6:18052:x1875571073239296:12345-192.168.206.44@tcp:900:mount.lustre.0 Request processed in 86us (828us total) trans 0 rc 0/0 00000100:00100000:2.0:1788684548.303574:0:22743:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 3 00002000:00080000:1.0:1788684548.303790:0:24238:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:1.0:1788684548.304045:0:24238:0:(import.c:65:import_set_state_nolock()) ffff8d6646c9a000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788684548.304099:0:24238:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d674698dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4099400f-835c-46aa-bd1f-63cdd511e591+6:2389:x1875571073239040:12345-192.168.206.44@tcp:8:mount.lustre.0 Request processed in 802us (1278us total) trans 0 rc 0/0 00000100:00100000:1.0:1788684548.304107:0:24238:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 17 00000100:00100000:1.0:1788684548.304123:0:24238:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 18 00000100:00100000:1.0:1788684548.304127:0:24238:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67450b2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2389:x1875571073239168:12345-192.168.206.44@tcp:8:mount.lustre.0 00010000:00080000:1.0:1788684548.304166:0:24238:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from 4099400f-835c-46aa-bd1f-63cdd511e591@192.168.206.44@tcp t0 exp 0000000000000000 cur 629 last 0 00000020:00000080:1.0:1788684548.304189:0:24238:0:(genops.c:1385:class_connect()) connect: client 4099400f-835c-46aa-bd1f-63cdd511e591, cookie 0x44bac02bd54ae21d 00002000:00100000:1.0:1788684548.304195:0:24238:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 4099400f-835c-46aa-bd1f-63cdd511e591/ffff8d6646c98000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a02 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1788684548.304208:0:24238:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:1.0:1788684548.304327:0:24238:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:1.0:1788684548.304344:0:24238:0:(import.c:65:import_set_state_nolock()) ffff8d6646c9e800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788684548.306138:0:24238:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67450b2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4099400f-835c-46aa-bd1f-63cdd511e591+6:2389:x1875571073239168:12345-192.168.206.44@tcp:8:mount.lustre.0 Request processed in 1999us (3162us total) trans 0 rc 0/0 00000100:00100000:1.0:1788684548.306151:0:24238:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 18 00000100:00100000:0.0:1788684548.318823:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:1.0:1788684548.319801:0:22735:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073239424 00000100:00100000:1.0:1788684548.319813:0:22735:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073239424 00000100:00100000:1.0:1788684548.320019:0:22735:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 0 00000100:00100000:1.0:1788684548.320031:0:22735:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d677fa82a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4099400f-835c-46aa-bd1f-63cdd511e591+6:18052:x1875571073239424:12345-192.168.206.44@tcp:33:mount.lustre.0 00000004:00080000:1.0:1788684548.321049:0:22735:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 933us 00000004:00200000:1.0:1788684548.340815:0:22735:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000100:00100000:1.0:1788684548.340957:0:22735:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d677fa82a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4099400f-835c-46aa-bd1f-63cdd511e591+6:18052:x1875571073239424:12345-192.168.206.44@tcp:33:mount.lustre.0 Request processed in 20923us (22138us total) trans 0 rc 0/0 00000100:00100000:1.0:1788684548.340969:0:22735:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 0 00000040:00080000:2.0:1788684548.414208:0:22768:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:2.0:1788684548.588448:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:0.0:1788684548.588627:0:22733:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073239552 00000100:00100000:0.0:1788684548.588639:0:22733:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073239552 00000100:00100000:0.0:1788684548.588747:0:22733:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 13 00000100:00100000:0.0:1788684548.588758:0:22733:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6647a63800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4099400f-835c-46aa-bd1f-63cdd511e591+6:18099:x1875571073239552:12345-192.168.206.44@tcp:101:mkdir.0 00010000:00010000:0.0:1788684548.588780:0:22733:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788684548.588818:0:22733:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d6765f61200/0x44bac02bd54ae224 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb726964c63ed405e expref: -99 pid: 22733 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684548.588892:0:22733:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d6765f61c00/0x44bac02bd54ae22b lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 22733 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684548.588908:0:22733:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d6765f61c00/0x44bac02bd54ae22b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22733 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684548.588936:0:22733:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d6765f61c00/0x44bac02bd54ae22b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22733 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788684548.588997:0:22733:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1788684548.589002:0:22733:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788684548.589148:0:22733:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d6765f61c00/0x44bac02bd54ae22b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22733 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684548.589175:0:22733:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d6765f61200/0x44bac02bd54ae224 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.44@tcp remote: 0xb726964c63ed405e expref: 8 pid: 22733 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684548.589194:0:22733:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d6765f61c00/0x44bac02bd54ae22b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.44@tcp remote: 0xb726964c63ed405e expref: 7 pid: 22733 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684548.589204:0:22733:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d6743f73d00) 00010000:00010000:0.0:1788684548.589206:0:22733:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788684548.589210:0:22733:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d6765f61c00, rc 0) 00000100:00100000:0.0:1788684548.589278:0:22733:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6647a63800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4099400f-835c-46aa-bd1f-63cdd511e591+7:18099:x1875571073239552:12345-192.168.206.44@tcp:101:mkdir.0 Request processed in 522us (840us total) trans 0 rc 0/0 00000100:00100000:0.0:1788684548.589286:0:22733:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 13 00000100:00100000:0.0:1788684548.733637:0:3626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6747a6f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3626:1875571085930112:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788684548.733730:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788684548.734023:0:24243:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085930112 00000100:00100000:2.0:1788684548.734032:0:24243:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085930112 00000100:00100000:2.0:1788684548.734149:0:24243:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1788684548.734162:0:24243:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d677fa83800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3626:x1875571085930112:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1788684548.734189:0:24243:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923513344 avail 3691991040 00000100:00080000:1.0:1788684548.734238:0:22728:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788684548.734251:0:24243:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d677fa83800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3626:x1875571085930112:12345-0@lo:13:osp-pre-0-1.0 Request processed in 93us (521us total) trans 0 rc 0/0 00000100:00100000:2.0:1788684548.734259:0:24243:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788684548.734322:0:3626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6747a6f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3626:1875571085930112:0@lo:13:osp-pre-0-1.0 00010000:00010000:3.0:1788684548.797652:0:25183:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788684549.825181:0:25184:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788684550.269523:0:3624:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788684550.269562:0:3624:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6647a62680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3624:1875571085930240:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788684550.269633:0:3624:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788684550.269729:0:24164:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085930240 00000100:00100000:2.0:1788684550.269738:0:24164:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085930240 00000100:00100000:2.0:1788684550.269792:0:24164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1788684550.269802:0:24164:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d677fa80380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3624:x1875571085930240:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1788684550.269834:0:24164:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446461440 avail 1300221952 00000100:00100000:2.0:1788684550.269903:0:24164:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d677fa80380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3624:x1875571085930240:12345-0@lo:41:osp-pre-1-0.0 Request processed in 103us (270us total) trans 0 rc 0/0 00000100:00100000:2.0:1788684550.269911:0:24164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1788684550.270009:0:3624:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6647a62680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3624:1875571085930240:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788684550.272862:0:3623:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788684550.272881:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d677fa81880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3623:1875571085930368:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788684550.272945:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788684550.273309:0:22737:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085930368 00000100:00100000:0.0:1788684550.273339:0:22737:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085930368 00000100:00100000:0.0:1788684550.273404:0:22737:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1788684550.273414:0:22737:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d66477ed880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3623:x1875571085930368:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1788684550.273445:0:22737:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446309888 avail 1300070400 00000100:00100000:0.0:1788684550.273498:0:22737:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d66477ed880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3623:x1875571085930368:12345-0@lo:41:osp-pre-0-1.0 Request processed in 86us (553us total) trans 0 rc 0/0 00000100:00100000:0.0:1788684550.273506:0:22737:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1788684550.273693:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d677fa81880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3623:1875571085930368:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788684550.560033:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:3.0:1788684550.560287:0:22732:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073239680 00000100:00100000:3.0:1788684550.560298:0:22732:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073239680 00000100:00100000:3.0:1788684550.560462:0:22732:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 14 00000100:00100000:3.0:1788684550.560473:0:22732:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d677fa82680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4099400f-835c-46aa-bd1f-63cdd511e591+7:18151:x1875571073239680:12345-192.168.206.44@tcp:41:lfs.0 00000004:00000024:3.0:1788684550.560505:0:22732:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446309888 avail 1300070400 00000100:00100000:3.0:1788684550.560599:0:22732:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d677fa82680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4099400f-835c-46aa-bd1f-63cdd511e591+7:18151:x1875571073239680:12345-192.168.206.44@tcp:41:lfs.0 Request processed in 127us (574us total) trans 0 rc 0/0 00000100:00100000:3.0:1788684550.560607:0:22732:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 14 00000100:00080000:1.0:1788684550.564806:0:22728:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788684550.568936:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:2.0:1788684550.569826:0:23765:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073239808 00000100:00100000:2.0:1788684550.569841:0:23765:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073239808 00000100:00080000:1.0:1788684550.569918:0:22728:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788684550.570025:0:23765:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 15 00000100:00100000:2.0:1788684550.570038:0:23765:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6747a6ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4099400f-835c-46aa-bd1f-63cdd511e591+6:18151:x1875571073239808:12345-192.168.206.44@tcp:41:lfs.0 00000004:00000024:2.0:1788684550.570075:0:23765:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446461440 avail 1300221952 00000100:00100000:2.0:1788684550.570197:0:23765:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6747a6ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4099400f-835c-46aa-bd1f-63cdd511e591+6:18151:x1875571073239808:12345-192.168.206.44@tcp:41:lfs.0 Request processed in 162us (1275us total) trans 0 rc 0/0 00000100:00100000:2.0:1788684550.570205:0:23765:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 15 00000100:00100000:0.0:1788684550.575567:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:1.0:1788684550.575821:0:24242:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073239936 00000100:00100000:1.0:1788684550.575835:0:24242:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073239936 00000100:00100000:1.0:1788684550.575954:0:24242:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 10 00000100:00100000:1.0:1788684550.575974:0:24242:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d677fa81180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:4099400f-835c-46aa-bd1f-63cdd511e591+6:18151:x1875571073239936:12345-192.168.206.44@tcp:13:lfs.0 00002000:00000024:1.0:1788684550.576132:0:24242:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923513344 avail 3691991040 00000100:00100000:1.0:1788684550.576454:0:24242:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d677fa81180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:4099400f-835c-46aa-bd1f-63cdd511e591+6:18151:x1875571073239936:12345-192.168.206.44@tcp:13:lfs.0 Request processed in 482us (901us total) trans 0 rc 0/0 00000100:00100000:1.0:1788684550.576462:0:24242:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 10 00000100:00080000:2.0:1788684550.578388:0:22728:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788684550.583584:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:0.0:1788684550.583690:0:24242:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073240064 00000100:00100000:0.0:1788684550.583703:0:24242:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073240064 00000100:00080000:2.0:1788684550.583789:0:22728:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788684550.583796:0:24242:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 11 00000100:00100000:0.0:1788684550.583808:0:24242:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d66477efb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:4099400f-835c-46aa-bd1f-63cdd511e591+6:18151:x1875571073240064:12345-192.168.206.44@tcp:13:lfs.0 00002000:00000024:0.0:1788684550.583859:0:24242:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3915849728 avail 3684327424 00000100:00100000:0.0:1788684550.586465:0:24242:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d66477efb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:4099400f-835c-46aa-bd1f-63cdd511e591+6:18151:x1875571073240064:12345-192.168.206.44@tcp:13:lfs.0 Request processed in 2641us (2880us total) trans 0 rc 0/0 00000100:00100000:0.0:1788684550.586483:0:24242:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 11 00000100:00100000:3.0:1788684550.801718:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:0.0:1788684550.801857:0:22727:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073240192 00000100:00100000:0.0:1788684550.801871:0:22727:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073240192 00000100:00100000:0.0:1788684550.801956:0:22727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 132 00000100:00100000:0.0:1788684550.801985:0:22727:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6746d85450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9f969391-6479-4864-94e2-df3227346f88+10:18182:x1875571073240192:12345-192.168.206.44@tcp:101:mount.lustre.0 00010000:00010000:0.0:1788684550.802007:0:22727:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788684550.802031:0:22727:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d6765f61800/0x44bac02bd54ae232 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: local remote: 0xb726964c63ed4065 expref: -99 pid: 22727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684550.802070:0:22727:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d6765f61800/0x44bac02bd54ae232 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000000 nid: 192.168.206.44@tcp remote: 0xb726964c63ed4065 expref: 11 pid: 22727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684550.802110:0:22727:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d6765f61800/0x44bac02bd54ae232 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 192.168.206.44@tcp remote: 0xb726964c63ed4065 expref: 11 pid: 22727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684550.802120:0:22727:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d6765f61800, rc 0) 00000100:00100000:0.0:1788684550.802189:0:22727:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6746d85450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9f969391-6479-4864-94e2-df3227346f88+11:18182:x1875571073240192:12345-192.168.206.44@tcp:101:mount.lustre.0 Request processed in 214us (487us total) trans 0 rc 0/0 00000100:00100000:0.0:1788684550.802197:0:22727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 132 00000100:00100000:1.0:1788684550.812977:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:3.0:1788684550.813160:0:22726:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073240320 00000100:00100000:3.0:1788684550.813173:0:22726:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073240320 00000100:00100000:3.0:1788684550.813259:0:22726:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 133 00000100:00100000:3.0:1788684550.813271:0:22726:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6746d86c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9f969391-6479-4864-94e2-df3227346f88+11:18182:x1875571073240320:12345-192.168.206.44@tcp:501:mount.lustre.0 00000100:00100000:3.0:1788684550.813526:0:22726:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6746d86c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9f969391-6479-4864-94e2-df3227346f88+11:18182:x1875571073240320:12345-192.168.206.44@tcp:501:mount.lustre.0 Request processed in 257us (577us total) trans 0 rc 0/0 00000100:00100000:3.0:1788684550.813536:0:22726:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 133 00000100:00100000:2.0:1788684550.827407:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:3.0:1788684550.832759:0:22725:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073240448 00000100:00100000:3.0:1788684550.832782:0:22725:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073240448 00000100:00100000:3.0:1788684550.834203:0:22725:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 134 00000100:00100000:3.0:1788684550.835402:0:22725:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6746d85050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9f969391-6479-4864-94e2-df3227346f88+11:18182:x1875571073240448:12345-192.168.206.44@tcp:503:mount.lustre.0 00000100:00100000:3.0:1788684550.835633:0:22725:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6746d85050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9f969391-6479-4864-94e2-df3227346f88+11:18182:x1875571073240448:12345-192.168.206.44@tcp:503:mount.lustre.0 Request processed in 1414us (8241us total) trans 0 rc 0/0 00000100:00100000:3.0:1788684550.835646:0:22725:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 134 00000100:00100000:0.0:1788684550.853527:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:3.0:1788684550.855212:0:22727:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073240576 00000100:00100000:3.0:1788684550.856104:0:22727:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073240576 00000100:00100000:3.0:1788684550.856411:0:22727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 135 00000100:00100000:3.0:1788684550.856425:0:22727:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6746d86450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9f969391-6479-4864-94e2-df3227346f88+11:18190:x1875571073240576:12345-192.168.206.44@tcp:502:llog_process_th.0 00000100:00100000:3.0:1788684550.856645:0:22727:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6746d86450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9f969391-6479-4864-94e2-df3227346f88+11:18190:x1875571073240576:12345-192.168.206.44@tcp:502:llog_process_th.0 Request processed in 222us (3132us total) trans 0 rc 0/0 00000100:00100000:3.0:1788684550.856653:0:22727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 135 00010000:00010000:1.0:1788684550.860447:0:22721:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788684550.902801:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:3.0:1788684550.902921:0:22725:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073240704 00000100:00100000:3.0:1788684550.902938:0:22725:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073240704 00000100:00100000:3.0:1788684550.903017:0:22725:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 136 00000100:00100000:3.0:1788684550.903029:0:22725:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6746d87050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9f969391-6479-4864-94e2-df3227346f88+11:18190:x1875571073240704:12345-192.168.206.44@tcp:502:llog_process_th.0 00000100:00100000:3.0:1788684550.903245:0:22725:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6746d87050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9f969391-6479-4864-94e2-df3227346f88+11:18190:x1875571073240704:12345-192.168.206.44@tcp:502:llog_process_th.0 Request processed in 218us (456us total) trans 0 rc 0/0 00000100:00100000:3.0:1788684550.903252:0:22725:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 136 00000100:00100000:0.0:1788684550.909569:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:2.0:1788684550.911122:0:22726:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073240832 00000100:00100000:2.0:1788684550.911140:0:22726:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073240832 00000100:00100000:2.0:1788684550.911217:0:22726:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 137 00000100:00100000:2.0:1788684550.911240:0:22726:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6746d84050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9f969391-6479-4864-94e2-df3227346f88+11:18190:x1875571073240832:12345-192.168.206.44@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788684550.911489:0:22726:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6746d84050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9f969391-6479-4864-94e2-df3227346f88+11:18190:x1875571073240832:12345-192.168.206.44@tcp:502:llog_process_th.0 Request processed in 262us (1934us total) trans 0 rc 0/0 00000100:00100000:2.0:1788684550.911498:0:22726:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 137 00000100:00100000:1.0:1788684550.914363:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:0.0:1788684550.914494:0:22727:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073240960 00000100:00100000:0.0:1788684550.914505:0:22727:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073240960 00000100:00100000:0.0:1788684550.914571:0:22727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 138 00000100:00100000:0.0:1788684550.914580:0:22727:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6746d84c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9f969391-6479-4864-94e2-df3227346f88+11:18182:x1875571073240960:12345-192.168.206.44@tcp:101:mount.lustre.0 00010000:00010000:0.0:1788684550.914598:0:22727:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788684550.914617:0:22727:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d6765f61000/0x44bac02bd54ae239 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xb726964c63ed4096 expref: -99 pid: 22727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684550.914645:0:22727:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d6765f61000/0x44bac02bd54ae239 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.206.44@tcp remote: 0xb726964c63ed4096 expref: 12 pid: 22727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684550.914654:0:22727:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d6765f61000/0x44bac02bd54ae239 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.206.44@tcp remote: 0xb726964c63ed4096 expref: 12 pid: 22727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684550.914662:0:22727:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d6765f61000, rc 0) 00000100:00100000:0.0:1788684550.914734:0:22727:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6746d84c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9f969391-6479-4864-94e2-df3227346f88+12:18182:x1875571073240960:12345-192.168.206.44@tcp:101:mount.lustre.0 Request processed in 154us (384us total) trans 0 rc 0/0 00000100:00100000:0.0:1788684550.914757:0:22727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 138 00000100:00100000:1.0:1788684550.918484:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:3.0:1788684550.918940:0:22725:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073241088 00000100:00100000:3.0:1788684550.918953:0:22725:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073241088 00000100:00100000:3.0:1788684550.919091:0:22725:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 139 00000100:00100000:3.0:1788684550.919103:0:22725:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6746d87850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9f969391-6479-4864-94e2-df3227346f88+12:18182:x1875571073241088:12345-192.168.206.44@tcp:256:mount.lustre.0 20000000:01000000:3.0:1788684550.919405:0:22725:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:3.0:1788684550.919443:0:22725:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:3.0:1788684550.919448:0:22725:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:3.0:1788684550.919451:0:22725:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:3.0:1788684550.919454:0:22725:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/256/255. 20000000:01000000:3.0:1788684550.919457:0:22725:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 14 00000100:00100000:2.0:1788684550.928020:0:22725:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6746d87850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9f969391-6479-4864-94e2-df3227346f88+12:18182:x1875571073241088:12345-192.168.206.44@tcp:256:mount.lustre.0 Request processed in 8901us (9533us total) trans 0 rc 0/0 00000100:00100000:2.0:1788684550.928040:0:22725:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 139 00000100:00100000:1.0:1788684550.938259:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:2.0:1788684550.938423:0:22726:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073241216 00000100:00100000:2.0:1788684550.938435:0:22726:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073241216 00000100:00100000:2.0:1788684550.938506:0:22726:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 140 00000100:00100000:2.0:1788684550.938539:0:22726:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d677ccdd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9f969391-6479-4864-94e2-df3227346f88+12:18182:x1875571073241216:12345-192.168.206.44@tcp:101:mount.lustre.0 00010000:00010000:2.0:1788684550.938558:0:22726:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788684550.938580:0:22726:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d66476d4800/0x44bac02bd54ae240 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xb726964c63ed409d expref: -99 pid: 22726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684550.938614:0:22726:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d66476d4800/0x44bac02bd54ae240 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 192.168.206.44@tcp remote: 0xb726964c63ed409d expref: 13 pid: 22726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684550.938626:0:22726:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d66476d4800/0x44bac02bd54ae240 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.206.44@tcp remote: 0xb726964c63ed409d expref: 13 pid: 22726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684550.938636:0:22726:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d66476d4800, rc 0) 00000100:00100000:2.0:1788684550.938712:0:22726:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d677ccdd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9f969391-6479-4864-94e2-df3227346f88+13:18182:x1875571073241216:12345-192.168.206.44@tcp:101:mount.lustre.0 Request processed in 176us (466us total) trans 0 rc 0/0 00000100:00100000:2.0:1788684550.938720:0:22726:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 140 00000100:00100000:0.0:1788684550.941509:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:2.0:1788684550.941698:0:22725:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073241344 00000100:00100000:2.0:1788684550.941709:0:22725:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073241344 00000100:00100000:2.0:1788684550.941786:0:22725:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 141 00000100:00100000:2.0:1788684550.941798:0:22725:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d677ccde450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9f969391-6479-4864-94e2-df3227346f88+13:18182:x1875571073241344:12345-192.168.206.44@tcp:501:mount.lustre.0 00000100:00100000:2.0:1788684550.942135:0:22725:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d677ccde450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9f969391-6479-4864-94e2-df3227346f88+13:18182:x1875571073241344:12345-192.168.206.44@tcp:501:mount.lustre.0 Request processed in 339us (639us total) trans 0 rc 0/0 00000100:00100000:2.0:1788684550.942144:0:22725:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 141 00000100:00100000:0.0:1788684550.947840:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:1.0:1788684550.948292:0:22727:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073241472 00000100:00100000:1.0:1788684550.948306:0:22727:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073241472 00000100:00100000:1.0:1788684550.948543:0:22727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 142 00000100:00100000:1.0:1788684550.948555:0:22727:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6746d86050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9f969391-6479-4864-94e2-df3227346f88+13:18182:x1875571073241472:12345-192.168.206.44@tcp:503:mount.lustre.0 00000100:00100000:1.0:1788684550.948756:0:22727:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6746d86050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9f969391-6479-4864-94e2-df3227346f88+13:18182:x1875571073241472:12345-192.168.206.44@tcp:503:mount.lustre.0 Request processed in 203us (1081us total) trans 0 rc 0/0 00000100:00100000:1.0:1788684550.948764:0:22727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 142 00000100:00100000:1.0:1788684550.953899:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:2.0:1788684550.954273:0:22725:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073241600 00000100:00100000:2.0:1788684550.954285:0:22725:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073241600 00000100:00100000:2.0:1788684550.954353:0:22725:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 143 00000100:00100000:2.0:1788684550.954660:0:22725:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d677ccddc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9f969391-6479-4864-94e2-df3227346f88+13:18194:x1875571073241600:12345-192.168.206.44@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788684550.956005:0:22725:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d677ccddc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9f969391-6479-4864-94e2-df3227346f88+13:18194:x1875571073241600:12345-192.168.206.44@tcp:502:llog_process_th.0 Request processed in 1635us (2113us total) trans 0 rc 0/0 00000100:00100000:2.0:1788684550.956020:0:22725:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 143 00000100:00100000:0.0:1788684550.970753:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:1.0:1788684550.972456:0:22727:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073241728 00000100:00100000:1.0:1788684550.972478:0:22727:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073241728 00000100:00100000:1.0:1788684550.972568:0:22727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 144 00000100:00100000:1.0:1788684550.972581:0:22727:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d677ccdf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9f969391-6479-4864-94e2-df3227346f88+13:18194:x1875571073241728:12345-192.168.206.44@tcp:502:llog_process_th.0 00000100:00100000:1.0:1788684550.972790:0:22727:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d677ccdf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9f969391-6479-4864-94e2-df3227346f88+13:18194:x1875571073241728:12345-192.168.206.44@tcp:502:llog_process_th.0 Request processed in 211us (2050us total) trans 0 rc 0/0 00000100:00100000:1.0:1788684550.972799:0:22727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 144 00000100:00100000:0.0:1788684550.979512:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:0.0:1788684550.979630:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:2.0:1788684550.979891:0:22734:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073241856 00000100:00100000:2.0:1788684550.979903:0:22734:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073241856 00000100:00100000:0.0:1788684550.980080:0:22733:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073242112 00000100:00100000:0.0:1788684550.980085:0:22733:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073242112 00000100:00100000:0.0:1788684550.980184:0:22733:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 16 00000100:00100000:0.0:1788684550.980194:0:22733:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d677fa81c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2389:x1875571073241856:12345-192.168.206.44@tcp:38:mount.lustre.0 00010000:00080000:0.0:1788684550.980232:0:22733:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from 0e62701e-7d60-4e2d-bd52-05ee75d6c929@192.168.206.44@tcp t0 exp 0000000000000000 cur 631 last 0 00000020:00000080:0.0:1788684550.980281:0:22733:0:(genops.c:1385:class_connect()) connect: client 0e62701e-7d60-4e2d-bd52-05ee75d6c929, cookie 0x44bac02bd54ae247 00000004:00100000:0.0:1788684550.980316:0:22733:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:0.0:1788684550.980466:0:22733:0:(import.c:65:import_set_state_nolock()) ffff8d6647936800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788684550.980550:0:22733:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d677fa81c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0e62701e-7d60-4e2d-bd52-05ee75d6c929+6:2389:x1875571073241856:12345-192.168.206.44@tcp:38:mount.lustre.0 Request processed in 356us (1052us total) trans 0 rc 0/0 00000100:00100000:0.0:1788684550.980558:0:22733:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 16 00000100:00100000:0.0:1788684550.980577:0:22733:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 17 00000100:00100000:0.0:1788684550.980582:0:22733:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d677fa80000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2389:x1875571073242112:12345-192.168.206.44@tcp:38:mount.lustre.0 00010000:00080000:0.0:1788684550.980598:0:22733:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0001: connection from 0e62701e-7d60-4e2d-bd52-05ee75d6c929@192.168.206.44@tcp t0 exp 0000000000000000 cur 631 last 0 00000020:00000080:0.0:1788684550.980622:0:22733:0:(genops.c:1385:class_connect()) connect: client 0e62701e-7d60-4e2d-bd52-05ee75d6c929, cookie 0x44bac02bd54ae24e 00000004:00100000:0.0:1788684550.980635:0:22733:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0001: cli supports cksum type f7, return f7 00000100:00080000:0.0:1788684550.981827:0:22733:0:(import.c:65:import_set_state_nolock()) ffff8d6647936000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788684550.981995:0:22733:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d677fa80000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0e62701e-7d60-4e2d-bd52-05ee75d6c929+6:2389:x1875571073242112:12345-192.168.206.44@tcp:38:mount.lustre.0 Request processed in 1408us (2361us total) trans 0 rc 0/0 00000100:00100000:0.0:1788684550.982022:0:22733:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 17 00000100:00100000:1.0:1788684550.990545:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:3.0:1788684550.995561:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:1.0:1788684550.996193:0:23765:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073241984 00000100:00100000:1.0:1788684550.996206:0:23765:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073241984 00000100:00100000:1.0:1788684550.996339:0:23765:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073242368 00000100:00100000:1.0:1788684550.996343:0:23765:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073242368 00000100:00100000:1.0:1788684550.996415:0:23765:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 18 00000100:00100000:1.0:1788684550.996433:0:23765:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6747a6ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0e62701e-7d60-4e2d-bd52-05ee75d6c929+7:0:x1875571073241984:12345-192.168.206.44@tcp:41:mount.lustre.0 00000004:00000024:1.0:1788684550.996494:0:23765:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446309888 avail 1300070400 00000100:00100000:1.0:1788684550.996576:0:23765:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6747a6ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0e62701e-7d60-4e2d-bd52-05ee75d6c929+7:0:x1875571073241984:12345-192.168.206.44@tcp:41:mount.lustre.0 Request processed in 152us (6046us total) trans 0 rc 0/0 00000100:00100000:1.0:1788684550.996585:0:23765:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 18 00000100:00100000:1.0:1788684550.996607:0:23765:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 19 00000100:00100000:1.0:1788684550.996615:0:23765:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d66477ef100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0e62701e-7d60-4e2d-bd52-05ee75d6c929+6:18182:x1875571073242368:12345-192.168.206.44@tcp:41:mount.lustre.0 00000004:00000024:1.0:1788684550.996626:0:23765:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446309888 avail 1300070400 00000100:00100000:1.0:1788684550.996648:0:23765:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d66477ef100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0e62701e-7d60-4e2d-bd52-05ee75d6c929+6:18182:x1875571073242368:12345-192.168.206.44@tcp:41:mount.lustre.0 Request processed in 34us (1102us total) trans 0 rc 0/0 00000100:00100000:1.0:1788684550.996654:0:23765:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 19 00000100:00080000:3.0:1788684550.997627:0:22728:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788684551.000873:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:2.0:1788684551.001195:0:23765:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073242240 00000100:00100000:2.0:1788684551.001208:0:23765:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073242240 00000100:00100000:2.0:1788684551.001302:0:23765:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 20 00000100:00100000:2.0:1788684551.001315:0:23765:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6747a6fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0e62701e-7d60-4e2d-bd52-05ee75d6c929+6:0:x1875571073242240:12345-192.168.206.44@tcp:41:mount.lustre.0 00000004:00000024:2.0:1788684551.001357:0:23765:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:2.0:1788684551.001462:0:23765:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6747a6fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0e62701e-7d60-4e2d-bd52-05ee75d6c929+6:0:x1875571073242240:12345-192.168.206.44@tcp:41:mount.lustre.0 Request processed in 150us (603us total) trans 0 rc 0/0 00000100:00100000:2.0:1788684551.001470:0:23765:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 20 00000100:00080000:3.0:1788684551.002877:0:22728:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788684551.008330:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:1.0:1788684551.008555:0:22733:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073242496 00000100:00100000:1.0:1788684551.008568:0:22733:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073242496 00000100:00100000:1.0:1788684551.008657:0:22733:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 21 00000100:00100000:1.0:1788684551.008669:0:22733:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d66477ed500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0e62701e-7d60-4e2d-bd52-05ee75d6c929+6:18182:x1875571073242496:12345-192.168.206.44@tcp:40:mount.lustre.0 00000100:00100000:1.0:1788684551.008794:0:22733:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d66477ed500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0e62701e-7d60-4e2d-bd52-05ee75d6c929+6:18182:x1875571073242496:12345-192.168.206.44@tcp:40:mount.lustre.0 Request processed in 126us (478us total) trans 0 rc 0/0 00000100:00100000:1.0:1788684551.008801:0:22733:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 21 00000100:00100000:0.0:1788684551.028985:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:0.0:1788684551.029041:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:1.0:1788684551.029154:0:24241:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073242624 00000100:00100000:1.0:1788684551.029166:0:24241:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073242624 00000100:00100000:1.0:1788684551.029224:0:24241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 19 00000100:00100000:1.0:1788684551.029243:0:24241:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d677fa83100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2389:x1875571073242624:12345-192.168.206.44@tcp:8:mount.lustre.0 00010000:00080000:1.0:1788684551.029285:0:24241:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from 0e62701e-7d60-4e2d-bd52-05ee75d6c929@192.168.206.44@tcp t0 exp 0000000000000000 cur 632 last 0 00000020:00000080:1.0:1788684551.029327:0:24241:0:(genops.c:1385:class_connect()) connect: client 0e62701e-7d60-4e2d-bd52-05ee75d6c929, cookie 0x44bac02bd54ae255 00002000:00100000:1.0:1788684551.029362:0:24241:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 0e62701e-7d60-4e2d-bd52-05ee75d6c929/ffff8d6646c9b000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a02 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1788684551.029409:0:24241:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:1.0:1788684551.029490:0:24241:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:1.0:1788684551.029531:0:24241:0:(import.c:65:import_set_state_nolock()) ffff8d6646c9c800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788684551.029614:0:24241:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d677fa83100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0e62701e-7d60-4e2d-bd52-05ee75d6c929+6:2389:x1875571073242624:12345-192.168.206.44@tcp:8:mount.lustre.0 Request processed in 370us (570us total) trans 0 rc 0/0 00000100:00100000:1.0:1788684551.029623:0:24241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 19 00000100:00100000:2.0:1788684551.030016:0:22743:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073242880 00000100:00100000:2.0:1788684551.030022:0:22743:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073242880 00000100:00100000:2.0:1788684551.030073:0:22743:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 4 00000100:00100000:2.0:1788684551.030082:0:22743:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d677fa82d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:0e62701e-7d60-4e2d-bd52-05ee75d6c929+6:18182:x1875571073242880:12345-192.168.206.44@tcp:900:mount.lustre.0 00000100:00100000:2.0:1788684551.030140:0:22743:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d677fa82d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:0e62701e-7d60-4e2d-bd52-05ee75d6c929+6:18182:x1875571073242880:12345-192.168.206.44@tcp:900:mount.lustre.0 Request processed in 59us (1168us total) trans 0 rc 0/0 00000100:00100000:2.0:1788684551.030148:0:22743:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 4 00000100:00100000:0.0:1788684551.032450:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:3.0:1788684551.032615:0:24240:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073242752 00000100:00100000:3.0:1788684551.032625:0:24240:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073242752 00000100:00100000:3.0:1788684551.032685:0:24240:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 20 00000100:00100000:3.0:1788684551.032694:0:24240:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d677fa81880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2389:x1875571073242752:12345-192.168.206.44@tcp:8:mount.lustre.0 00010000:00080000:3.0:1788684551.032738:0:24240:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from 0e62701e-7d60-4e2d-bd52-05ee75d6c929@192.168.206.44@tcp t0 exp 0000000000000000 cur 632 last 0 00000020:00000080:3.0:1788684551.032788:0:24240:0:(genops.c:1385:class_connect()) connect: client 0e62701e-7d60-4e2d-bd52-05ee75d6c929, cookie 0x44bac02bd54ae25c 00002000:00100000:3.0:1788684551.032804:0:24240:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 0e62701e-7d60-4e2d-bd52-05ee75d6c929/ffff8d6646496800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a02 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1788684551.032817:0:24240:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:3.0:1788684551.032904:0:24240:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:3.0:1788684551.032967:0:24240:0:(import.c:65:import_set_state_nolock()) ffff8d67488fa000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788684551.033051:0:24240:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d677fa81880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0e62701e-7d60-4e2d-bd52-05ee75d6c929+6:2389:x1875571073242752:12345-192.168.206.44@tcp:8:mount.lustre.0 Request processed in 356us (614us total) trans 0 rc 0/0 00000100:00100000:3.0:1788684551.033059:0:24240:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 20 00000100:00100000:1.0:1788684551.036700:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:0.0:1788684551.036915:0:22736:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073243008 00000100:00100000:0.0:1788684551.036928:0:22736:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073243008 00000100:00100000:0.0:1788684551.036999:0:22736:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 1 00000100:00100000:0.0:1788684551.037011:0:22736:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6747a6ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0e62701e-7d60-4e2d-bd52-05ee75d6c929+6:18182:x1875571073243008:12345-192.168.206.44@tcp:33:mount.lustre.0 00000004:00200000:0.0:1788684551.037122:0:22736:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000100:00100000:0.0:1788684551.037312:0:22736:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6747a6ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0e62701e-7d60-4e2d-bd52-05ee75d6c929+6:18182:x1875571073243008:12345-192.168.206.44@tcp:33:mount.lustre.0 Request processed in 302us (635us total) trans 0 rc 0/0 00000100:00100000:0.0:1788684551.037321:0:22736:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 1 00000040:00080000:0.0:1788684551.103613:0:23489:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:1.0:1788684551.176332:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:2.0:1788684551.176572:0:23765:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073243136 00000100:00100000:2.0:1788684551.176585:0:23765:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073243136 00000100:00100000:2.0:1788684551.176679:0:23765:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 22 00000100:00100000:2.0:1788684551.176690:0:23765:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6747a6c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0e62701e-7d60-4e2d-bd52-05ee75d6c929+6:18217:x1875571073243136:12345-192.168.206.44@tcp:101:mkdir.0 00010000:00010000:2.0:1788684551.176716:0:23765:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788684551.176762:0:23765:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d5600/0x44bac02bd54ae263 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb726964c63ed40ce expref: -99 pid: 23765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684551.176863:0:23765:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d4400/0x44bac02bd54ae26a lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 23765 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684551.176878:0:23765:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d4400/0x44bac02bd54ae26a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 23765 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684551.176893:0:23765:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d4400/0x44bac02bd54ae26a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 23765 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788684551.176952:0:23765:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1788684551.176966:0:23765:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788684551.176994:0:23765:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d4400/0x44bac02bd54ae26a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 23765 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684551.177024:0:23765:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d5600/0x44bac02bd54ae263 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.44@tcp remote: 0xb726964c63ed40ce expref: 8 pid: 23765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684551.177045:0:23765:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d4400/0x44bac02bd54ae26a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.44@tcp remote: 0xb726964c63ed40ce expref: 7 pid: 23765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684551.177054:0:23765:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d6743f73d00) 00010000:00010000:2.0:1788684551.177057:0:23765:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788684551.177061:0:23765:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d66476d4400, rc 0) 00000100:00100000:2.0:1788684551.177340:0:23765:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6747a6c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0e62701e-7d60-4e2d-bd52-05ee75d6c929+7:18217:x1875571073243136:12345-192.168.206.44@tcp:101:mkdir.0 Request processed in 650us (1020us total) trans 0 rc 0/0 00000100:00100000:2.0:1788684551.177348:0:23765:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 22 00000100:00100000:3.0:1788684551.806122:0:3625:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d677fb45880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3625:1875571085930496:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788684551.806200:0:3625:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788684551.806333:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d66477ec700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3623:1875571085930752:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788684551.806384:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788684551.808661:0:3625:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788684551.808683:0:3625:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d677fb44e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3625:1875571085930624:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788684551.808770:0:3625:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788684551.808843:0:24243:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085930496 00000100:00100000:3.0:1788684551.808852:0:24243:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085930496 00000100:00100000:3.0:1788684551.808901:0:24243:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085930752 00000100:00100000:3.0:1788684551.808904:0:24243:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085930752 00000100:00100000:3.0:1788684551.808919:0:24243:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085930624 00000100:00100000:3.0:1788684551.808922:0:24243:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085930624 00000100:00100000:3.0:1788684551.808950:0:24243:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1788684551.808970:0:24243:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d66477ed180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3625:x1875571085930496:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788684551.808996:0:24243:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3915849728 avail 3684327424 00000100:00100000:3.0:1788684551.809044:0:24243:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d66477ed180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3625:x1875571085930496:12345-0@lo:13:osp-pre-1-0.0 Request processed in 76us (2845us total) trans 0 rc 0/0 00000100:00100000:3.0:1788684551.809051:0:24243:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1788684551.809070:0:24243:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1788684551.809076:0:24243:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d677fb47100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3623:x1875571085930752:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788684551.809087:0:24243:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:3.0:1788684551.809116:0:24243:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d677fb47100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3623:x1875571085930752:12345-0@lo:13:osp-pre-0-0.0 Request processed in 41us (2749us total) trans 0 rc 0/0 00000100:00100000:3.0:1788684551.809121:0:24243:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1788684551.809150:0:24243:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1788684551.809156:0:24243:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d66477ec380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3625:x1875571085930624:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1788684551.809166:0:24243:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3915849728 avail 3684327424 00000100:00100000:3.0:1788684551.809192:0:24243:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d66477ec380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3625:x1875571085930624:12345-0@lo:13:osp-pre-1-1.0 Request processed in 36us (422us total) trans 0 rc 0/0 00000100:00100000:3.0:1788684551.809197:0:24243:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00080000:3.0:1788684551.809214:0:22728:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788684551.809218:0:22728:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788684551.809248:0:3625:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 12884901890 gen 2 00000100:00100000:3.0:1788684551.809274:0:3625:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d677fb44e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3625:1875571085930624:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788684551.809292:0:3625:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d677fb45880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3625:1875571085930496:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788684551.809862:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d66477ec700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3623:1875571085930752:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788684551.810487:0:3625:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d66477ef480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3625:1875571085931008:0@lo:400:kworker.0 00000100:00100000:3.0:1788684551.810538:0:3625:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788684551.810578:0:3625:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d66477edf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3625:1875571085931520:0@lo:400:kworker.0 00000100:00100000:3.0:1788684551.810601:0:3625:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788684551.810616:0:3625:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d677fbc1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3625:1875571085932032:0@lo:400:kworker.0 00000100:00100000:3.0:1788684551.810640:0:3625:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788684551.810660:0:3625:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1788684551.810666:0:3625:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d66477eea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3625:1875571085931136:0@lo:400:kworker.0 00000100:00100000:3.0:1788684551.810686:0:3625:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788684551.810699:0:3625:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d66477ef800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3625:1875571085931648:0@lo:400:kworker.0 00000100:00100000:3.0:1788684551.810718:0:3625:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788684551.811119:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d66477ec000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3623:1875571085931264:0@lo:400:kworker.0 00000100:00100000:3.0:1788684551.811149:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788684551.811180:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d67450b3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3623:1875571085931776:0@lo:400:kworker.0 00000100:00100000:3.0:1788684551.811203:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788684551.811217:0:3623:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:3.0:1788684551.811223:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d66477eca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:cebd1789-51a4-46ff-b167-6b1633e930a1:3623:1875571085930880:0@lo:400:kworker.0 00000100:00100000:3.0:1788684551.811267:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788684551.811293:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d66477ec700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3623:1875571085931392:0@lo:400:kworker.0 00000100:00100000:3.0:1788684551.811318:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788684551.811333:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d677fbc2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3623:1875571085931904:0@lo:400:kworker.0 00000100:00100000:3.0:1788684551.811352:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788684551.811539:0:23765:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085931520 00000100:00100000:0.0:1788684551.811546:0:23765:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085931520 00000100:00100000:0.0:1788684551.811583:0:23765:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085932032 00000100:00100000:0.0:1788684551.811586:0:23765:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085932032 00000100:00100000:0.0:1788684551.811610:0:23765:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085931136 00000100:00100000:0.0:1788684551.811613:0:23765:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085931136 00000100:00100000:0.0:1788684551.811624:0:23765:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085931648 00000100:00100000:0.0:1788684551.811626:0:23765:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085931648 00000100:00100000:0.0:1788684551.811636:0:23765:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085931776 00000100:00100000:0.0:1788684551.811639:0:23765:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085931776 00000100:00100000:0.0:1788684551.811649:0:23765:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085931904 00000100:00100000:0.0:1788684551.811658:0:23765:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085931904 00000100:00100000:0.0:1788684551.811678:0:23765:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1788684551.811686:0:23765:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d677fbc0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3625:x1875571085931520:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788684551.813146:0:23765:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d677fbc0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3625:x1875571085931520:12345-0@lo:400:kworker.0 Request processed in 1452us (2535us total) trans 0 rc 0/0 00000100:00100000:0.0:1788684551.813160:0:23765:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1788684551.813194:0:23765:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1788684551.813206:0:23765:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d677fbc2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3625:x1875571085932032:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788684551.813255:0:23765:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d677fbc2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3625:x1875571085932032:12345-0@lo:400:kworker.0 Request processed in 54us (2614us total) trans 0 rc 0/0 00000100:00100000:0.0:1788684551.813261:0:23765:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1788684551.813274:0:23765:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1788684551.813280:0:23765:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d677fbc1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3625:x1875571085931136:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788684551.813899:0:23765:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d677fbc1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3625:x1875571085931136:12345-0@lo:400:kworker.0 Request processed in 617us (3209us total) trans 0 rc 0/0 00000100:00100000:0.0:1788684551.813907:0:23765:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1788684551.813923:0:23765:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1788684551.813931:0:23765:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d677fbc3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3625:x1875571085931648:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788684551.814089:0:22732:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1788684551.814100:0:22732:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d677fbc2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3623:x1875571085931776:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788684551.814150:0:22732:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d677fbc2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3623:x1875571085931776:12345-0@lo:400:kworker.0 Request processed in 54us (2945us total) trans 0 rc 0/0 00000100:00100000:1.0:1788684551.814156:0:22732:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1788684551.814169:0:22732:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1788684551.814176:0:22732:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d677fbc3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3623:x1875571085931904:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788684551.814203:0:22732:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d677fbc3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3623:x1875571085931904:12345-0@lo:400:kworker.0 Request processed in 28us (2850us total) trans 0 rc 0/0 00000100:00100000:1.0:1788684551.814208:0:22732:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1788684551.814227:0:24238:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085931392 00000100:00100000:1.0:1788684551.814233:0:24238:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085931392 00000100:00100000:1.0:1788684551.814272:0:24238:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1788684551.814279:0:24238:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d677fbc3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3623:x1875571085931392:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788684551.814344:0:24238:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d677fbc3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3623:x1875571085931392:12345-0@lo:400:kworker.0 Request processed in 66us (3025us total) trans 0 rc 0/0 00000100:00100000:1.0:1788684551.814351:0:24238:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1788684551.814422:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d66477ec700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3623:1875571085931392:0@lo:400:kworker.0 00000100:00100000:1.0:1788684551.814436:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d677fbc2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3623:1875571085931904:0@lo:400:kworker.0 00000100:00100000:2.0:1788684551.816050:0:24164:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085931008 00000100:00100000:2.0:1788684551.816068:0:24164:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085931008 00000100:00100000:2.0:1788684551.816109:0:24164:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085931264 00000100:00100000:2.0:1788684551.816113:0:24164:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085931264 00010000:00080000:1.0:1788684551.816118:0:3623:0:(ldlm_request.c:1670:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d67450b3480 x1875571085931776/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788684567 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788684551.816130:0:24164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1788684551.816136:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d67450b3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3623:1875571085931776:0@lo:400:kworker.0 00000100:00100000:2.0:1788684551.816142:0:24164:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d677fbc1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3625:x1875571085931008:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788684551.816226:0:23765:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d677fbc3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3625:x1875571085931648:12345-0@lo:400:kworker.0 Request processed in 2295us (5504us total) trans 0 rc 0/0 00000100:00100000:0.0:1788684551.816235:0:23765:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1788684551.816249:0:24164:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d677fbc1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3625:x1875571085931008:12345-0@lo:400:kworker.0 Request processed in 101us (5702us total) trans 0 rc 0/0 00000100:00100000:2.0:1788684551.816259:0:24164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1788684551.816266:0:22737:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1788684551.816279:0:22737:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d677fbc1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3623:x1875571085931264:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788684551.816301:0:22725:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085930880 00000100:00100000:2.0:1788684551.816306:0:22725:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085930880 00000100:00100000:0.0:1788684551.816329:0:22737:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d677fbc1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3623:x1875571085931264:12345-0@lo:400:kworker.0 Request processed in 53us (5178us total) trans 0 rc 0/0 00000100:00100000:2.0:1788684551.816338:0:22725:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:0.0:1788684551.816352:0:22737:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1788684551.816353:0:22725:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d677ccdcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cebd1789-51a4-46ff-b167-6b1633e930a1+24:3623:x1875571085930880:12345-0@lo:400:kworker.0 00000100:00080000:0.0:1788684551.816422:0:22728:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788684551.816429:0:22728:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788684551.816432:0:22728:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788684551.816475:0:3625:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d66477eea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3625:1875571085931136:0@lo:400:kworker.0 00000100:00100000:0.0:1788684551.816490:0:3625:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d66477ef800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3625:1875571085931648:0@lo:400:kworker.0 00000100:00100000:0.0:1788684551.816504:0:3625:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d66477ef480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3625:1875571085931008:0@lo:400:kworker.0 00000100:00100000:0.0:1788684551.816516:0:3625:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d66477edf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3625:1875571085931520:0@lo:400:kworker.0 00010000:00080000:0.0:1788684551.816535:0:3625:0:(ldlm_request.c:1670:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d677fbc1f80 x1875571085932032/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788684567 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788684551.816543:0:3625:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d677fbc1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3625:1875571085932032:0@lo:400:kworker.0 00000100:00100000:2.0:1788684551.816588:0:22725:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d677ccdcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cebd1789-51a4-46ff-b167-6b1633e930a1+24:3623:x1875571085930880:12345-0@lo:400:kworker.0 Request processed in 239us (5318us total) trans 0 rc 0/0 00000100:00100000:2.0:1788684551.816597:0:22725:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:1.0:1788684551.817096:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d66477eca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:cebd1789-51a4-46ff-b167-6b1633e930a1:3623:1875571085930880:0@lo:400:kworker.0 00000100:00100000:1.0:1788684551.817112:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d66477ec000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3623:1875571085931264:0@lo:400:kworker.0 00010000:00010000:3.0:1788684551.873048:0:22720:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788684552.893623:0:25183:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1788684553.694251:0:25612:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00000100:00100000:0.0:1788684553.858805:0:3626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d677fb45500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3626:1875571085932160:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788684553.859018:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788684553.859128:0:24243:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085932160 00000100:00100000:0.0:1788684553.859137:0:24243:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085932160 00000100:00100000:0.0:1788684553.859199:0:24243:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1788684553.859208:0:24243:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d677fb47800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3626:x1875571085932160:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1788684553.859236:0:24243:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:0.0:1788684553.859280:0:24243:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d677fb47800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3626:x1875571085932160:12345-0@lo:13:osp-pre-0-1.0 Request processed in 73us (263us total) trans 0 rc 0/0 00000100:00100000:0.0:1788684553.859288:0:24243:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1788684553.859335:0:3626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d677fb45500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3626:1875571085932160:0@lo:13:osp-pre-0-1.0 00000100:00080000:1.0:1788684553.859521:0:22728:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:00100000:1.0:1788684553.863883:0:25054:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 0e62701e-7d60-4e2d-bd52-05ee75d6c929 00000001:00100000:1.0:1788684553.863896:0:25054:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 4099400f-835c-46aa-bd1f-63cdd511e591 00000001:00100000:2.0:1788684553.864150:0:22711:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 0e62701e-7d60-4e2d-bd52-05ee75d6c929 00000001:00100000:2.0:1788684553.864157:0:22711:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 4099400f-835c-46aa-bd1f-63cdd511e591 00000001:00100000:1.0:1788684553.864626:0:24235:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 0e62701e-7d60-4e2d-bd52-05ee75d6c929 00000001:00100000:1.0:1788684553.864633:0:24235:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 4099400f-835c-46aa-bd1f-63cdd511e591 00000001:00100000:0.0:1788684553.865982:0:23464:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of 0e62701e-7d60-4e2d-bd52-05ee75d6c929 00000001:00100000:0.0:1788684553.866000:0:23464:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of 4099400f-835c-46aa-bd1f-63cdd511e591 00010000:00010000:3.0:1788684553.917741:0:25184:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788684554.941681:0:22721:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788684555.389558:0:3624:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788684555.389582:0:3624:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6647a62680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3624:1875571085932288:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788684555.389658:0:3624:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788684555.389798:0:24164:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085932288 00000100:00100000:2.0:1788684555.389817:0:24164:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085932288 00000100:00100000:2.0:1788684555.389867:0:24164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1788684555.389877:0:24164:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d677fb45500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3624:x1875571085932288:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1788684555.389910:0:24164:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:2.0:1788684555.389970:0:24164:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d677fb45500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3624:x1875571085932288:12345-0@lo:41:osp-pre-1-0.0 Request processed in 94us (312us total) trans 0 rc 0/0 00000100:00100000:2.0:1788684555.389978:0:24164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1788684555.390113:0:3624:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6647a62680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3624:1875571085932288:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788684555.390812:0:3624:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d677fb46300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3624:1875571085932416:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788684555.390848:0:3624:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788684555.390988:0:22738:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085932416 00000100:00100000:0.0:1788684555.390994:0:22738:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085932416 00000100:00100000:0.0:1788684555.391031:0:22738:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1788684555.391040:0:22738:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6647a60e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3624:x1875571085932416:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1788684555.391061:0:22738:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446309888 avail 1300070400 00000100:00100000:0.0:1788684555.391102:0:22738:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6647a60e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3624:x1875571085932416:12345-0@lo:41:osp-pre-0-1.0 Request processed in 63us (253us total) trans 0 rc 0/0 00000100:00100000:0.0:1788684555.391109:0:22738:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1788684555.391143:0:3624:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d677fb46300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3624:1875571085932416:0@lo:41:osp-pre-0-1.0 00010000:00010000:3.0:1788684555.965943:0:22720:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788684556.477844:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:0.0:1788684556.477909:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:0.0:1788684556.477953:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:0.0:1788684556.477983:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:0.0:1788684556.478024:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:3.0:1788684556.478025:0:22726:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073243264 00000100:00100000:3.0:1788684556.478042:0:22726:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073243264 00000100:00100000:0.0:1788684556.478062:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:3.0:1788684556.478101:0:22726:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 146 00000100:00100000:3.0:1788684556.478115:0:22726:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d677ccdf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9f969391-6479-4864-94e2-df3227346f88+13:2392:x1875571073243264:12345-192.168.206.44@tcp:400:kworker.0 00000100:00100000:3.0:1788684556.478212:0:22726:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d677ccdf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9f969391-6479-4864-94e2-df3227346f88+13:2392:x1875571073243264:12345-192.168.206.44@tcp:400:kworker.0 Request processed in 100us (387us total) trans 0 rc 0/0 00000100:00100000:3.0:1788684556.478220:0:22726:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 146 00000100:00100000:3.0:1788684556.478262:0:24240:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073243776 00000100:00100000:3.0:1788684556.478266:0:24240:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073243776 00000100:00100000:3.0:1788684556.478306:0:24240:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073244288 00000100:00100000:3.0:1788684556.478309:0:24240:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073244288 00000100:00100000:3.0:1788684556.478346:0:24240:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 8 00000100:00100000:3.0:1788684556.478354:0:24240:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d677fb47b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4099400f-835c-46aa-bd1f-63cdd511e591+5:2392:x1875571073243776:12345-192.168.206.44@tcp:400:kworker.0 00000100:00100000:3.0:1788684556.478425:0:24240:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d677fb47b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4099400f-835c-46aa-bd1f-63cdd511e591+5:2392:x1875571073243776:12345-192.168.206.44@tcp:400:kworker.0 Request processed in 72us (472us total) trans 0 rc 0/0 00000100:00100000:3.0:1788684556.478433:0:24240:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 8 00000100:00100000:3.0:1788684556.478446:0:24240:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 9 00000100:00100000:3.0:1788684556.478452:0:24240:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d677fb44e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0e62701e-7d60-4e2d-bd52-05ee75d6c929+5:2392:x1875571073244288:12345-192.168.206.44@tcp:400:kworker.0 00000100:00100000:3.0:1788684556.478668:0:24240:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d677fb44e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0e62701e-7d60-4e2d-bd52-05ee75d6c929+5:2392:x1875571073244288:12345-192.168.206.44@tcp:400:kworker.0 Request processed in 25us (454us total) trans 0 rc 0/0 00000100:00100000:3.0:1788684556.478676:0:24240:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 9 00000100:00080000:3.0:1788684556.478853:0:22728:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788684556.484941:0:22732:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073243520 00000100:00100000:1.0:1788684556.484962:0:22732:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073243520 00000100:00100000:1.0:1788684556.485064:0:22732:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073244032 00000100:00100000:1.0:1788684556.485068:0:22732:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073244032 00000100:00100000:1.0:1788684556.485104:0:22732:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 45 00000100:00100000:1.0:1788684556.485117:0:22732:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d677fb46300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4099400f-835c-46aa-bd1f-63cdd511e591+5:2392:x1875571073243520:12345-192.168.206.44@tcp:400:kworker.0 00000100:00100000:1.0:1788684556.485240:0:22732:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d677fb46300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4099400f-835c-46aa-bd1f-63cdd511e591+5:2392:x1875571073243520:12345-192.168.206.44@tcp:400:kworker.0 Request processed in 125us (7341us total) trans 0 rc 0/0 00000100:00100000:1.0:1788684556.485248:0:22732:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 45 00000100:00100000:1.0:1788684556.485268:0:22732:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 46 00000100:00100000:1.0:1788684556.485276:0:22732:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d677fb45880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0e62701e-7d60-4e2d-bd52-05ee75d6c929+5:2392:x1875571073244032:12345-192.168.206.44@tcp:400:kworker.0 00000100:00100000:1.0:1788684556.485309:0:22732:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d677fb45880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0e62701e-7d60-4e2d-bd52-05ee75d6c929+5:2392:x1875571073244032:12345-192.168.206.44@tcp:400:kworker.0 Request processed in 34us (7326us total) trans 0 rc 0/0 00000100:00100000:1.0:1788684556.485315:0:22732:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 46 00000100:00100000:0.0:1788684556.486291:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:1.0:1788684556.486316:0:22733:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073243392 00000100:00100000:1.0:1788684556.486323:0:22733:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073243392 00000100:00100000:3.0:1788684556.486549:0:24241:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073243648 00000100:00100000:3.0:1788684556.486554:0:24241:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073243648 00000100:00100000:3.0:1788684556.486602:0:24241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 10 00000100:00100000:3.0:1788684556.486613:0:24241:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d677709a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4099400f-835c-46aa-bd1f-63cdd511e591+5:2392:x1875571073243648:12345-192.168.206.44@tcp:400:kworker.0 00000100:00100000:3.0:1788684556.486662:0:24241:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d677709a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4099400f-835c-46aa-bd1f-63cdd511e591+5:2392:x1875571073243648:12345-192.168.206.44@tcp:400:kworker.0 Request processed in 52us (379us total) trans 0 rc 0/0 00000100:00100000:3.0:1788684556.486670:0:24241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 10 00000100:00100000:1.0:1788684556.486737:0:22733:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 47 00000100:00100000:1.0:1788684556.486865:0:22733:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d677709b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4099400f-835c-46aa-bd1f-63cdd511e591+6:2392:x1875571073243392:12345-192.168.206.44@tcp:400:kworker.0 00000100:00100000:1.0:1788684556.486896:0:22733:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d677709b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4099400f-835c-46aa-bd1f-63cdd511e591+6:2392:x1875571073243392:12345-192.168.206.44@tcp:400:kworker.0 Request processed in 153us (8835us total) trans 0 rc 0/0 00000100:00100000:1.0:1788684556.486904:0:22733:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 47 00000100:00080000:1.0:1788684556.486924:0:22728:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788684556.486945:0:22728:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788684556.486947:0:22728:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788684556.487738:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:1.0:1788684556.487785:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:1.0:1788684556.487869:0:24763:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073244160 00000100:00100000:1.0:1788684556.487876:0:24763:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073244160 00000100:00100000:1.0:1788684556.487916:0:24763:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 11 00000100:00100000:1.0:1788684556.487923:0:24763:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d67450b3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0e62701e-7d60-4e2d-bd52-05ee75d6c929+5:2392:x1875571073244160:12345-192.168.206.44@tcp:400:kworker.0 00000100:00100000:1.0:1788684556.487983:0:24763:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d67450b3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0e62701e-7d60-4e2d-bd52-05ee75d6c929+5:2392:x1875571073244160:12345-192.168.206.44@tcp:400:kworker.0 Request processed in 60us (198us total) trans 0 rc 0/0 00000100:00100000:1.0:1788684556.487990:0:24763:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 11 00000100:00080000:1.0:1788684556.488004:0:22728:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788684556.488544:0:22733:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073243904 00000100:00100000:0.0:1788684556.488552:0:22733:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073243904 00000100:00100000:0.0:1788684556.488592:0:22733:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 48 00000100:00100000:0.0:1788684556.488600:0:22733:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6747a6f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0e62701e-7d60-4e2d-bd52-05ee75d6c929+6:2392:x1875571073243904:12345-192.168.206.44@tcp:400:kworker.0 00000100:00100000:0.0:1788684556.488641:0:22733:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6747a6f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0e62701e-7d60-4e2d-bd52-05ee75d6c929+6:2392:x1875571073243904:12345-192.168.206.44@tcp:400:kworker.0 Request processed in 43us (908us total) trans 0 rc 0/0 00000100:00100000:0.0:1788684556.488657:0:22733:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 48 00000100:00080000:1.0:1788684556.489751:0:22728:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788684556.925649:0:3625:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d677fbc3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3625:1875571085932544:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788684556.925681:0:3626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6647a61f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3626:1875571085932672:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788684556.926495:0:3624:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788684556.926513:0:3624:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d677709aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3624:1875571085932800:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788684556.931916:0:3625:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788684556.932063:0:3625:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d66477eca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3625:1875571085933056:0@lo:400:kworker.0 00000100:00100000:3.0:1788684556.932134:0:3625:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788684556.932173:0:3625:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d66477eea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3625:1875571085933568:0@lo:400:kworker.0 00000100:00100000:3.0:1788684556.932207:0:3625:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788684556.932236:0:3625:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d677fab6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3625:1875571085934080:0@lo:400:kworker.0 00000100:00100000:3.0:1788684556.932266:0:3625:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788684556.932311:0:3625:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:3.0:1788684556.932321:0:3625:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d66477edf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3625:1875571085933184:0@lo:400:kworker.0 00000100:00100000:3.0:1788684556.932355:0:3625:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788684556.932413:0:3625:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d66477ec700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3625:1875571085933696:0@lo:400:kworker.0 00000100:00100000:3.0:1788684556.932443:0:3625:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788684556.932473:0:3625:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d677fab5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3625:1875571085934208:0@lo:400:kworker.0 00000100:00100000:3.0:1788684556.932502:0:3625:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788684556.932553:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788684556.932564:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d66477ef480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3623:1875571085933312:0@lo:400:kworker.0 00000100:00100000:3.0:1788684556.932608:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788684556.932609:0:25188:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085933184 00000100:00100000:2.0:1788684556.932618:0:25188:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085933184 00000100:00100000:2.0:1788684556.932701:0:25188:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085933696 00000100:00100000:2.0:1788684556.932704:0:25188:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085933696 00000100:00100000:2.0:1788684556.932737:0:25188:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085933312 00000100:00100000:2.0:1788684556.932741:0:25188:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085933312 00000100:00100000:2.0:1788684556.932779:0:25188:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1788684556.932792:0:25188:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d677fbc0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3625:x1875571085933184:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788684556.933126:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d677fab5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3623:1875571085933824:0@lo:400:kworker.0 00000100:00100000:2.0:1788684556.933188:0:25188:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d677fbc0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3625:x1875571085933184:12345-0@lo:400:kworker.0 Request processed in 399us (833us total) trans 0 rc 0/0 00000100:00100000:2.0:1788684556.933198:0:25188:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1788684556.933763:0:3624:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788684556.933793:0:3624:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d66477ec000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:cebd1789-51a4-46ff-b167-6b1633e930a1:3624:1875571085932928:0@lo:400:kworker.0 00000100:00100000:0.0:1788684556.933825:0:3624:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788684556.933856:0:3624:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d66477ef800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3624:1875571085933440:0@lo:400:kworker.0 00000100:00100000:0.0:1788684556.934013:0:3624:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788684556.934042:0:3624:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d677fab4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3624:1875571085933952:0@lo:400:kworker.0 00000100:00100000:0.0:1788684556.934064:0:3624:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788684556.934082:0:3624:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d677fab5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3624:1875571085934464:0@lo:400:kworker.0 00000100:00100000:0.0:1788684556.934266:0:3624:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788684556.934303:0:22733:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085934080 00000100:00100000:0.0:1788684556.934309:0:22733:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085934080 00000100:00100000:0.0:1788684556.934344:0:22733:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085934208 00000100:00100000:0.0:1788684556.934347:0:22733:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085934208 00000100:00100000:0.0:1788684556.934359:0:22733:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085933440 00000100:00100000:0.0:1788684556.934361:0:22733:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085933440 00000100:00100000:0.0:1788684556.934393:0:22733:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085933952 00000100:00100000:0.0:1788684556.934396:0:22733:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085933952 00000100:00100000:0.0:1788684556.934405:0:22733:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085934464 00000100:00100000:0.0:1788684556.934407:0:22733:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085934464 00000100:00100000:0.0:1788684556.934421:0:22733:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1788684556.934428:0:22733:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d677fbc1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3625:x1875571085934080:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788684556.934472:0:22733:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d677fbc1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3625:x1875571085934080:12345-0@lo:400:kworker.0 Request processed in 44us (2205us total) trans 0 rc 0/0 00000100:00100000:0.0:1788684556.934494:0:22733:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1788684556.934509:0:22733:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1788684556.934514:0:22733:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d677fbc1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3625:x1875571085934208:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788684556.934542:0:22733:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d677fbc1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3625:x1875571085934208:12345-0@lo:400:kworker.0 Request processed in 29us (2041us total) trans 0 rc 0/0 00000100:00100000:0.0:1788684556.934547:0:22733:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1788684556.934557:0:22733:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1788684556.934562:0:22733:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6777099500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3624:x1875571085933440:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788684556.934591:0:22733:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6777099500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3624:x1875571085933440:12345-0@lo:400:kworker.0 Request processed in 28us (578us total) trans 0 rc 0/0 00000100:00100000:0.0:1788684556.934597:0:22733:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1788684556.934606:0:22733:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1788684556.934611:0:22733:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6777098380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3624:x1875571085933952:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788684556.934633:0:22733:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6777098380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3624:x1875571085933952:12345-0@lo:400:kworker.0 Request processed in 23us (568us total) trans 0 rc 0/0 00000100:00100000:0.0:1788684556.934639:0:22733:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1788684556.934647:0:22733:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1788684556.934653:0:22733:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6777098e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3624:x1875571085934464:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788684556.934675:0:22733:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6777098e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3624:x1875571085934464:12345-0@lo:400:kworker.0 Request processed in 23us (410us total) trans 0 rc 0/0 00000100:00100000:0.0:1788684556.934681:0:22733:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1788684556.934723:0:3624:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d66477ef800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3624:1875571085933440:0@lo:400:kworker.0 00000100:00100000:0.0:1788684556.934733:0:3624:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d677fab4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3624:1875571085933952:0@lo:400:kworker.0 00010000:00080000:0.0:1788684556.934757:0:3624:0:(ldlm_request.c:1670:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d677fab5c00 x1875571085934464/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788684572 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788684556.934767:0:3624:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d677fab5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3624:1875571085934464:0@lo:400:kworker.0 00000100:00100000:2.0:1788684556.935104:0:25188:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1788684556.935117:0:25188:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d677fbc0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3625:x1875571085933696:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788684556.935157:0:25188:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d677fbc0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+5:3625:x1875571085933696:12345-0@lo:400:kworker.0 Request processed in 44us (2715us total) trans 0 rc 0/0 00000100:00100000:3.0:1788684556.935778:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788684556.935803:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d677fab4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3623:1875571085934336:0@lo:400:kworker.0 00000100:00100000:3.0:1788684556.935830:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788684556.935878:0:24240:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085933824 00000100:00100000:3.0:1788684556.935884:0:24240:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085933824 00000100:00100000:0.0:1788684556.937352:0:24241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1788684556.937404:0:25188:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1788684556.937453:0:24242:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085932544 00000100:00100000:2.0:1788684556.937460:0:24242:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085932544 00000100:00100000:2.0:1788684556.937490:0:24242:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085932672 00000100:00100000:2.0:1788684556.937492:0:24242:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085932672 00000100:00100000:2.0:1788684556.937502:0:24242:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085932800 00000100:00100000:2.0:1788684556.937504:0:24242:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085932800 00000100:00100000:2.0:1788684556.937516:0:24242:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1788684556.937523:0:24242:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d677fbc0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3625:x1875571085932544:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788684556.937556:0:24242:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3915849728 avail 3684327424 00000100:00100000:2.0:1788684556.937623:0:24242:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d677fbc0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3625:x1875571085932544:12345-0@lo:13:osp-pre-1-0.0 Request processed in 101us (5718us total) trans 0 rc 0/0 00000100:00100000:2.0:1788684556.937643:0:24242:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1788684556.937654:0:24242:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1788684556.937659:0:24242:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6647a60700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3626:x1875571085932672:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1788684556.937669:0:24242:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3915849728 avail 3684327424 00000100:00100000:2.0:1788684556.937692:0:24242:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6647a60700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3626:x1875571085932672:12345-0@lo:13:osp-pre-1-1.0 Request processed in 33us (5142us total) trans 0 rc 0/0 00000100:00100000:2.0:1788684556.937698:0:24242:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1788684556.937707:0:24242:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1788684556.937712:0:24242:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6777099180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3624:x1875571085932800:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788684556.937743:0:24242:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:2.0:1788684556.937784:0:24242:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6777099180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3624:x1875571085932800:12345-0@lo:13:osp-pre-0-0.0 Request processed in 72us (4024us total) trans 0 rc 0/0 00000100:00100000:2.0:1788684556.937790:0:24242:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00080000:2.0:1788684556.937806:0:22728:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1788684556.937812:0:22728:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788684556.937815:0:22728:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788684556.937817:0:22728:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788684556.937836:0:22727:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085932928 00000100:00100000:2.0:1788684556.937840:0:22727:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085932928 00000100:00100000:2.0:1788684556.938221:0:22727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:2.0:1788684556.938228:0:22727:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d677ccdec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cebd1789-51a4-46ff-b167-6b1633e930a1+24:3624:x1875571085932928:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788684556.938476:0:22727:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d677ccdec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cebd1789-51a4-46ff-b167-6b1633e930a1+24:3624:x1875571085932928:12345-0@lo:400:kworker.0 Request processed in 247us (4648us total) trans 0 rc 0/0 00000100:00100000:2.0:1788684556.938484:0:22727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:2.0:1788684556.938561:0:3624:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d66477ec000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:cebd1789-51a4-46ff-b167-6b1633e930a1:3624:1875571085932928:0@lo:400:kworker.0 00000100:00100000:1.0:1788684556.938580:0:22738:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085933056 00000100:00100000:1.0:1788684556.938595:0:22738:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085933056 00000100:00100000:3.0:1788684556.938598:0:24240:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1788684556.938617:0:3624:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d677709aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3624:1875571085932800:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788684556.938631:0:24240:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d664876e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3623:x1875571085933824:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788684556.938669:0:22738:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085933568 00000100:00100000:2.0:1788684556.938677:0:24164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1788684556.938687:0:24164:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d677fbc2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3625:x1875571085933056:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788684556.938694:0:22738:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085933568 00000100:00100000:1.0:1788684556.938734:0:22738:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1788684556.938749:0:22738:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d677fbc0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3625:x1875571085933568:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788684556.938806:0:24240:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d664876e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3623:x1875571085933824:12345-0@lo:400:kworker.0 Request processed in 194us (3026us total) trans 0 rc 0/0 00000100:00100000:3.0:1788684556.938816:0:24240:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1788684556.938851:0:22733:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085934336 00000100:00100000:1.0:1788684556.938859:0:22738:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d677fbc0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3625:x1875571085933568:12345-0@lo:400:kworker.0 Request processed in 107us (6644us total) trans 0 rc 0/0 00000100:00100000:3.0:1788684556.938861:0:22733:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085934336 00000100:00100000:1.0:1788684556.938875:0:22738:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1788684556.938918:0:22733:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1788684556.938940:0:22733:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d664876f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3623:x1875571085934336:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788684556.938983:0:22733:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d664876f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3623:x1875571085934336:12345-0@lo:400:kworker.0 Request processed in 58us (3151us total) trans 0 rc 0/0 00000100:00100000:3.0:1788684556.939004:0:22733:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1788684556.939011:0:24164:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d677fbc2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3625:x1875571085933056:12345-0@lo:400:kworker.0 Request processed in 51us (6602us total) trans 0 rc 0/0 00000100:00100000:2.0:1788684556.939020:0:24164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00080000:2.0:1788684556.939043:0:22728:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788684556.939076:0:3626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6647a61f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3626:1875571085932672:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788684556.939423:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d677fab5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3623:1875571085933824:0@lo:400:kworker.0 00000100:00100000:2.0:1788684556.939436:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d677fab4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3623:1875571085934336:0@lo:400:kworker.0 00000100:00100000:2.0:1788684556.939466:0:3625:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d66477edf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3625:1875571085933184:0@lo:400:kworker.0 00000100:00100000:2.0:1788684556.939478:0:3625:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d66477ec700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3625:1875571085933696:0@lo:400:kworker.0 00010000:00080000:2.0:1788684556.939491:0:3625:0:(ldlm_request.c:1670:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d677fab5500 x1875571085934208/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788684572 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788684556.939503:0:3625:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d677fab5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3625:1875571085934208:0@lo:400:kworker.0 00000100:00100000:2.0:1788684556.939514:0:3625:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d66477eca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3625:1875571085933056:0@lo:400:kworker.0 00000100:00100000:2.0:1788684556.939525:0:3625:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d66477eea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3625:1875571085933568:0@lo:400:kworker.0 00000100:00100000:2.0:1788684556.939536:0:3625:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d677fab6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3625:1875571085934080:0@lo:400:kworker.0 00000100:00100000:2.0:1788684556.939551:0:3625:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d677fbc3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3625:1875571085932544:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788684556.939627:0:24241:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d677fbc2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3623:x1875571085933312:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788684556.939696:0:24241:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d677fbc2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3623:x1875571085933312:12345-0@lo:400:kworker.0 Request processed in 78us (7091us total) trans 0 rc 0/0 00000100:00100000:0.0:1788684556.939704:0:24241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1788684556.941506:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d66477ef480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3623:1875571085933312:0@lo:400:kworker.0 00010000:00010000:3.0:1788684556.991350:0:25183:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1788684557.737816:0:25759:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffc946c1e90 20000000:00000080:3.0:1788684557.737840:0:25759:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff8d67482c3800 uarg=0000000000000000 20000000:01000000:3.0:1788684557.737896:0:25759:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:3.0:1788684557.737904:0:25759:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:3.0:1788684557.737909:0:25759:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:1.0:1788684557.740648:0:25760:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 13 20000000:00000400:3.0:1788684557.740913:0:25759:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:3.0:1788684557.747609:0:25759:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:0.0:1788684557.753063:0:25759:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff8d6765f60a00/0x44bac02bd54ae271 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684557.753096:0:25759:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8d6746d3f600/0x44bac02bd54adece lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x44bac02bd54adec7 expref: 23 pid: 22725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684557.753106:0:25759:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8d6746cb2c00/0x44bac02bd54adedc lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x44bac02bd54aded5 expref: 23 pid: 22726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684557.753113:0:25759:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8d6746cb2a00/0x44bac02bd54adf1b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x44bac02bd54adf14 expref: 23 pid: 22725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684557.753121:0:25759:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8d66476d4200/0x44bac02bd54adfb5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x44bac02bd54adfae expref: 23 pid: 22727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684557.753131:0:25759:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8d6765f60400/0x44bac02bd54ae201 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.206.44@tcp remote: 0xb726964c63ed402d expref: 12 pid: 22726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684557.753139:0:25759:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff8d66476d4800/0x44bac02bd54ae240 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.206.44@tcp remote: 0xb726964c63ed409d expref: 12 pid: 22726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684557.753166:0:25759:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff8d6765f60a00/0x44bac02bd54ae271 lrc: 9/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 25759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684557.753216:0:25759:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8d66476d4800/0x44bac02bd54ae240 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.206.44@tcp remote: 0xb726964c63ed409d expref: 12 pid: 22726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684557.753234:0:25759:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8d66476d4800/0x44bac02bd54ae240 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.206.44@tcp remote: 0xb726964c63ed409d expref: 12 pid: 22726 timeout: 738 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788684557.753251:0:25759:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d677709bb80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25759:1875571085934592:192.168.206.44@tcp:104: 00010000:00010000:0.0:1788684557.753469:0:25759:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8d6765f60400/0x44bac02bd54ae201 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.206.44@tcp remote: 0xb726964c63ed402d expref: 12 pid: 22726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684557.753477:0:25759:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8d6765f60400/0x44bac02bd54ae201 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.206.44@tcp remote: 0xb726964c63ed402d expref: 12 pid: 22726 timeout: 738 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788684557.753487:0:25759:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6777099f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25759:1875571085934720:192.168.206.44@tcp:104: 00010000:00010000:0.0:1788684557.753519:0:25759:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8d66476d4200/0x44bac02bd54adfb5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x44bac02bd54adfae expref: 23 pid: 22727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684557.753528:0:25759:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8d66476d4200/0x44bac02bd54adfb5 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x44bac02bd54adfae expref: 23 pid: 22727 timeout: 738 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788684557.753538:0:25759:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d677709b800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25759:1875571085934848:0@lo:104: 00000100:00100000:0.0:1788684557.753589:0:25759:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788684557.753636:0:25759:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8d6746cb2a00/0x44bac02bd54adf1b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x44bac02bd54adf14 expref: 23 pid: 22725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684557.753654:0:25759:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8d6746cb2a00/0x44bac02bd54adf1b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x44bac02bd54adf14 expref: 23 pid: 22725 timeout: 738 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788684557.753664:0:25759:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d677709b480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25759:1875571085934976:0@lo:104: 00000100:00100000:0.0:1788684557.753687:0:25759:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788684557.753705:0:25759:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8d6746cb2c00/0x44bac02bd54adedc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x44bac02bd54aded5 expref: 23 pid: 22726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684557.753714:0:25759:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8d6746cb2c00/0x44bac02bd54adedc lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x44bac02bd54aded5 expref: 23 pid: 22726 timeout: 738 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788684557.753721:0:25759:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d677709a680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25759:1875571085935104:0@lo:104: 00000100:00100000:0.0:1788684557.753741:0:25759:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788684557.753758:0:25759:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff8d6746d3f600/0x44bac02bd54adece lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x44bac02bd54adec7 expref: 23 pid: 22725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684557.753766:0:25759:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff8d6746d3f600/0x44bac02bd54adece lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x44bac02bd54adec7 expref: 23 pid: 22725 timeout: 738 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788684557.753774:0:25759:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d677709ad80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25759:1875571085935232:0@lo:104: 00000100:00100000:0.0:1788684557.753804:0:25759:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788684557.753816:0:25759:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d677e2b6f00 going to sleep for 11 seconds 00000100:00100000:2.0:1788684557.754050:0:22716:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085934848 00000100:00100000:2.0:1788684557.754064:0:22716:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085934848 00000100:00100000:2.0:1788684557.754112:0:22716:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085934976 00000100:00100000:2.0:1788684557.754114:0:22716:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085934976 00000100:00100000:2.0:1788684557.754125:0:22716:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085935104 00000100:00100000:2.0:1788684557.754127:0:22716:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085935104 00000100:00100000:2.0:1788684557.754134:0:22716:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085935232 00000100:00100000:2.0:1788684557.754135:0:22716:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085935232 00000100:00100000:2.0:1788684557.754148:0:22716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1788684557.754156:0:22716:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6777098a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:cebd1789-51a4-46ff-b167-6b1633e930a1+6:25759:x1875571085934848:12345-0@lo:104: 00010000:00010000:2.0:1788684557.754172:0:22716:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.144@tcp lock: ffff8d6746cb2400/0x44bac02bd54adfae lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x44bac02bd54adfb5 expref: -99 pid: 25053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684557.754239:0:22716:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1788684557.754246:0:22716:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6777098a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:cebd1789-51a4-46ff-b167-6b1633e930a1+6:25759:x1875571085934848:12345-0@lo:104: Request processed in 90us (657us total) trans 0 rc 0/0 00000100:00100000:2.0:1788684557.754253:0:22716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1788684557.754270:0:22716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788684557.754276:0:22716:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6777099c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:cebd1789-51a4-46ff-b167-6b1633e930a1+5:25759:x1875571085934976:12345-0@lo:104: 00010000:00010000:2.0:1788684557.754283:0:22716:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.144@tcp lock: ffff8d66476d5c00/0x44bac02bd54adf14 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x44bac02bd54adf1b expref: -99 pid: 24234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684557.754318:0:22716:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1788684557.754324:0:22716:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6777099c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:cebd1789-51a4-46ff-b167-6b1633e930a1+5:25759:x1875571085934976:12345-0@lo:104: Request processed in 48us (636us total) trans 0 rc 0/0 00000100:00100000:2.0:1788684557.754330:0:22716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788684557.754352:0:22716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1788684557.754357:0:22716:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6777098700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:cebd1789-51a4-46ff-b167-6b1633e930a1+4:25759:x1875571085935104:12345-0@lo:104: 00010000:00010000:2.0:1788684557.754387:0:22716:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.144@tcp lock: ffff8d6746d3f000/0x44bac02bd54aded5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x44bac02bd54adedc expref: -99 pid: 22729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684557.754430:0:22716:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:2.0:1788684557.754435:0:22716:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6777098700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:cebd1789-51a4-46ff-b167-6b1633e930a1+4:25759:x1875571085935104:12345-0@lo:104: Request processed in 78us (693us total) trans 0 rc 0/0 00000100:00100000:2.0:1788684557.754441:0:22716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1788684557.754453:0:22716:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1788684557.754458:0:22716:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6777098000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:cebd1789-51a4-46ff-b167-6b1633e930a1+3:25759:x1875571085935232:12345-0@lo:104: 00010000:00010000:2.0:1788684557.754466:0:22716:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.206.144@tcp lock: ffff8d66476d5e00/0x44bac02bd54adec7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x44bac02bd54adece expref: -99 pid: 22729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684557.754495:0:22716:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:2.0:1788684557.754500:0:22716:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6777098000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:cebd1789-51a4-46ff-b167-6b1633e930a1+3:25759:x1875571085935232:12345-0@lo:104: Request processed in 42us (696us total) trans 0 rc 0/0 00000100:00100000:2.0:1788684557.754506:0:22716:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1788684557.756332:0:25759:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d677709b800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25759:1875571085934848:0@lo:104: 00000100:00100000:0.0:1788684557.756349:0:25759:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d677709b480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25759:1875571085934976:0@lo:104: 00000100:00100000:0.0:1788684557.756359:0:25759:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d677709a680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25759:1875571085935104:0@lo:104: 00000100:00100000:0.0:1788684557.756429:0:25759:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d677709ad80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25759:1875571085935232:0@lo:104: 00010000:00010000:0.0:1788684557.756477:0:22721:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:0.0:1788684557.756502:0:22721:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.144@tcp lock: ffff8d6746cb2400/0x44bac02bd54adfae lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x44bac02bd54adfb5 expref: -99 pid: 25053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684557.756512:0:22721:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d6746cb2400 already unused, calling callback (ffffffffc1297c20) 10000000:00010000:0.0:1788684557.756516:0:22721:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.144@tcp lock: ffff8d6746cb2400/0x44bac02bd54adfae lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x44bac02bd54adfb5 expref: -99 pid: 25053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684557.756527:0:22721:0:(ldlm_request.c:1390:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.144@tcp lock: ffff8d6746cb2400/0x44bac02bd54adfae lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x44bac02bd54adfb5 expref: -99 pid: 25053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788684557.756535:0:22721:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.144@tcp lock: ffff8d6746cb2400/0x44bac02bd54adfae lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x44bac02bd54adfb5 expref: -99 pid: 25053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788684557.756542:0:22721:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1788684557.756592:0:22721:0:(ldlm_request.c:1438:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.144@tcp lock: ffff8d6746cb2400/0x44bac02bd54adfae lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x44bac02bd54adfb5 expref: -99 pid: 25053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684557.756600:0:22721:0:(ldlm_request.c:1497:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788684557.756620:0:22721:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.144@tcp lock: ffff8d6746cb2400/0x44bac02bd54adfae lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x44bac02bd54adfb5 expref: -99 pid: 25053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684557.756629:0:22721:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.144@tcp lock: ffff8d6746cb2400/0x44bac02bd54adfae lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x44bac02bd54adfb5 expref: -99 pid: 25053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684557.756643:0:22721:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1788684557.756647:0:22721:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.144@tcp lock: ffff8d66476d5c00/0x44bac02bd54adf14 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x44bac02bd54adf1b expref: -99 pid: 24234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684557.756652:0:22721:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d66476d5c00 already unused, calling callback (ffffffffc1297c20) 10000000:00010000:0.0:1788684557.756655:0:22721:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.144@tcp lock: ffff8d66476d5c00/0x44bac02bd54adf14 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x44bac02bd54adf1b expref: -99 pid: 24234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684557.756674:0:22721:0:(ldlm_request.c:1390:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.144@tcp lock: ffff8d66476d5c00/0x44bac02bd54adf14 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x44bac02bd54adf1b expref: -99 pid: 24234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788684557.756681:0:22721:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.144@tcp lock: ffff8d66476d5c00/0x44bac02bd54adf14 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x44bac02bd54adf1b expref: -99 pid: 24234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788684557.756687:0:22721:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1788684557.756701:0:22721:0:(ldlm_request.c:1438:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.144@tcp lock: ffff8d66476d5c00/0x44bac02bd54adf14 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x44bac02bd54adf1b expref: -99 pid: 24234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684557.756707:0:22721:0:(ldlm_request.c:1497:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788684557.756713:0:22721:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.144@tcp lock: ffff8d66476d5c00/0x44bac02bd54adf14 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x44bac02bd54adf1b expref: -99 pid: 24234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684557.756719:0:22721:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.144@tcp lock: ffff8d66476d5c00/0x44bac02bd54adf14 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x44bac02bd54adf1b expref: -99 pid: 24234 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684557.756729:0:22721:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788684557.756732:0:22721:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.144@tcp lock: ffff8d6746d3f000/0x44bac02bd54aded5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x44bac02bd54adedc expref: -99 pid: 22729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684557.756738:0:22721:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d6746d3f000 already unused, calling callback (ffffffffc1297c20) 10000000:00010000:0.0:1788684557.756742:0:22721:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.144@tcp lock: ffff8d6746d3f000/0x44bac02bd54aded5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x44bac02bd54adedc expref: -99 pid: 22729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684557.756749:0:22721:0:(ldlm_request.c:1390:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.144@tcp lock: ffff8d6746d3f000/0x44bac02bd54aded5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x44bac02bd54adedc expref: -99 pid: 22729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788684557.756755:0:22721:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.144@tcp lock: ffff8d6746d3f000/0x44bac02bd54aded5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x44bac02bd54adedc expref: -99 pid: 22729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788684557.756768:0:22721:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1788684557.756782:0:22721:0:(ldlm_request.c:1438:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.144@tcp lock: ffff8d6746d3f000/0x44bac02bd54aded5 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x44bac02bd54adedc expref: -99 pid: 22729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684557.756939:0:25184:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788684557.756946:0:25184:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.206.144@tcp lock: ffff8d66476d5e00/0x44bac02bd54adec7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x44bac02bd54adece expref: -99 pid: 22729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684557.756954:0:25184:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d66476d5e00 already unused, calling callback (ffffffffc1297c20) 10000000:00010000:3.0:1788684557.756957:0:25184:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.206.144@tcp lock: ffff8d66476d5e00/0x44bac02bd54adec7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x44bac02bd54adece expref: -99 pid: 22729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684557.756966:0:25184:0:(ldlm_request.c:1390:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.206.144@tcp lock: ffff8d66476d5e00/0x44bac02bd54adec7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x44bac02bd54adece expref: -99 pid: 22729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788684557.756972:0:25184:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.206.144@tcp lock: ffff8d66476d5e00/0x44bac02bd54adec7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x44bac02bd54adece expref: -99 pid: 22729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788684557.756978:0:25184:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1788684557.756994:0:25184:0:(ldlm_request.c:1438:__ldlm_pack_lock()) ### packing ns: MGC192.168.206.144@tcp lock: ffff8d66476d5e00/0x44bac02bd54adec7 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x44bac02bd54adece expref: -99 pid: 22729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684557.757001:0:25184:0:(ldlm_request.c:1497:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788684557.757028:0:25184:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.144@tcp lock: ffff8d66476d5e00/0x44bac02bd54adec7 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x44bac02bd54adece expref: -99 pid: 22729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684557.757036:0:25184:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.144@tcp lock: ffff8d66476d5e00/0x44bac02bd54adec7 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x44bac02bd54adece expref: -99 pid: 22729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684557.757047:0:25184:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788684557.757049:0:25184:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788684557.757050:0:25184:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788684557.757057:0:22720:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788684557.757063:0:25183:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788684557.757077:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d664876c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:cebd1789-51a4-46ff-b167-6b1633e930a1:3623:1875571085935744:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788684557.757146:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788684557.757214:0:22718:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085935744 00000100:00100000:3.0:1788684557.757220:0:22718:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085935744 00010000:00010000:3.0:1788684557.757253:0:22718:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8d6746d3f600/0x44bac02bd54adece lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x44bac02bd54adec7 expref: 24 pid: 22725 timeout: 738 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788684557.757284:0:22718:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788684557.757292:0:22718:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d664876dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:cebd1789-51a4-46ff-b167-6b1633e930a1+24:3623:x1875571085935744:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788684557.757305:0:22718:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788684557.757312:0:22718:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8d6746d3f600/0x44bac02bd54adece lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x44bac02bd54adec7 expref: 24 pid: 22725 timeout: 738 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684557.757322:0:22718:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8d6746d3f600/0x44bac02bd54adece lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x44bac02bd54adec7 expref: 24 pid: 22725 timeout: 738 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684557.757339:0:22718:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d6746d3f600/0x44bac02bd54adece lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x44bac02bd54adec7 expref: 24 pid: 22725 timeout: 738 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684557.757387:0:22718:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788684557.757421:0:22718:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d664876dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:cebd1789-51a4-46ff-b167-6b1633e930a1+23:3623:x1875571085935744:12345-0@lo:103:ldlm_bl.0 Request processed in 129us (275us total) trans 0 rc 0/0 00000100:00100000:3.0:1788684557.757428:0:22718:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788684557.757466:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d664876c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:cebd1789-51a4-46ff-b167-6b1633e930a1:3623:1875571085935744:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788684557.757554:0:3625:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6777099880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:cebd1789-51a4-46ff-b167-6b1633e930a1:3625:1875571085935360:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788684557.757584:0:3625:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788684557.757618:0:3625:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788684557.757624:0:3625:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d677709aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:cebd1789-51a4-46ff-b167-6b1633e930a1:3625:1875571085935488:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788684557.757644:0:3625:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788684557.759559:0:22721:0:(ldlm_request.c:1497:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788684557.759591:0:22721:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.206.144@tcp lock: ffff8d6746d3f000/0x44bac02bd54aded5 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x44bac02bd54adedc expref: -99 pid: 22729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684557.759601:0:22721:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.206.144@tcp lock: ffff8d6746d3f000/0x44bac02bd54aded5 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x44bac02bd54adedc expref: -99 pid: 22729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684557.759633:0:22721:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788684557.759635:0:22721:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788684557.759638:0:22721:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788684557.759888:0:22719:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085935360 00000100:00100000:3.0:1788684557.759897:0:22719:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085935360 00010000:00010000:3.0:1788684557.759956:0:22719:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8d66476d4200/0x44bac02bd54adfb5 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x44bac02bd54adfae expref: 23 pid: 22727 timeout: 738 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788684557.759991:0:22719:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085935488 00000100:00100000:3.0:1788684557.759994:0:22719:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085935488 00010000:00010000:3.0:1788684557.760006:0:22719:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8d6746cb2a00/0x44bac02bd54adf1b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x44bac02bd54adf14 expref: 24 pid: 22725 timeout: 738 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788684557.760020:0:22719:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1788684557.760030:0:22719:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6647a61f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:cebd1789-51a4-46ff-b167-6b1633e930a1+24:3625:x1875571085935360:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788684557.760045:0:22719:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788684557.760050:0:22719:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8d66476d4200/0x44bac02bd54adfb5 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x44bac02bd54adfae expref: 24 pid: 22727 timeout: 738 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684557.760061:0:22719:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8d66476d4200/0x44bac02bd54adfb5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x44bac02bd54adfae expref: 24 pid: 22727 timeout: 738 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684557.760079:0:22719:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d66476d4200/0x44bac02bd54adfb5 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x44bac02bd54adfae expref: 24 pid: 22727 timeout: 738 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684557.760093:0:22719:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788684557.760185:0:22719:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6647a61f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:cebd1789-51a4-46ff-b167-6b1633e930a1+23:3625:x1875571085935360:12345-0@lo:103:ldlm_bl.0 Request processed in 156us (2600us total) trans 0 rc 0/0 00000100:00100000:3.0:1788684557.760193:0:22719:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1788684557.760210:0:22719:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1788684557.760216:0:22719:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6647a62d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:cebd1789-51a4-46ff-b167-6b1633e930a1+22:3625:x1875571085935488:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788684557.760223:0:22719:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788684557.760228:0:22719:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8d6746cb2a00/0x44bac02bd54adf1b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x44bac02bd54adf14 expref: 22 pid: 22725 timeout: 738 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684557.760237:0:22719:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8d6746cb2a00/0x44bac02bd54adf1b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x44bac02bd54adf14 expref: 22 pid: 22725 timeout: 738 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684557.760249:0:22719:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d6746cb2a00/0x44bac02bd54adf1b lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x44bac02bd54adf14 expref: 22 pid: 22725 timeout: 738 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684557.760258:0:22719:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788684557.760278:0:22719:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6647a62d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:cebd1789-51a4-46ff-b167-6b1633e930a1+21:3625:x1875571085935488:12345-0@lo:103:ldlm_bl.0 Request processed in 63us (2634us total) trans 0 rc 0/0 00000100:00100000:3.0:1788684557.760284:0:22719:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1788684557.760322:0:3624:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d66477ef480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:cebd1789-51a4-46ff-b167-6b1633e930a1:3624:1875571085935616:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788684557.760401:0:3624:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788684557.760463:0:3625:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d677709aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:cebd1789-51a4-46ff-b167-6b1633e930a1:3625:1875571085935488:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788684557.760475:0:3625:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6777099880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:cebd1789-51a4-46ff-b167-6b1633e930a1:3625:1875571085935360:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788684557.760505:0:22718:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085935616 00000100:00100000:3.0:1788684557.760508:0:22718:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085935616 00010000:00010000:3.0:1788684557.760521:0:22718:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8d6746cb2c00/0x44bac02bd54adedc lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x44bac02bd54aded5 expref: 21 pid: 22726 timeout: 738 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788684557.760551:0:22718:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1788684557.760557:0:22718:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d664876c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:cebd1789-51a4-46ff-b167-6b1633e930a1+21:3624:x1875571085935616:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788684557.760567:0:22718:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788684557.760571:0:22718:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8d6746cb2c00/0x44bac02bd54adedc lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x44bac02bd54aded5 expref: 21 pid: 22726 timeout: 738 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684557.760580:0:22718:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8d6746cb2c00/0x44bac02bd54adedc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x44bac02bd54aded5 expref: 21 pid: 22726 timeout: 738 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684557.760591:0:22718:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d6746cb2c00/0x44bac02bd54adedc lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x44bac02bd54aded5 expref: 21 pid: 22726 timeout: 738 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684557.760599:0:22718:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788684557.760627:0:22718:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d664876c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:cebd1789-51a4-46ff-b167-6b1633e930a1+20:3624:x1875571085935616:12345-0@lo:103:ldlm_bl.0 Request processed in 71us (227us total) trans 0 rc 0/0 00000100:00100000:3.0:1788684557.760633:0:22718:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1788684557.760654:0:3624:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d66477ef480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:cebd1789-51a4-46ff-b167-6b1633e930a1:3624:1875571085935616:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788684557.772090:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:1.0:1788684557.772135:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:2.0:1788684557.772273:0:22719:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073244416 00000100:00100000:2.0:1788684557.772283:0:22719:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073244416 00010000:00010000:2.0:1788684557.772342:0:22719:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8d66476d4800/0x44bac02bd54ae240 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.206.44@tcp remote: 0xb726964c63ed409d expref: 13 pid: 22726 timeout: 738 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788684557.772403:0:22719:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073244544 00000100:00100000:2.0:1788684557.772406:0:22719:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073244544 00010000:00010000:2.0:1788684557.772419:0:22719:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff8d6765f60400/0x44bac02bd54ae201 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.206.44@tcp remote: 0xb726964c63ed402d expref: 14 pid: 22726 timeout: 738 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788684557.772459:0:22719:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 13 00000100:00100000:2.0:1788684557.772469:0:22719:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d66465df450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9f969391-6479-4864-94e2-df3227346f88+14:2393:x1875571073244416:12345-192.168.206.44@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788684557.772486:0:22719:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788684557.772493:0:22719:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8d66476d4800/0x44bac02bd54ae240 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.206.44@tcp remote: 0xb726964c63ed409d expref: 14 pid: 22726 timeout: 738 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684557.772506:0:22719:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8d66476d4800/0x44bac02bd54ae240 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.206.44@tcp remote: 0xb726964c63ed409d expref: 14 pid: 22726 timeout: 738 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684557.772531:0:22719:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788684557.772595:0:22719:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d66465df450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9f969391-6479-4864-94e2-df3227346f88+14:2393:x1875571073244416:12345-192.168.206.44@tcp:103:ldlm_bl.0 Request processed in 127us (518us total) trans 0 rc 0/0 00000100:00100000:2.0:1788684557.772602:0:22719:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 13 00000100:00100000:2.0:1788684557.772655:0:22719:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 14 00000100:00100000:2.0:1788684557.772661:0:22719:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d677fab7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9f969391-6479-4864-94e2-df3227346f88+13:2393:x1875571073244544:12345-192.168.206.44@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788684557.772669:0:22719:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788684557.772674:0:22719:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff8d6765f60400/0x44bac02bd54ae201 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.206.44@tcp remote: 0xb726964c63ed402d expref: 13 pid: 22726 timeout: 738 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684557.772685:0:22719:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff8d6765f60400/0x44bac02bd54ae201 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.206.44@tcp remote: 0xb726964c63ed402d expref: 13 pid: 22726 timeout: 738 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684557.772698:0:22719:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff8d6765f60a00/0x44bac02bd54ae271 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 25759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684557.772707:0:22719:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d6765f60a00/0x44bac02bd54ae271 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 25759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684557.772730:0:22719:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8d6765f60a00/0x44bac02bd54ae271 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 25759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684557.772737:0:22719:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff8d6765f60a00/0x44bac02bd54ae271 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 25759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684557.772744:0:22719:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff8d6765f60a00/0x44bac02bd54ae271 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 25759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684557.772752:0:22719:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff8d6765f60a00/0x44bac02bd54ae271 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 25759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684557.772759:0:22719:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d6765f60a00 already unused, calling callback (ffffffffc0cae340) 00010000:00010000:2.0:1788684557.772764:0:22719:0:(ldlm_request.c:377:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff8d6765f60a00/0x44bac02bd54ae271 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 25759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684557.772773:0:22719:0:(ldlm_request.c:1415:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff8d6765f60a00/0x44bac02bd54ae271 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 25759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684557.772782:0:22719:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff8d6765f60a00/0x44bac02bd54ae271 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 25759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684557.772792:0:22719:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788684557.772811:0:22719:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d677fab7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9f969391-6479-4864-94e2-df3227346f88+13:2393:x1875571073244544:12345-192.168.206.44@tcp:103:ldlm_bl.0 Request processed in 150us (675us total) trans 0 rc 0/0 00000100:00100000:2.0:1788684557.772818:0:22719:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 14 00010000:00010000:0.0:1788684557.773209:0:25759:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d66476d4800/0x44bac02bd54ae240 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.206.44@tcp remote: 0xb726964c63ed409d expref: 12 pid: 22726 timeout: 738 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788684557.773226:0:25759:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d677709bb80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25759:1875571085934592:192.168.206.44@tcp:104: 00010000:00010000:0.0:1788684557.773238:0:25759:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d6765f60400/0x44bac02bd54ae201 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 192.168.206.44@tcp remote: 0xb726964c63ed402d expref: 11 pid: 22726 timeout: 738 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788684557.773247:0:25759:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6777099f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25759:1875571085934720:192.168.206.44@tcp:104: 00010000:00010000:0.0:1788684557.773282:0:25759:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff8d6765f60a00/0x44bac02bd54ae271 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 25759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684557.773292:0:25759:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff8d6765f60a00/0x44bac02bd54ae271 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 25759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684557.773300:0:25759:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff8d6765f60a00/0x44bac02bd54ae271 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 25759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684557.773315:0:25759:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff8d6765f60a00/0x44bac02bd54ae271 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 25759 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684558.013656:0:25184:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1788684558.655475:0:22768:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:1.0:1788684558.904668:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:3.0:1788684558.904856:0:22725:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073244672 00000100:00100000:3.0:1788684558.904869:0:22725:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073244672 00000100:00100000:3.0:1788684558.904950:0:22725:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 148 00000100:00100000:3.0:1788684558.904963:0:22725:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d677ccdd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9f969391-6479-4864-94e2-df3227346f88+11:18066:x1875571073244672:12345-192.168.206.44@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788684558.904986:0:22725:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788684558.905013:0:22725:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d6647890200/0x44bac02bd54ae278 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xb726964c63ed40d5 expref: -99 pid: 22725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684558.905073:0:22725:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d6647890200/0x44bac02bd54ae278 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.206.44@tcp remote: 0xb726964c63ed40d5 expref: 12 pid: 22725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684558.905085:0:22725:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d6647890200/0x44bac02bd54ae278 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.206.44@tcp remote: 0xb726964c63ed40d5 expref: 12 pid: 22725 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684558.905095:0:22725:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d6647890200, rc 0) 00000100:00100000:3.0:1788684558.905170:0:22725:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d677ccdd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9f969391-6479-4864-94e2-df3227346f88+12:18066:x1875571073244672:12345-192.168.206.44@tcp:101:ll_cfg_requeue.0 Request processed in 209us (517us total) trans 0 rc 0/0 00000100:00100000:3.0:1788684558.905177:0:22725:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 148 00000100:00100000:2.0:1788684558.916304:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:3.0:1788684558.916991:0:22726:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073244800 00000100:00100000:3.0:1788684558.917005:0:22726:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073244800 00000100:00100000:3.0:1788684558.917080:0:22726:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 149 00000100:00100000:3.0:1788684558.917092:0:22726:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d677ccdc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9f969391-6479-4864-94e2-df3227346f88+12:18066:x1875571073244800:12345-192.168.206.44@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788684558.921295:0:22726:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d677ccdc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9f969391-6479-4864-94e2-df3227346f88+12:18066:x1875571073244800:12345-192.168.206.44@tcp:501:ll_cfg_requeue.0 Request processed in 4184us (4987us total) trans 0 rc 0/0 00000100:00100000:3.0:1788684558.921314:0:22726:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 149 00000100:00100000:3.0:1788684558.947576:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:2.0:1788684558.947812:0:22727:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073244928 00000100:00100000:2.0:1788684558.947824:0:22727:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073244928 00000100:00100000:2.0:1788684558.947899:0:22727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 150 00000100:00100000:2.0:1788684558.947940:0:22727:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d677ccdf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9f969391-6479-4864-94e2-df3227346f88+12:18066:x1875571073244928:12345-192.168.206.44@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788684558.948150:0:22727:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d677ccdf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9f969391-6479-4864-94e2-df3227346f88+12:18066:x1875571073244928:12345-192.168.206.44@tcp:503:ll_cfg_requeue.0 Request processed in 211us (602us total) trans 0 rc 0/0 00000100:00100000:2.0:1788684558.948159:0:22727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 150 00000100:00100000:1.0:1788684558.972669:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:3.0:1788684558.972809:0:22726:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073245056 00000100:00100000:3.0:1788684558.972821:0:22726:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073245056 00000100:00100000:3.0:1788684558.972890:0:22726:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 151 00000100:00100000:3.0:1788684558.972902:0:22726:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d677ccde850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9f969391-6479-4864-94e2-df3227346f88+12:18066:x1875571073245056:12345-192.168.206.44@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788684558.972932:0:22726:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788684558.972954:0:22726:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d6647890c00/0x44bac02bd54ae27f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xb726964c63ed40dc expref: -99 pid: 22726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684558.973010:0:22726:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d6647890c00/0x44bac02bd54ae27f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.206.44@tcp remote: 0xb726964c63ed40dc expref: 13 pid: 22726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684558.973023:0:22726:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d6647890c00/0x44bac02bd54ae27f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.206.44@tcp remote: 0xb726964c63ed40dc expref: 13 pid: 22726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684558.973033:0:22726:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d6647890c00, rc 0) 00000100:00100000:3.0:1788684558.973124:0:22726:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d677ccde850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:9f969391-6479-4864-94e2-df3227346f88+13:18066:x1875571073245056:12345-192.168.206.44@tcp:101:ll_cfg_requeue.0 Request processed in 224us (470us total) trans 0 rc 0/0 00000100:00100000:3.0:1788684558.973139:0:22726:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 151 00000100:00100000:0.0:1788684558.976839:0:3626:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788684558.976878:0:3626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d677fab7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3626:1875571085935872:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788684558.978782:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788684558.979065:0:24242:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085935872 00000100:00100000:3.0:1788684558.979076:0:24242:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085935872 00000100:00100000:3.0:1788684558.979191:0:24242:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1788684558.979203:0:24242:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d66477eea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3626:x1875571085935872:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1788684558.979242:0:24242:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:3.0:1788684558.979324:0:24242:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d66477eea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3626:x1875571085935872:12345-0@lo:13:osp-pre-0-1.0 Request processed in 124us (551us total) trans 0 rc 0/0 00000100:00100000:3.0:1788684558.979331:0:24242:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1788684558.979533:0:3626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d677fab7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3626:1875571085935872:0@lo:13:osp-pre-0-1.0 00000100:00080000:2.0:1788684558.979869:0:22728:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788684558.995584:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:3.0:1788684558.996203:0:22725:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073245184 00000100:00100000:3.0:1788684558.996215:0:22725:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073245184 00000100:00100000:3.0:1788684558.996290:0:22725:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 152 00000100:00100000:3.0:1788684558.996301:0:22725:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d677ccdc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9f969391-6479-4864-94e2-df3227346f88+13:18066:x1875571073245184:12345-192.168.206.44@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788684558.996529:0:22725:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d677ccdc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:9f969391-6479-4864-94e2-df3227346f88+13:18066:x1875571073245184:12345-192.168.206.44@tcp:501:ll_cfg_requeue.0 Request processed in 228us (958us total) trans 0 rc 0/0 00000100:00100000:3.0:1788684558.996538:0:22725:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 152 00000100:00100000:0.0:1788684559.000200:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:2.0:1788684559.000299:0:22727:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073245312 00000100:00100000:2.0:1788684559.000310:0:22727:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073245312 00000100:00100000:2.0:1788684559.000407:0:22727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 153 00000100:00100000:2.0:1788684559.000418:0:22727:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d677ccdfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9f969391-6479-4864-94e2-df3227346f88+13:18066:x1875571073245312:12345-192.168.206.44@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788684559.000589:0:22727:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d677ccdfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9f969391-6479-4864-94e2-df3227346f88+13:18066:x1875571073245312:12345-192.168.206.44@tcp:503:ll_cfg_requeue.0 Request processed in 172us (403us total) trans 0 rc 0/0 00000100:00100000:2.0:1788684559.000598:0:22727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 153 00010000:00010000:3.0:1788684559.037792:0:22720:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788684559.593486:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:0.0:1788684559.594230:0:22732:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073245440 00000100:00100000:0.0:1788684559.594245:0:22732:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073245440 00000100:00100000:0.0:1788684559.594342:0:22732:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 23 00000100:00100000:0.0:1788684559.594354:0:22732:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d677fab7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4099400f-835c-46aa-bd1f-63cdd511e591+6:18686:x1875571073245440:12345-192.168.206.44@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788684559.594408:0:22732:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788684559.594436:0:22732:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d6765f61200/0x44bac02bd54ae286 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb726964c63ed40e3 expref: -99 pid: 22732 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1788684559.594499:0:22728:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1788684559.594517:0:22732:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d6765f61600/0x44bac02bd54ae28d lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 22732 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684559.594533:0:22732:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d6765f61600/0x44bac02bd54ae28d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22732 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684559.594544:0:22732:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d6765f61600/0x44bac02bd54ae28d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22732 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684559.594559:0:22732:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d6765f60400/0x44bac02bd54ae294 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 22732 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684559.594584:0:22732:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d6765f60400/0x44bac02bd54ae294 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22732 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684559.594590:0:22732:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d6765f60400/0x44bac02bd54ae294 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22732 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684559.594692:0:22732:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d6765f60a00/0x44bac02bd54ae29b lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 22732 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684559.594702:0:22732:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d6765f60a00/0x44bac02bd54ae29b lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22732 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684559.594710:0:22732:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d6765f60a00/0x44bac02bd54ae29b lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22732 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788684559.594745:0:22732:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1788684559.594750:0:22732:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788684559.594795:0:22732:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d6765f60a00/0x44bac02bd54ae29b lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22732 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684559.594807:0:22732:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d6765f61600/0x44bac02bd54ae28d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22732 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684559.594815:0:22732:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d6765f61600/0x44bac02bd54ae28d lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 22732 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684559.594822:0:22732:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d6765f61600/0x44bac02bd54ae28d lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22732 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684559.594828:0:22732:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d6765f61600 already unused, calling callback (ffffffffc18a84f0) 00010000:00010000:0.0:1788684559.594832:0:22732:0:(ldlm_request.c:377:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d6765f61600/0x44bac02bd54ae28d lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22732 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684559.594847:0:22732:0:(ldlm_request.c:1415:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d6765f61600/0x44bac02bd54ae28d lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 22732 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684559.594862:0:22732:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d6743f73d00) 00010000:00010000:0.0:1788684559.594865:0:22732:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788684559.594871:0:22732:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d6765f61600/0x44bac02bd54ae28d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22732 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684559.594878:0:22732:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d6765f61600/0x44bac02bd54ae28d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22732 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684559.594893:0:22732:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d6765f60400/0x44bac02bd54ae294 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22732 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684559.594899:0:22732:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d6765f60400/0x44bac02bd54ae294 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 22732 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684559.594904:0:22732:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d6765f60400/0x44bac02bd54ae294 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22732 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684559.594909:0:22732:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d6765f60400 already unused, calling callback (ffffffffc18a84f0) 00010000:00010000:0.0:1788684559.594922:0:22732:0:(ldlm_request.c:377:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d6765f60400/0x44bac02bd54ae294 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22732 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684559.594928:0:22732:0:(ldlm_request.c:1415:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d6765f60400/0x44bac02bd54ae294 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 22732 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684559.594937:0:22732:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffff8d6743f73500) 00010000:00010000:0.0:1788684559.594939:0:22732:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788684559.594943:0:22732:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d6765f60400/0x44bac02bd54ae294 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22732 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684559.594959:0:22732:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d6765f60400/0x44bac02bd54ae294 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22732 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684559.594999:0:22732:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d6765f61200/0x44bac02bd54ae286 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.44@tcp remote: 0xb726964c63ed40e3 expref: 8 pid: 22732 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684559.595012:0:22732:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d6765f60a00/0x44bac02bd54ae29b lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.44@tcp remote: 0xb726964c63ed40e3 expref: 7 pid: 22732 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684559.595019:0:22732:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff8d6743f73c00) 00010000:00010000:0.0:1788684559.595022:0:22732:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788684559.595025:0:22732:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d6765f60a00, rc 0) 00000100:00100000:0.0:1788684559.596684:0:22732:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d677fab7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4099400f-835c-46aa-bd1f-63cdd511e591+7:18686:x1875571073245440:12345-192.168.206.44@tcp:101:lhsmtool_posix.0 Request processed in 2318us (3199us total) trans 0 rc 0/0 00000100:00100000:0.0:1788684559.596699:0:22732:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 23 00000100:00100000:0.0:1788684559.602870:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:2.0:1788684559.603052:0:22744:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073245568 00000100:00100000:2.0:1788684559.603065:0:22744:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073245568 00000100:00100000:2.0:1788684559.603140:0:22744:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 5 00000100:00100000:2.0:1788684559.603152:0:22744:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d66477eca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:4099400f-835c-46aa-bd1f-63cdd511e591+7:18686:x1875571073245568:12345-192.168.206.44@tcp:900:lhsmtool_posix.0 00000100:00100000:2.0:1788684559.603409:0:22744:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d66477eca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:4099400f-835c-46aa-bd1f-63cdd511e591+7:18686:x1875571073245568:12345-192.168.206.44@tcp:900:lhsmtool_posix.0 Request processed in 258us (564us total) trans 0 rc 0/0 00000100:00100000:2.0:1788684559.603418:0:22744:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 5 00000100:00100000:2.0:1788684559.612600:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:3.0:1788684559.612707:0:22733:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073245824 00000100:00100000:3.0:1788684559.612718:0:22733:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073245824 00000100:00100000:3.0:1788684559.612843:0:22733:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 24 00000100:00100000:3.0:1788684559.612870:0:22733:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6647a61f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4099400f-835c-46aa-bd1f-63cdd511e591+7:18686:x1875571073245824:12345-192.168.206.44@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788684559.612903:0:22733:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788684559.612951:0:22733:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d6647890a00/0x44bac02bd54ae2a2 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb726964c63ed40ea expref: -99 pid: 22733 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684559.613826:0:22733:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d6647890000/0x44bac02bd54ae2a9 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 22733 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684559.613852:0:22733:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d6647890000/0x44bac02bd54ae2a9 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22733 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684559.613867:0:22733:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d6647890000/0x44bac02bd54ae2a9 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22733 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684559.613885:0:22733:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d6647891a00/0x44bac02bd54ae2b0 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 22733 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684559.613893:0:22733:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d6647891a00/0x44bac02bd54ae2b0 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22733 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684559.613900:0:22733:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d6647891a00/0x44bac02bd54ae2b0 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22733 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684559.614063:0:22733:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d6647891600/0x44bac02bd54ae2b7 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 22733 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684559.614073:0:22733:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d6647891600/0x44bac02bd54ae2b7 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22733 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684559.614099:0:22733:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d6647891600/0x44bac02bd54ae2b7 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22733 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788684559.614111:0:22733:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 4096 00010000:00010000:3.0:1788684559.614510:0:22733:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d6647890000/0x44bac02bd54ae2a9 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22733 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684559.614520:0:22733:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d6647890000/0x44bac02bd54ae2a9 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 22733 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684559.614526:0:22733:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d6647890000/0x44bac02bd54ae2a9 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 22733 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684559.614533:0:22733:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d6647890000 already unused, calling callback (ffffffffc18a84f0) 00010000:00010000:3.0:1788684559.614538:0:22733:0:(ldlm_request.c:377:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d6647890000/0x44bac02bd54ae2a9 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 22733 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684559.614546:0:22733:0:(ldlm_request.c:1415:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d6647890000/0x44bac02bd54ae2a9 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 22733 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684559.614561:0:22733:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff8d6743f73c00) 00010000:00010000:3.0:1788684559.614565:0:22733:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788684559.614571:0:22733:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d6647890000/0x44bac02bd54ae2a9 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 22733 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684559.614577:0:22733:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d6647890000/0x44bac02bd54ae2a9 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 22733 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684559.614594:0:22733:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d6647891a00/0x44bac02bd54ae2b0 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22733 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684559.614600:0:22733:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d6647891a00/0x44bac02bd54ae2b0 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 22733 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684559.614613:0:22733:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d6647891a00/0x44bac02bd54ae2b0 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22733 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684559.614619:0:22733:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d6647891a00 already unused, calling callback (ffffffffc18a84f0) 00010000:00010000:3.0:1788684559.614623:0:22733:0:(ldlm_request.c:377:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d6647891a00/0x44bac02bd54ae2b0 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22733 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684559.614630:0:22733:0:(ldlm_request.c:1415:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d6647891a00/0x44bac02bd54ae2b0 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 22733 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684559.614639:0:22733:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff8d6750b6ae00) 00010000:00010000:3.0:1788684559.614641:0:22733:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788684559.614644:0:22733:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d6647891a00/0x44bac02bd54ae2b0 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22733 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684559.614650:0:22733:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d6647891a00/0x44bac02bd54ae2b0 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22733 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684559.620165:0:22733:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d6647890a00/0x44bac02bd54ae2a2 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.44@tcp remote: 0xb726964c63ed40ea expref: 10 pid: 22733 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684559.620195:0:22733:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d6647891600/0x44bac02bd54ae2b7 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.44@tcp remote: 0xb726964c63ed40ea expref: 9 pid: 22733 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684559.620206:0:22733:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8d6750b6a100) 00010000:00010000:3.0:1788684559.620209:0:22733:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788684559.620212:0:22733:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d6647891600, rc 0) 00000100:00100000:3.0:1788684559.620300:0:22733:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6647a61f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4099400f-835c-46aa-bd1f-63cdd511e591+9:18686:x1875571073245824:12345-192.168.206.44@tcp:101:lhsmtool_posix.0 Request processed in 7444us (7714us total) trans 12884901889 rc 0/0 00000100:00100000:3.0:1788684559.620319:0:22733:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 24 00000100:00100000:1.0:1788684559.624064:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:2.0:1788684559.629305:0:22734:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073245952 00000100:00100000:2.0:1788684559.629320:0:22734:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073245952 00000100:00100000:2.0:1788684559.629468:0:22734:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 25 00000100:00100000:2.0:1788684559.629484:0:22734:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d677fab4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4099400f-835c-46aa-bd1f-63cdd511e591+9:18686:x1875571073245952:12345-192.168.206.44@tcp:59:lhsmtool_posix.0 00000100:00100000:2.0:1788684559.629632:0:22734:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d677fab4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4099400f-835c-46aa-bd1f-63cdd511e591+9:18686:x1875571073245952:12345-192.168.206.44@tcp:59:lhsmtool_posix.0 Request processed in 154us (5575us total) trans 0 rc 0/0 00000100:00100000:2.0:1788684559.629641:0:22734:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 25 00000100:00100000:0.0:1788684559.643538:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:0.0:1788684559.643580:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:3.0:1788684559.643654:0:22733:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073246080 00000100:00100000:3.0:1788684559.643664:0:22733:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073246080 00000100:00100000:3.0:1788684559.643738:0:22733:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073246208 00000100:00100000:3.0:1788684559.643742:0:22733:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073246208 00000100:00100000:3.0:1788684559.643763:0:22733:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 26 00000100:00100000:3.0:1788684559.643774:0:22733:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d66477ec700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4099400f-835c-46aa-bd1f-63cdd511e591+5:18686:x1875571073246080:12345-192.168.206.44@tcp:59:lhsmtool_posix.0 00000100:00100000:1.0:1788684559.643822:0:22732:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 27 00000100:00100000:1.0:1788684559.643845:0:22732:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d66477edf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4099400f-835c-46aa-bd1f-63cdd511e591+9:18692:x1875571073246208:12345-192.168.206.44@tcp:101:lfs.0 00010000:00010000:1.0:1788684559.643873:0:22732:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788684559.643900:0:22732:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d66477b1000/0x44bac02bd54ae2c5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb726964c63ed40f1 expref: -99 pid: 22732 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1788684559.643956:0:22728:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:1.0:1788684559.643978:0:22732:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d66477b1800/0x44bac02bd54ae2cc lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 22732 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684559.643991:0:22732:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d66477b1800/0x44bac02bd54ae2cc lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22732 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684559.644004:0:22732:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d66477b1800/0x44bac02bd54ae2cc lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22732 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1788684559.647126:0:22733:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0001: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0001 0, time 3269us 00010000:00010000:1.0:1788684559.653146:0:22732:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d66477b1e00/0x44bac02bd54ae2d3 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 22732 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684559.653188:0:22732:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d66477b1e00/0x44bac02bd54ae2d3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22732 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684559.653203:0:22732:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d66477b1e00/0x44bac02bd54ae2d3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22732 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684559.653259:0:22732:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d66477b1800/0x44bac02bd54ae2cc lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22732 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684559.653268:0:22732:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d66477b1800/0x44bac02bd54ae2cc lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 22732 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684559.653277:0:22732:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d66477b1800/0x44bac02bd54ae2cc lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22732 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684559.653284:0:22732:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d66477b1800 already unused, calling callback (ffffffffc18a84f0) 00010000:00010000:1.0:1788684559.653289:0:22732:0:(ldlm_request.c:377:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d66477b1800/0x44bac02bd54ae2cc lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22732 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684559.653297:0:22732:0:(ldlm_request.c:1415:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d66477b1800/0x44bac02bd54ae2cc lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 22732 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684559.653313:0:22732:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d6743f73d00) 00010000:00010000:1.0:1788684559.653317:0:22732:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788684559.653323:0:22732:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d66477b1800/0x44bac02bd54ae2cc lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22732 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684559.653331:0:22732:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d66477b1800/0x44bac02bd54ae2cc lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22732 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684559.653346:0:22732:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d66477b1e00/0x44bac02bd54ae2d3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22732 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684559.653359:0:22732:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d66477b1e00/0x44bac02bd54ae2d3 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 22732 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684559.653383:0:22732:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d66477b1e00/0x44bac02bd54ae2d3 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22732 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684559.653389:0:22732:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d66477b1e00 already unused, calling callback (ffffffffc18a84f0) 00010000:00010000:1.0:1788684559.653393:0:22732:0:(ldlm_request.c:377:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d66477b1e00/0x44bac02bd54ae2d3 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22732 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684559.653401:0:22732:0:(ldlm_request.c:1415:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d66477b1e00/0x44bac02bd54ae2d3 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 22732 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684559.653411:0:22732:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa6028a67 (ffff8d6641867e00) 00010000:00010000:1.0:1788684559.653414:0:22732:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788684559.653417:0:22732:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d66477b1e00/0x44bac02bd54ae2d3 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22732 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684559.653424:0:22732:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d66477b1e00/0x44bac02bd54ae2d3 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22732 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684559.653473:0:22732:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d66477b1000/0x44bac02bd54ae2c5 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.44@tcp remote: 0xb726964c63ed40f1 expref: 10 pid: 22732 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684559.653485:0:22732:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d6743f73d00) 00010000:00010000:1.0:1788684559.653487:0:22732:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788684559.653491:0:22732:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d66477b1000/0x44bac02bd54ae2c5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.44@tcp remote: 0xb726964c63ed40f1 expref: 10 pid: 22732 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684559.653513:0:22732:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d66477b1000, rc 0) 00000100:00100000:1.0:1788684559.653582:0:22732:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d66477edf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4099400f-835c-46aa-bd1f-63cdd511e591+9:18692:x1875571073246208:12345-192.168.206.44@tcp:101:lfs.0 Request processed in 9747us (9999us total) trans 0 rc 301/301 00000100:00100000:1.0:1788684559.653592:0:22732:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 27 00000100:00100000:2.0:1788684559.661166:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:3.0:1788684559.661264:0:22741:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073246336 00000100:00100000:3.0:1788684559.661275:0:22741:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073246336 00000100:00100000:3.0:1788684559.661330:0:22741:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 0 00000100:00100000:3.0:1788684559.661341:0:22741:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6647a62d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:4099400f-835c-46aa-bd1f-63cdd511e591+9:18692:x1875571073246336:12345-192.168.206.44@tcp:700:lfs.0 00000100:00100000:3.0:1788684559.661451:0:22741:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6647a62d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:4099400f-835c-46aa-bd1f-63cdd511e591+9:18692:x1875571073246336:12345-192.168.206.44@tcp:700:lfs.0 Request processed in 111us (293us total) trans 0 rc 0/0 00000100:00100000:3.0:1788684559.661459:0:22741:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 0 00000100:00100000:1.0:1788684559.670005:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:0.0:1788684559.670746:0:23765:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073246592 00000100:00100000:0.0:1788684559.670758:0:23765:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073246592 00000100:00100000:0.0:1788684559.670837:0:23765:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 28 00000100:00100000:0.0:1788684559.670848:0:23765:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d677fab6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4099400f-835c-46aa-bd1f-63cdd511e591+9:18692:x1875571073246592:12345-192.168.206.44@tcp:36:lfs.0 00010000:00010000:0.0:1788684559.670924:0:23765:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788684559.670953:0:23765:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d6765f61c00/0x44bac02bd54ae22b lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.44@tcp remote: 0xb726964c63ed405e expref: 9 pid: 22733 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684559.670994:0:23765:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d6743f73d00) 00010000:00010000:0.0:1788684559.670999:0:23765:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788684559.671065:0:23765:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d6765f61600/0x44bac02bd54ae2da lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 23765 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684559.671079:0:23765:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d4400/0x44bac02bd54ae26a lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.44@tcp remote: 0xb726964c63ed40ce expref: 5 pid: 23765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684559.671088:0:23765:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d6765f61600/0x44bac02bd54ae2da lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 23765 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684559.671125:0:23765:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d4400/0x44bac02bd54ae26a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.44@tcp remote: 0xb726964c63ed40ce expref: 5 pid: 23765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684559.671140:0:23765:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d4400/0x44bac02bd54ae26a lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.44@tcp remote: 0xb726964c63ed40ce expref: 5 pid: 23765 timeout: 740 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788684559.671153:0:23765:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d66477ec000 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:23765:1875571085936000:192.168.206.44@tcp:104: 00000100:00100000:0.0:1788684559.671246:0:23765:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d677e2b6c00 going to sleep for 11 seconds 00000100:00100000:2.0:1788684559.676493:0:23765:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d66477ec000 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:23765:1875571085936000:192.168.206.44@tcp:104: 00010000:00010000:2.0:1788684559.676525:0:23765:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8d6765f61600/0x44bac02bd54ae2da lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 23765 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788684559.677307:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:2.0:1788684559.677408:0:22719:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073246720 00000100:00100000:2.0:1788684559.677416:0:22719:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073246720 00010000:00010000:2.0:1788684559.677469:0:22719:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d4400/0x44bac02bd54ae26a lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.44@tcp remote: 0xb726964c63ed40ce expref: 6 pid: 23765 timeout: 740 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788684559.677502:0:22719:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 15 00000100:00100000:2.0:1788684559.677512:0:22719:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d677fab6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0e62701e-7d60-4e2d-bd52-05ee75d6c929+6:2390:x1875571073246720:12345-192.168.206.44@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788684559.677527:0:22719:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788684559.677534:0:22719:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d4400/0x44bac02bd54ae26a lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.44@tcp remote: 0xb726964c63ed40ce expref: 6 pid: 23765 timeout: 740 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684559.677559:0:22719:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d4400/0x44bac02bd54ae26a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.44@tcp remote: 0xb726964c63ed40ce expref: 6 pid: 23765 timeout: 740 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684559.677581:0:22719:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d4400/0x44bac02bd54ae26a lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.44@tcp remote: 0xb726964c63ed40ce expref: 6 pid: 23765 timeout: 740 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684559.677596:0:22719:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d6743f73d00) 00010000:00010000:2.0:1788684559.677613:0:22719:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8d6765f61600/0x44bac02bd54ae2da lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 23765 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684559.677622:0:22719:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d6765f61600/0x44bac02bd54ae2da lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 23765 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684559.677630:0:22719:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d6765f61600/0x44bac02bd54ae2da lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 23765 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684559.677653:0:22719:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788684559.677697:0:22719:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d677fab6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0e62701e-7d60-4e2d-bd52-05ee75d6c929+5:2390:x1875571073246720:12345-192.168.206.44@tcp:103:ldlm_bl.0 Request processed in 187us (393us total) trans 0 rc 0/0 00000100:00100000:2.0:1788684559.677704:0:22719:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 15 00010000:00010000:2.0:1788684559.677796:0:23765:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8d6765f61600/0x44bac02bd54ae2da lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 23765 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684559.677805:0:23765:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d6765f61600/0x44bac02bd54ae2da lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 23765 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684559.677827:0:23765:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d4000/0x44bac02bd54ae2e1 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 23765 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684559.677838:0:23765:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d4000/0x44bac02bd54ae2e1 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 23765 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684559.677846:0:23765:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d4000/0x44bac02bd54ae2e1 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 23765 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788684559.678004:0:22768:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00080000:1.0:1788684559.678265:0:22728:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1788684559.679797:0:23765:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d4800/0x44bac02bd54ae2e8 lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 23765 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684559.679816:0:23765:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d4800/0x44bac02bd54ae2e8 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 23765 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684559.679832:0:23765:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d4800/0x44bac02bd54ae2e8 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 23765 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788684559.679849:0:23765:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000748f55fa reply state 00000000ca6507a9 transno 12884901890 ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d4800/0x44bac02bd54ae2e8 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 23765 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684559.679861:0:23765:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d4800/0x44bac02bd54ae2e8 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 23765 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684559.679868:0:23765:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff8d664770ff00) 00010000:00010000:2.0:1788684559.679871:0:23765:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788684559.679875:0:23765:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:2.0:1788684559.679881:0:23765:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 4096 00010000:00010000:2.0:1788684559.679890:0:23765:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d6765f61600/0x44bac02bd54ae2da lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 23765 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684559.679897:0:23765:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d6765f61600/0x44bac02bd54ae2da lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 23765 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684559.679905:0:23765:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d6765f61600/0x44bac02bd54ae2da lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 23765 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684559.679923:0:23765:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d6765f61600 already unused, calling callback (ffffffffc18a84f0) 00010000:00010000:2.0:1788684559.679928:0:23765:0:(ldlm_request.c:377:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d6765f61600/0x44bac02bd54ae2da lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 23765 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684559.679935:0:23765:0:(ldlm_request.c:1415:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d6765f61600/0x44bac02bd54ae2da lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 23765 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684559.679946:0:23765:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d6743f73d00) 00010000:00010000:2.0:1788684559.679948:0:23765:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788684559.679959:0:23765:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d6765f61600/0x44bac02bd54ae2da lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 23765 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684559.679966:0:23765:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d6765f61600/0x44bac02bd54ae2da lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 23765 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788684559.679985:0:23765:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000748f55fa reply state 00000000ca6507a9 transno 12884901890 ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d4000/0x44bac02bd54ae2e1 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 23765 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684559.679994:0:23765:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d4000/0x44bac02bd54ae2e1 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 23765 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684559.680006:0:23765:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa6028a67 (ffff8d664770fd00) 00010000:00010000:2.0:1788684559.680008:0:23765:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788684559.680010:0:23765:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000100:00100000:2.0:1788684559.680105:0:23765:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d677fab6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4099400f-835c-46aa-bd1f-63cdd511e591+10:18692:x1875571073246592:12345-192.168.206.44@tcp:36:lfs.0 Request processed in 9256us (10107us total) trans 12884901890 rc 0/0 00000100:00100000:2.0:1788684559.680114:0:23765:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 28 00000100:00100000:0.0:1788684559.690739:0:22733:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d66477ec700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4099400f-835c-46aa-bd1f-63cdd511e591+5:18686:x1875571073246080:12345-192.168.206.44@tcp:59:lhsmtool_posix.0 Request processed in 46960us (47203us total) trans 0 rc 0/0 00000100:00100000:0.0:1788684559.690751:0:22733:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 26 10000000:01000000:0.0:1788684559.741495:0:22729:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1788684559.741503:0:22729:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8d6646627000 from 13 10000000:01000000:0.0:1788684559.741510:0:22729:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788684559.741561:0:22729:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.144@tcp lock: ffff8d6765f61c00/0x44bac02bd54ae2ef lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684559.741592:0:22729:0:(ldlm_request.c:1106:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.144@tcp lock: ffff8d6765f61c00/0x44bac02bd54ae2ef lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684559.741616:0:22729:0:(ldlm_request.c:1193:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.144@tcp lock: ffff8d6765f61c00/0x44bac02bd54ae2ef lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788684559.741643:0:22729:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d66477ef800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cebd1789-51a4-46ff-b167-6b1633e930a1:22729:1875571085936128:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788684559.741713:0:22729:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788684559.741816:0:22729:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d677e2b6240 going to sleep for 11 seconds 00000100:00100000:2.0:1788684559.743973:0:22726:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085936128 00000100:00100000:2.0:1788684559.743986:0:22726:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085936128 00000100:00100000:2.0:1788684559.744044:0:22726:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:2.0:1788684559.744053:0:22726:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d677ccdc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cebd1789-51a4-46ff-b167-6b1633e930a1+20:22729:x1875571085936128:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788684559.744069:0:22726:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788684559.744088:0:22726:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d66476d4400/0x44bac02bd54ae2f6 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x44bac02bd54ae2ef expref: -99 pid: 22726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684559.744115:0:22726:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d66476d4400/0x44bac02bd54ae2f6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x44bac02bd54ae2ef expref: 21 pid: 22726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684559.744193:0:22726:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d66476d4400/0x44bac02bd54ae2f6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x44bac02bd54ae2ef expref: 21 pid: 22726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684559.744221:0:22726:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d66476d4400, rc 0) 00000100:00100000:2.0:1788684559.744391:0:22726:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d677ccdc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cebd1789-51a4-46ff-b167-6b1633e930a1+21:22729:x1875571085936128:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 312us (2651us total) trans 0 rc 0/0 00000100:00100000:2.0:1788684559.744398:0:22726:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:1.0:1788684559.749212:0:22729:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d66477ef800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cebd1789-51a4-46ff-b167-6b1633e930a1:22729:1875571085936128:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788684559.749246:0:22729:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.144@tcp lock: ffff8d6765f61c00/0x44bac02bd54ae2ef lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x44bac02bd54ae2f6 expref: -99 pid: 22729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684559.749259:0:22729:0:(ldlm_request.c:840:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.144@tcp lock: ffff8d6765f61c00/0x44bac02bd54ae2ef lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x44bac02bd54ae2f6 expref: -99 pid: 22729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788684559.749994:0:22729:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6647a62300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cebd1789-51a4-46ff-b167-6b1633e930a1:22729:1875571085936256:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788684559.750058:0:22729:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788684559.750191:0:22729:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d6777317000 going to sleep for 11 seconds 00000100:00100000:3.0:1788684559.752979:0:22725:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085936256 00000100:00100000:3.0:1788684559.752993:0:22725:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085936256 00000100:00100000:2.0:1788684559.753972:0:22725:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:2.0:1788684559.753986:0:22725:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6746cac450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cebd1789-51a4-46ff-b167-6b1633e930a1+21:22729:x1875571085936256:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788684559.754175:0:22725:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6746cac450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cebd1789-51a4-46ff-b167-6b1633e930a1+21:22729:x1875571085936256:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 191us (4116us total) trans 0 rc 0/0 00000100:00100000:2.0:1788684559.754184:0:22725:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:0.0:1788684559.754278:0:22729:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6647a62300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cebd1789-51a4-46ff-b167-6b1633e930a1:22729:1875571085936256:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788684559.754336:0:22729:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d66477ef800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cebd1789-51a4-46ff-b167-6b1633e930a1:22729:1875571085936384:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788684559.754423:0:22729:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788684559.770728:0:22729:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d677e2b6b40 going to sleep for 11 seconds 00000100:00100000:3.0:1788684559.770920:0:22726:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085936384 00000100:00100000:3.0:1788684559.770931:0:22726:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085936384 00000100:00100000:3.0:1788684559.770984:0:22726:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:3.0:1788684559.770994:0:22726:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6746cad050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cebd1789-51a4-46ff-b167-6b1633e930a1+21:22729:x1875571085936384:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788684559.771151:0:22726:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6746cad050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cebd1789-51a4-46ff-b167-6b1633e930a1+21:22729:x1875571085936384:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 158us (16726us total) trans 0 rc 0/0 00000100:00100000:3.0:1788684559.771159:0:22726:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:0.0:1788684559.771456:0:22729:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d66477ef800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cebd1789-51a4-46ff-b167-6b1633e930a1:22729:1875571085936384:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1788684559.772530:0:25773:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:0.0:1788684559.773157:0:22729:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:0.0:1788684559.773180:0:22729:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.144@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788684559.773190:0:22729:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.144@tcp lock: ffff8d6765f61c00/0x44bac02bd54ae2ef lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x44bac02bd54ae2f6 expref: -99 pid: 22729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684559.773200:0:22729:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.144@tcp lock: ffff8d6765f61c00/0x44bac02bd54ae2ef lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x44bac02bd54ae2f6 expref: -99 pid: 22729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788684559.773211:0:22729:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1788684559.773213:0:22729:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8d6647988800 from 13 10000000:01000000:0.0:1788684559.773216:0:22729:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788684559.773250:0:22729:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.144@tcp lock: ffff8d6765f61400/0x44bac02bd54ae2fd lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684559.773270:0:22729:0:(ldlm_request.c:1106:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.144@tcp lock: ffff8d6765f61400/0x44bac02bd54ae2fd lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684559.773281:0:22729:0:(ldlm_request.c:1193:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.144@tcp lock: ffff8d6765f61400/0x44bac02bd54ae2fd lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788684559.773304:0:22729:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d66477ef800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cebd1789-51a4-46ff-b167-6b1633e930a1:22729:1875571085936512:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788684559.773358:0:22729:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788684559.773410:0:22729:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d677e2b6b40 going to sleep for 11 seconds 00000100:00100000:3.0:1788684559.773880:0:22726:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085936512 00000100:00100000:3.0:1788684559.773895:0:22726:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085936512 00000100:00100000:3.0:1788684559.773949:0:22726:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:3.0:1788684559.773958:0:22726:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6746caf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cebd1789-51a4-46ff-b167-6b1633e930a1+21:22729:x1875571085936512:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788684559.773971:0:22726:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788684559.773984:0:22726:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d6647890a00/0x44bac02bd54ae304 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x44bac02bd54ae2fd expref: -99 pid: 22726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684559.774007:0:22726:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d6647890a00/0x44bac02bd54ae304 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x44bac02bd54ae2fd expref: 22 pid: 22726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684559.774018:0:22726:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d6647890a00/0x44bac02bd54ae304 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x44bac02bd54ae2fd expref: 22 pid: 22726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684559.774027:0:22726:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d6647890a00, rc 0) 00000100:00100000:3.0:1788684559.774067:0:22726:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6746caf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cebd1789-51a4-46ff-b167-6b1633e930a1+22:22729:x1875571085936512:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 111us (709us total) trans 0 rc 0/0 00000100:00100000:3.0:1788684559.774075:0:22726:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:3.0:1788684559.776276:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:0.0:1788684559.776492:0:22729:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d66477ef800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cebd1789-51a4-46ff-b167-6b1633e930a1:22729:1875571085936512:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788684559.776520:0:22729:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.144@tcp lock: ffff8d6765f61400/0x44bac02bd54ae2fd lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x44bac02bd54ae304 expref: -99 pid: 22729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684559.776533:0:22729:0:(ldlm_request.c:840:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.144@tcp lock: ffff8d6765f61400/0x44bac02bd54ae2fd lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x44bac02bd54ae304 expref: -99 pid: 22729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788684559.776620:0:22729:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d66477ef800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cebd1789-51a4-46ff-b167-6b1633e930a1:22729:1875571085936640:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788684559.776662:0:22729:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788684559.776696:0:22729:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d677e2b6b40 going to sleep for 11 seconds 00000100:00100000:0.0:1788684559.776729:0:22732:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073246848 00000100:00100000:0.0:1788684559.776735:0:22732:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073246848 00000100:00100000:0.0:1788684559.776779:0:22732:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 29 00000100:00100000:0.0:1788684559.776788:0:22732:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d664876f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4099400f-835c-46aa-bd1f-63cdd511e591+10:18700:x1875571073246848:12345-192.168.206.44@tcp:101:lctl.0 00010000:00010000:0.0:1788684559.776807:0:22732:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788684559.776843:0:22732:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d6765f60e00/0x44bac02bd54ae30b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb726964c63ed40f8 expref: -99 pid: 22732 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684559.776935:0:22732:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d6765f60800/0x44bac02bd54ae312 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 22732 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684559.776948:0:22732:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d6765f60800/0x44bac02bd54ae312 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22732 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684559.776961:0:22732:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d6765f60800/0x44bac02bd54ae312 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22732 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788684559.777000:0:22732:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1788684559.777004:0:22732:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788684559.777040:0:22732:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d6765f60800/0x44bac02bd54ae312 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22732 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684559.777066:0:22732:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d6765f60e00/0x44bac02bd54ae30b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.44@tcp remote: 0xb726964c63ed40f8 expref: 12 pid: 22732 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684559.777084:0:22732:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d6765f60800/0x44bac02bd54ae312 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.44@tcp remote: 0xb726964c63ed40f8 expref: 11 pid: 22732 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684559.777094:0:22732:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d6743f73e00) 00010000:00010000:0.0:1788684559.777097:0:22732:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788684559.777101:0:22732:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d6765f60800, rc 0) 00000100:00100000:3.0:1788684559.777487:0:22726:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085936640 00000100:00100000:3.0:1788684559.777496:0:22726:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085936640 00000100:00100000:3.0:1788684559.777531:0:22726:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:3.0:1788684559.777538:0:22726:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6746cacc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cebd1789-51a4-46ff-b167-6b1633e930a1+22:22729:x1875571085936640:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788684559.777656:0:22726:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6746cacc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cebd1789-51a4-46ff-b167-6b1633e930a1+22:22729:x1875571085936640:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 117us (992us total) trans 0 rc 0/0 00000100:00100000:3.0:1788684559.777664:0:22726:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:0.0:1788684559.777845:0:22732:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d664876f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4099400f-835c-46aa-bd1f-63cdd511e591+11:18700:x1875571073246848:12345-192.168.206.44@tcp:101:lctl.0 Request processed in 1057us (1577us total) trans 0 rc 0/0 00000100:00100000:0.0:1788684559.777853:0:22732:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 29 00000100:00100000:0.0:1788684559.777890:0:22729:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d66477ef800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cebd1789-51a4-46ff-b167-6b1633e930a1:22729:1875571085936640:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788684559.777938:0:22729:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d66477ef800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cebd1789-51a4-46ff-b167-6b1633e930a1:22729:1875571085936768:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788684559.777990:0:22729:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788684559.778026:0:22729:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d677e2b6b40 going to sleep for 11 seconds 00000100:00100000:1.0:1788684559.779650:0:22727:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085936768 00000100:00100000:1.0:1788684559.779664:0:22727:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085936768 00000100:00100000:1.0:1788684559.779734:0:22727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:1.0:1788684559.779744:0:22727:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6746caf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cebd1789-51a4-46ff-b167-6b1633e930a1+22:22729:x1875571085936768:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788684559.779909:0:22727:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6746caf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cebd1789-51a4-46ff-b167-6b1633e930a1+22:22729:x1875571085936768:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 166us (1917us total) trans 0 rc 0/0 00000100:00100000:1.0:1788684559.779930:0:22727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:0.0:1788684559.780152:0:22729:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d66477ef800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cebd1789-51a4-46ff-b167-6b1633e930a1:22729:1875571085936768:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1788684559.781308:0:25774:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:1.0:1788684559.781532:0:22729:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:1.0:1788684559.781551:0:22729:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.144@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788684559.781562:0:22729:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.144@tcp lock: ffff8d6765f61400/0x44bac02bd54ae2fd lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x44bac02bd54ae304 expref: -99 pid: 22729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684559.781586:0:22729:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.144@tcp lock: ffff8d6765f61400/0x44bac02bd54ae2fd lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x44bac02bd54ae304 expref: -99 pid: 22729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788684559.781597:0:22729:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1788684559.781600:0:22729:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8d6647429800 from 13 10000000:01000000:1.0:1788684559.781602:0:22729:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788684559.781639:0:22729:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.144@tcp lock: ffff8d66477b1e00/0x44bac02bd54ae319 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684559.781647:0:22729:0:(ldlm_request.c:1106:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.144@tcp lock: ffff8d66477b1e00/0x44bac02bd54ae319 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684559.781657:0:22729:0:(ldlm_request.c:1193:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.144@tcp lock: ffff8d66477b1e00/0x44bac02bd54ae319 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788684559.781678:0:22729:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d677fab4a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cebd1789-51a4-46ff-b167-6b1633e930a1:22729:1875571085936896:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788684559.781736:0:22729:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788684559.781780:0:22729:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d677e238d80 going to sleep for 11 seconds 00000100:00100000:0.0:1788684559.781894:0:22727:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085936896 00000100:00100000:0.0:1788684559.781901:0:22727:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085936896 00000100:00100000:0.0:1788684559.781957:0:22727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:0.0:1788684559.781967:0:22727:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6746cad850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cebd1789-51a4-46ff-b167-6b1633e930a1+22:22729:x1875571085936896:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788684559.781977:0:22727:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788684559.781990:0:22727:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d6765f61a00/0x44bac02bd54ae320 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x44bac02bd54ae319 expref: -99 pid: 22727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684559.782012:0:22727:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d6765f61a00/0x44bac02bd54ae320 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x44bac02bd54ae319 expref: 23 pid: 22727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684559.782022:0:22727:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d6765f61a00/0x44bac02bd54ae320 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x44bac02bd54ae319 expref: 23 pid: 22727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684559.782031:0:22727:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d6765f61a00, rc 0) 00000100:00100000:0.0:1788684559.782075:0:22727:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6746cad850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cebd1789-51a4-46ff-b167-6b1633e930a1+23:22729:x1875571085936896:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 110us (339us total) trans 0 rc 0/0 00000100:00100000:0.0:1788684559.782082:0:22727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:3.0:1788684559.782196:0:22729:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d677fab4a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cebd1789-51a4-46ff-b167-6b1633e930a1:22729:1875571085936896:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788684559.782212:0:22729:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.144@tcp lock: ffff8d66477b1e00/0x44bac02bd54ae319 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x44bac02bd54ae320 expref: -99 pid: 22729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684559.782227:0:22729:0:(ldlm_request.c:840:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.144@tcp lock: ffff8d66477b1e00/0x44bac02bd54ae319 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x44bac02bd54ae320 expref: -99 pid: 22729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788684559.782280:0:22729:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d664876f100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cebd1789-51a4-46ff-b167-6b1633e930a1:22729:1875571085937024:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788684559.782310:0:22729:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788684559.782334:0:22729:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d6750025cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1788684559.782473:0:22725:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085937024 00000100:00100000:1.0:1788684559.782477:0:22725:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085937024 00000100:00100000:1.0:1788684559.782514:0:22725:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:1.0:1788684559.782521:0:22725:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6746cac050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cebd1789-51a4-46ff-b167-6b1633e930a1+23:22729:x1875571085937024:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788684559.782630:0:22725:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6746cac050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cebd1789-51a4-46ff-b167-6b1633e930a1+23:22729:x1875571085937024:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 109us (318us total) trans 0 rc 0/0 00000100:00100000:1.0:1788684559.782637:0:22725:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:3.0:1788684559.782708:0:22729:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d664876f100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cebd1789-51a4-46ff-b167-6b1633e930a1:22729:1875571085937024:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788684559.782737:0:22729:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d664876f100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cebd1789-51a4-46ff-b167-6b1633e930a1:22729:1875571085937152:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788684559.782779:0:22729:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788684559.782809:0:22729:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d6750025cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1788684559.782822:0:22727:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085937152 00000100:00100000:3.0:1788684559.782897:0:22727:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085937152 00000100:00100000:3.0:1788684559.782933:0:22727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:3.0:1788684559.782940:0:22727:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6746caec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cebd1789-51a4-46ff-b167-6b1633e930a1+23:22729:x1875571085937152:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788684559.783026:0:22727:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6746caec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cebd1789-51a4-46ff-b167-6b1633e930a1+23:22729:x1875571085937152:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 87us (247us total) trans 0 rc 0/0 00000100:00100000:3.0:1788684559.783035:0:22727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00100000:3.0:1788684559.783076:0:22729:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d664876f100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cebd1789-51a4-46ff-b167-6b1633e930a1:22729:1875571085937152:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1788684559.785111:0:25775:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:3.0:1788684559.789492:0:22729:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:3.0:1788684559.789536:0:22729:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.144@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788684559.789549:0:22729:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.144@tcp lock: ffff8d66477b1e00/0x44bac02bd54ae319 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x44bac02bd54ae320 expref: -99 pid: 22729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684559.789562:0:22729:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.144@tcp lock: ffff8d66477b1e00/0x44bac02bd54ae319 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x44bac02bd54ae320 expref: -99 pid: 22729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788684559.789591:0:22729:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1788684559.789594:0:22729:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff8d677cb59000 from 13 10000000:01000000:3.0:1788684559.789597:0:22729:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788684559.789638:0:22729:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.206.144@tcp lock: ffff8d6647891a00/0x44bac02bd54ae327 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684559.789647:0:22729:0:(ldlm_request.c:1106:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.206.144@tcp lock: ffff8d6647891a00/0x44bac02bd54ae327 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684559.789657:0:22729:0:(ldlm_request.c:1193:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.206.144@tcp lock: ffff8d6647891a00/0x44bac02bd54ae327 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788684559.789681:0:22729:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d664876f100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cebd1789-51a4-46ff-b167-6b1633e930a1:22729:1875571085937280:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788684559.789746:0:22729:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788684559.789792:0:22729:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d6750025cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1788684559.789966:0:22727:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085937280 00000100:00100000:0.0:1788684559.789975:0:22727:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085937280 00000100:00100000:0.0:1788684559.790026:0:22727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:0.0:1788684559.790036:0:22727:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6746cac850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cebd1789-51a4-46ff-b167-6b1633e930a1+23:22729:x1875571085937280:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788684559.790049:0:22727:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788684559.790069:0:22727:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff8d6765f60c00/0x44bac02bd54ae32e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x44bac02bd54ae327 expref: -99 pid: 22727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684559.790092:0:22727:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff8d6765f60c00/0x44bac02bd54ae32e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x44bac02bd54ae327 expref: 24 pid: 22727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684559.790102:0:22727:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff8d6765f60c00/0x44bac02bd54ae32e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x44bac02bd54ae327 expref: 24 pid: 22727 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684559.790111:0:22727:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d6765f60c00, rc 0) 00000100:00100000:0.0:1788684559.790154:0:22727:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6746cac850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cebd1789-51a4-46ff-b167-6b1633e930a1+24:22729:x1875571085937280:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 119us (408us total) trans 0 rc 0/0 00000100:00100000:0.0:1788684559.790161:0:22727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00100000:2.0:1788684559.792475:0:22729:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d664876f100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cebd1789-51a4-46ff-b167-6b1633e930a1:22729:1875571085937280:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788684559.792503:0:22729:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.206.144@tcp lock: ffff8d6647891a00/0x44bac02bd54ae327 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x44bac02bd54ae32e expref: -99 pid: 22729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684559.792515:0:22729:0:(ldlm_request.c:840:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.206.144@tcp lock: ffff8d6647891a00/0x44bac02bd54ae327 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x44bac02bd54ae32e expref: -99 pid: 22729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788684559.792609:0:22729:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6647a63480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cebd1789-51a4-46ff-b167-6b1633e930a1:22729:1875571085937408:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788684559.792666:0:22729:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788684559.792706:0:22729:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d6777317240 going to sleep for 11 seconds 00000100:00100000:1.0:1788684559.792814:0:22725:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085937408 00000100:00100000:1.0:1788684559.792822:0:22725:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085937408 00000100:00100000:1.0:1788684559.792880:0:22725:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164 00000100:00100000:1.0:1788684559.792906:0:22725:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6746cadc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cebd1789-51a4-46ff-b167-6b1633e930a1+24:22729:x1875571085937408:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788684559.793027:0:22725:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6746cadc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cebd1789-51a4-46ff-b167-6b1633e930a1+24:22729:x1875571085937408:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 123us (360us total) trans 0 rc 0/0 00000100:00100000:1.0:1788684559.793036:0:22725:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164 00000100:00100000:2.0:1788684559.793397:0:22729:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6647a63480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cebd1789-51a4-46ff-b167-6b1633e930a1:22729:1875571085937408:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788684559.793430:0:22729:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6647a63480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cebd1789-51a4-46ff-b167-6b1633e930a1:22729:1875571085937536:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788684559.793479:0:22729:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788684559.793497:0:22729:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d6777317240 going to sleep for 11 seconds 00000100:00100000:2.0:1788684559.793509:0:22727:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085937536 00000100:00100000:2.0:1788684559.793513:0:22727:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085937536 00000100:00100000:2.0:1788684559.793541:0:22727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 165 00000100:00100000:2.0:1788684559.793547:0:22727:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6746cae050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cebd1789-51a4-46ff-b167-6b1633e930a1+24:22729:x1875571085937536:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788684559.793618:0:22727:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6746cae050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cebd1789-51a4-46ff-b167-6b1633e930a1+24:22729:x1875571085937536:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 69us (138us total) trans 0 rc 0/0 00000100:00100000:2.0:1788684559.793624:0:22727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 165 00000100:00100000:2.0:1788684559.793655:0:22729:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6647a63480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cebd1789-51a4-46ff-b167-6b1633e930a1:22729:1875571085937536:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1788684559.794451:0:25776:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:2.0:1788684559.794507:0:22729:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:2.0:1788684559.794524:0:22729:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.206.144@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788684559.794534:0:22729:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.206.144@tcp lock: ffff8d6647891a00/0x44bac02bd54ae327 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x44bac02bd54ae32e expref: -99 pid: 22729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684559.794544:0:22729:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.206.144@tcp lock: ffff8d6647891a00/0x44bac02bd54ae327 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x44bac02bd54ae32e expref: -99 pid: 22729 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788684559.830263:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:2.0:1788684559.830398:0:23765:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073246976 00000100:00100000:2.0:1788684559.830409:0:23765:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073246976 00000100:00100000:2.0:1788684559.830462:0:23765:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 30 00000100:00100000:2.0:1788684559.830472:0:23765:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d664876c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0e62701e-7d60-4e2d-bd52-05ee75d6c929+5:18701:x1875571073246976:12345-192.168.206.44@tcp:101:lfs.0 00010000:00010000:2.0:1788684559.830495:0:23765:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788684559.830519:0:23765:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d4200/0x44bac02bd54ae335 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb726964c63ed40ff expref: -99 pid: 23765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684559.830614:0:23765:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d5e00/0x44bac02bd54ae33c lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 23765 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684559.830627:0:23765:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d5e00/0x44bac02bd54ae33c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 23765 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684559.830639:0:23765:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d5e00/0x44bac02bd54ae33c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 23765 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788684559.830680:0:23765:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1788684559.830684:0:23765:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788684559.830702:0:23765:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d5e00/0x44bac02bd54ae33c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 23765 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684559.830726:0:23765:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d4200/0x44bac02bd54ae335 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.44@tcp remote: 0xb726964c63ed40ff expref: 7 pid: 23765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684559.830745:0:23765:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d5e00/0x44bac02bd54ae33c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.44@tcp remote: 0xb726964c63ed40ff expref: 6 pid: 23765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684559.830754:0:23765:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d6743f73e00) 00010000:00010000:2.0:1788684559.830756:0:23765:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788684559.830760:0:23765:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d66476d5e00, rc 0) 00000100:00100000:2.0:1788684559.830822:0:23765:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d664876c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0e62701e-7d60-4e2d-bd52-05ee75d6c929+6:18701:x1875571073246976:12345-192.168.206.44@tcp:101:lfs.0 Request processed in 351us (567us total) trans 0 rc 0/0 00000100:00100000:2.0:1788684559.830840:0:23765:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 30 00000100:00100000:1.0:1788684559.834814:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:0.0:1788684559.835006:0:22732:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073247104 00000100:00100000:0.0:1788684559.835017:0:22732:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073247104 00000100:00100000:0.0:1788684559.835082:0:22732:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 31 00000100:00100000:0.0:1788684559.835094:0:22732:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d677fab4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0e62701e-7d60-4e2d-bd52-05ee75d6c929+6:18701:x1875571073247104:12345-192.168.206.44@tcp:101:lfs.0 00010000:00010000:0.0:1788684559.835115:0:22732:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788684559.835152:0:22732:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d6765f60e00/0x44bac02bd54ae343 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb726964c63ed4106 expref: -99 pid: 22732 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684559.835219:0:22732:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d6765f60000/0x44bac02bd54ae34a lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 22732 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684559.835235:0:22732:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d6765f60000/0x44bac02bd54ae34a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22732 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684559.835248:0:22732:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d6765f60000/0x44bac02bd54ae34a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22732 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684559.835279:0:22732:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d6765f60600/0x44bac02bd54ae351 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 22732 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684559.835288:0:22732:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d6765f60600/0x44bac02bd54ae351 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22732 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684559.835295:0:22732:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d6765f60600/0x44bac02bd54ae351 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22732 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684559.835412:0:22732:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d6765f61600/0x44bac02bd54ae358 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 22732 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684559.835421:0:22732:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d6765f61600/0x44bac02bd54ae358 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22732 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684559.835429:0:22732:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d6765f61600/0x44bac02bd54ae358 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22732 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788684559.835467:0:22732:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1788684559.835472:0:22732:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788684559.835493:0:22732:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d6765f61600/0x44bac02bd54ae358 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22732 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684559.835506:0:22732:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d6765f60000/0x44bac02bd54ae34a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22732 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684559.835513:0:22732:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d6765f60000/0x44bac02bd54ae34a lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 22732 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684559.835520:0:22732:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d6765f60000/0x44bac02bd54ae34a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22732 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684559.835536:0:22732:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d6765f60000 already unused, calling callback (ffffffffc18a84f0) 00010000:00010000:0.0:1788684559.835541:0:22732:0:(ldlm_request.c:377:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d6765f60000/0x44bac02bd54ae34a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22732 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684559.835549:0:22732:0:(ldlm_request.c:1415:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d6765f60000/0x44bac02bd54ae34a lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 22732 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684559.835562:0:22732:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d6743f73e00) 00010000:00010000:0.0:1788684559.835566:0:22732:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788684559.835570:0:22732:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d6765f60000/0x44bac02bd54ae34a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22732 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684559.835578:0:22732:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d6765f60000/0x44bac02bd54ae34a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22732 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684559.835592:0:22732:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d6765f60600/0x44bac02bd54ae351 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22732 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684559.835598:0:22732:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d6765f60600/0x44bac02bd54ae351 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 22732 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684559.835604:0:22732:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d6765f60600/0x44bac02bd54ae351 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 22732 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684559.835609:0:22732:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d6765f60600 already unused, calling callback (ffffffffc18a84f0) 00010000:00010000:0.0:1788684559.835612:0:22732:0:(ldlm_request.c:377:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d6765f60600/0x44bac02bd54ae351 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 22732 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684559.835618:0:22732:0:(ldlm_request.c:1415:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d6765f60600/0x44bac02bd54ae351 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 22732 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684559.835639:0:22732:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa6028a67 (ffff8d664770fd00) 00010000:00010000:0.0:1788684559.835642:0:22732:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788684559.835645:0:22732:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d6765f60600/0x44bac02bd54ae351 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 22732 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684559.835651:0:22732:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d6765f60600/0x44bac02bd54ae351 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 22732 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684559.835678:0:22732:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d6765f60e00/0x44bac02bd54ae343 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.44@tcp remote: 0xb726964c63ed4106 expref: 8 pid: 22732 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684559.835691:0:22732:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d6765f61600/0x44bac02bd54ae358 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.44@tcp remote: 0xb726964c63ed4106 expref: 7 pid: 22732 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684559.835698:0:22732:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff8d664770ff00) 00010000:00010000:0.0:1788684559.835701:0:22732:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788684559.835703:0:22732:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d6765f61600, rc 0) 00000100:00100000:0.0:1788684559.835759:0:22732:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d677fab4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0e62701e-7d60-4e2d-bd52-05ee75d6c929+7:18701:x1875571073247104:12345-192.168.206.44@tcp:101:lfs.0 Request processed in 668us (955us total) trans 0 rc 0/0 00000100:00100000:0.0:1788684559.835766:0:22732:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 31 00000100:00100000:3.0:1788684559.844993:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:2.0:1788684559.845104:0:22744:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073247232 00000100:00100000:2.0:1788684559.845115:0:22744:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073247232 00000100:00100000:2.0:1788684559.845204:0:22744:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 6 00000100:00100000:2.0:1788684559.845215:0:22744:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d664876ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:0e62701e-7d60-4e2d-bd52-05ee75d6c929+5:18701:x1875571073247232:12345-192.168.206.44@tcp:900:lfs.0 00000100:00100000:2.0:1788684559.845308:0:22744:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d664876ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:0e62701e-7d60-4e2d-bd52-05ee75d6c929+5:18701:x1875571073247232:12345-192.168.206.44@tcp:900:lfs.0 Request processed in 95us (325us total) trans 0 rc 0/0 00000100:00100000:2.0:1788684559.845316:0:22744:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 6 00000100:00080000:1.0:1788684559.845394:0:22728:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788684559.851268:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:2.0:1788684559.854401:0:23765:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073247488 00000100:00100000:2.0:1788684559.854416:0:23765:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073247488 00000100:00100000:2.0:1788684559.854479:0:23765:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 32 00000100:00100000:2.0:1788684559.854489:0:23765:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d664876d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0e62701e-7d60-4e2d-bd52-05ee75d6c929+7:18701:x1875571073247488:12345-192.168.206.44@tcp:101:lfs.0 00010000:00010000:2.0:1788684559.854511:0:23765:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788684559.854533:0:23765:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d4200/0x44bac02bd54ae35f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb726964c63ed410d expref: -99 pid: 23765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788684559.854632:0:23765:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 4096 00010000:00010000:2.0:1788684559.855212:0:23765:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d4200/0x44bac02bd54ae35f lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.44@tcp remote: 0xb726964c63ed410d expref: 9 pid: 23765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684559.855230:0:23765:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d6743f73e00) 00010000:00010000:2.0:1788684559.855234:0:23765:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788684559.855239:0:23765:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d4200/0x44bac02bd54ae35f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.44@tcp remote: 0xb726964c63ed410d expref: 9 pid: 23765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684559.855255:0:23765:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d66476d4200, rc 0) 00000100:00100000:2.0:1788684559.855537:0:23765:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d664876d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0e62701e-7d60-4e2d-bd52-05ee75d6c929+8:18701:x1875571073247488:12345-192.168.206.44@tcp:101:lfs.0 Request processed in 1047us (4275us total) trans 12884901891 rc 301/301 00000100:00100000:2.0:1788684559.855545:0:23765:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 32 00000100:00100000:3.0:1788684559.865068:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:0.0:1788684559.865170:0:22732:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073247744 00000100:00100000:0.0:1788684559.865181:0:22732:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073247744 00000100:00100000:0.0:1788684559.865246:0:22732:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 33 00000100:00100000:0.0:1788684559.865257:0:22732:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d664876df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0e62701e-7d60-4e2d-bd52-05ee75d6c929+8:18701:x1875571073247744:12345-192.168.206.44@tcp:36:lfs.0 00010000:00010000:0.0:1788684559.865312:0:22732:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788684559.865341:0:22732:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d6765f61600/0x44bac02bd54ae358 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.44@tcp remote: 0xb726964c63ed4106 expref: 8 pid: 22732 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684559.865498:0:22732:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff8d664770ff00) 00010000:00010000:0.0:1788684559.865504:0:22732:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788684559.865528:0:22732:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d6765f60e00/0x44bac02bd54ae36d lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 22732 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684559.865542:0:22732:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d6765f60e00/0x44bac02bd54ae36d lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22732 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684559.865551:0:22732:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d6765f60e00/0x44bac02bd54ae36d lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22732 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788684559.865756:0:22732:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000fc2d7ddc reply state 00000000569852f6 transno 12884901892 ns: mdt-lustre-MDT0000_UUID lock: ffff8d6765f60e00/0x44bac02bd54ae36d lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22732 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684559.865769:0:22732:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d6765f60e00/0x44bac02bd54ae36d lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22732 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684559.865788:0:22732:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff8d664770ff00) 00010000:00010000:0.0:1788684559.865791:0:22732:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00000100:00100000:0.0:1788684559.865794:0:22732:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:0.0:1788684559.865801:0:22732:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 4096 00000100:00100000:0.0:1788684559.865877:0:22732:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d664876df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0e62701e-7d60-4e2d-bd52-05ee75d6c929+9:18701:x1875571073247744:12345-192.168.206.44@tcp:36:lfs.0 Request processed in 622us (818us total) trans 12884901892 rc 0/0 00000100:00100000:0.0:1788684559.865885:0:22732:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 33 00000100:00100000:3.0:1788684559.872291:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:1.0:1788684559.875872:0:22735:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073248000 00000100:00100000:1.0:1788684559.875886:0:22735:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073248000 00000100:00100000:1.0:1788684559.876017:0:22735:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 2 00000100:00100000:1.0:1788684559.876028:0:22735:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d664876d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0e62701e-7d60-4e2d-bd52-05ee75d6c929+9:18701:x1875571073248000:12345-192.168.206.44@tcp:35:lfs.0 00000100:00100000:1.0:1788684559.876248:0:22735:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d664876d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0e62701e-7d60-4e2d-bd52-05ee75d6c929+10:18701:x1875571073248000:12345-192.168.206.44@tcp:35:lfs.0 Request processed in 221us (3965us total) trans 12884901893 rc 0/0 00000100:00100000:1.0:1788684559.876257:0:22735:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 2 00000100:00100000:3.0:1788684559.885209:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:0.0:1788684559.885627:0:22733:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073248256 00000100:00100000:0.0:1788684559.885637:0:22733:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073248256 00000100:00100000:0.0:1788684559.885702:0:22733:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 34 00000100:00100000:0.0:1788684559.885714:0:22733:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d664876ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0e62701e-7d60-4e2d-bd52-05ee75d6c929+10:18701:x1875571073248256:12345-192.168.206.44@tcp:101:lfs.0 00010000:00010000:0.0:1788684559.885738:0:22733:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788684559.885773:0:22733:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d6765f61600/0x44bac02bd54ae374 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb726964c63ed4114 expref: -99 pid: 22733 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684559.885863:0:22733:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d6765f60600/0x44bac02bd54ae37b lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 22733 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684559.885878:0:22733:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d6765f60600/0x44bac02bd54ae37b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22733 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684559.885889:0:22733:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d6765f60600/0x44bac02bd54ae37b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22733 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684559.885900:0:22733:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d6765f60000/0x44bac02bd54ae382 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 22733 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684559.885907:0:22733:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d6765f60000/0x44bac02bd54ae382 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22733 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684559.885926:0:22733:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d6765f60000/0x44bac02bd54ae382 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22733 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788684559.886022:0:22733:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 4096 00010000:00010000:0.0:1788684559.886098:0:22733:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d6765f60600/0x44bac02bd54ae37b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22733 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684559.886107:0:22733:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d6765f60600/0x44bac02bd54ae37b lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 22733 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684559.886114:0:22733:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d6765f60600/0x44bac02bd54ae37b lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22733 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684559.886120:0:22733:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d6765f60600 already unused, calling callback (ffffffffc18a84f0) 00010000:00010000:0.0:1788684559.886125:0:22733:0:(ldlm_request.c:377:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d6765f60600/0x44bac02bd54ae37b lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22733 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684559.886143:0:22733:0:(ldlm_request.c:1415:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d6765f60600/0x44bac02bd54ae37b lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 22733 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684559.886157:0:22733:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d6743f73e00) 00010000:00010000:0.0:1788684559.886161:0:22733:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788684559.886166:0:22733:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d6765f60600/0x44bac02bd54ae37b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22733 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684559.886173:0:22733:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d6765f60600/0x44bac02bd54ae37b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22733 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684559.886189:0:22733:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d6765f60000/0x44bac02bd54ae382 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22733 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684559.886195:0:22733:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d6765f60000/0x44bac02bd54ae382 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 22733 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684559.886201:0:22733:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d6765f60000/0x44bac02bd54ae382 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 22733 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684559.886207:0:22733:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d6765f60000 already unused, calling callback (ffffffffc18a84f0) 00010000:00010000:0.0:1788684559.886210:0:22733:0:(ldlm_request.c:377:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d6765f60000/0x44bac02bd54ae382 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 22733 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684559.886216:0:22733:0:(ldlm_request.c:1415:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d6765f60000/0x44bac02bd54ae382 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 22733 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684559.886223:0:22733:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa6028a67 (ffff8d664770fd00) 00010000:00010000:0.0:1788684559.886225:0:22733:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788684559.886228:0:22733:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d6765f60000/0x44bac02bd54ae382 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 22733 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684559.886244:0:22733:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d6765f60000/0x44bac02bd54ae382 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 22733 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684559.886277:0:22733:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d6765f61600/0x44bac02bd54ae374 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.44@tcp remote: 0xb726964c63ed4114 expref: 12 pid: 22733 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684559.886287:0:22733:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d6743f73e00) 00010000:00010000:0.0:1788684559.886289:0:22733:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788684559.886293:0:22733:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d6765f61600/0x44bac02bd54ae374 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.44@tcp remote: 0xb726964c63ed4114 expref: 12 pid: 22733 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684559.886303:0:22733:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d6765f61600, rc 0) 00000100:00100000:0.0:1788684559.886424:0:22733:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d664876ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0e62701e-7d60-4e2d-bd52-05ee75d6c929+11:18701:x1875571073248256:12345-192.168.206.44@tcp:101:lfs.0 Request processed in 655us (1166us total) trans 12884901894 rc 301/301 00000100:00100000:0.0:1788684559.886432:0:22733:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 34 00000100:00100000:3.0:1788684559.892062:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:1.0:1788684559.892164:0:22734:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073248384 00000100:00100000:1.0:1788684559.892174:0:22734:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073248384 00000100:00100000:1.0:1788684559.892236:0:22734:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 35 00000100:00100000:1.0:1788684559.892247:0:22734:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d664876fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0e62701e-7d60-4e2d-bd52-05ee75d6c929+11:18701:x1875571073248384:12345-192.168.206.44@tcp:101:lfs.0 00010000:00010000:1.0:1788684559.892272:0:22734:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788684559.892293:0:22734:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d66477b1a00/0x44bac02bd54ae390 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb726964c63ed411b expref: -99 pid: 22734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684559.892442:0:22734:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d66477b1200/0x44bac02bd54ae397 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 22734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684559.892458:0:22734:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d66477b1200/0x44bac02bd54ae397 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684559.892470:0:22734:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d66477b1200/0x44bac02bd54ae397 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22734 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788684559.892502:0:22734:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1788684559.892506:0:22734:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1788684559.892527:0:22734:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d66477b1200/0x44bac02bd54ae397 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684559.892552:0:22734:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d66477b1a00/0x44bac02bd54ae390 lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.44@tcp remote: 0xb726964c63ed411b expref: 13 pid: 22734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684559.892571:0:22734:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d66477b1200/0x44bac02bd54ae397 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.44@tcp remote: 0xb726964c63ed411b expref: 12 pid: 22734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684559.892581:0:22734:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff8d664770ff00) 00010000:00010000:1.0:1788684559.892584:0:22734:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788684559.892588:0:22734:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d66477b1200, rc 0) 00000100:00100000:1.0:1788684559.892651:0:22734:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d664876fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0e62701e-7d60-4e2d-bd52-05ee75d6c929+12:18701:x1875571073248384:12345-192.168.206.44@tcp:101:lfs.0 Request processed in 406us (596us total) trans 0 rc 0/0 00000100:00100000:1.0:1788684559.892659:0:22734:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 35 00000100:00100000:3.0:1788684559.900329:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:0.0:1788684559.900550:0:22736:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073248512 00000100:00100000:0.0:1788684559.900561:0:22736:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073248512 00000100:00100000:0.0:1788684559.900617:0:22736:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 3 00000100:00100000:0.0:1788684559.900628:0:22736:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d664876c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0e62701e-7d60-4e2d-bd52-05ee75d6c929+12:18701:x1875571073248512:12345-192.168.206.44@tcp:37:lfs.0 00000100:00100000:0.0:1788684559.908703:0:22736:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d664876c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:0e62701e-7d60-4e2d-bd52-05ee75d6c929+12:18701:x1875571073248512:12345-192.168.206.44@tcp:37:lfs.0 Request processed in 8066us (8372us total) trans 0 rc 0/0 00000100:00100000:0.0:1788684559.908715:0:22736:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 3 00000100:00100000:3.0:1788684559.912766:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:1.0:1788684559.913007:0:22735:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073248768 00000100:00100000:1.0:1788684559.913018:0:22735:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073248768 00000100:00100000:1.0:1788684559.913081:0:22735:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 4 00000100:00100000:1.0:1788684559.913091:0:22735:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d677fad5050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0e62701e-7d60-4e2d-bd52-05ee75d6c929+12:18701:x1875571073248768:12345-192.168.206.44@tcp:35:lfs.0 00000100:00100000:1.0:1788684559.913320:0:22735:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d677fad5050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0e62701e-7d60-4e2d-bd52-05ee75d6c929+13:18701:x1875571073248768:12345-192.168.206.44@tcp:35:lfs.0 Request processed in 230us (564us total) trans 12884901895 rc 0/0 00000100:00100000:1.0:1788684559.913328:0:22735:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 4 00000100:00100000:3.0:1788684560.027215:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:0.0:1788684560.027467:0:22733:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073248896 00000100:00100000:0.0:1788684560.027479:0:22733:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073248896 00000100:00100000:0.0:1788684560.027552:0:22733:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 36 00000100:00100000:0.0:1788684560.027564:0:22733:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d664876ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4099400f-835c-46aa-bd1f-63cdd511e591+11:18707:x1875571073248896:12345-192.168.206.44@tcp:101:bash.0 00010000:00010000:0.0:1788684560.027600:0:22733:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788684560.027624:0:22733:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d6765f60000/0x44bac02bd54ae39e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb726964c63ed4122 expref: -99 pid: 22733 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684560.027696:0:22733:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d6765f60600/0x44bac02bd54ae3a5 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 22733 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684560.027712:0:22733:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d6765f60600/0x44bac02bd54ae3a5 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22733 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684560.027725:0:22733:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d6765f60600/0x44bac02bd54ae3a5 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22733 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684560.027738:0:22733:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d6765f60400/0x44bac02bd54ae3ac lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 22733 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684560.027746:0:22733:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d6765f60400/0x44bac02bd54ae3ac lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22733 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684560.027753:0:22733:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d6765f60400/0x44bac02bd54ae3ac lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22733 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684560.027831:0:22733:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d6765f61200/0x44bac02bd54ae3b3 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 22733 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684560.027841:0:22733:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d6765f61200/0x44bac02bd54ae3b3 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22733 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684560.027847:0:22733:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d6765f61200/0x44bac02bd54ae3b3 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22733 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788684560.027883:0:22733:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1788684560.027893:0:22733:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788684560.028076:0:22733:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d6765f61200/0x44bac02bd54ae3b3 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22733 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684560.028091:0:22733:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d6765f60600/0x44bac02bd54ae3a5 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22733 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684560.028098:0:22733:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d6765f60600/0x44bac02bd54ae3a5 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 22733 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684560.028104:0:22733:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d6765f60600/0x44bac02bd54ae3a5 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22733 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684560.028109:0:22733:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d6765f60600 already unused, calling callback (ffffffffc18a84f0) 00010000:00010000:0.0:1788684560.028113:0:22733:0:(ldlm_request.c:377:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d6765f60600/0x44bac02bd54ae3a5 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22733 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684560.028120:0:22733:0:(ldlm_request.c:1415:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d6765f60600/0x44bac02bd54ae3a5 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 22733 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684560.028134:0:22733:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d6743f73e00) 00010000:00010000:0.0:1788684560.028136:0:22733:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788684560.028140:0:22733:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d6765f60600/0x44bac02bd54ae3a5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22733 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684560.028145:0:22733:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d6765f60600/0x44bac02bd54ae3a5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22733 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684560.028158:0:22733:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d6765f60400/0x44bac02bd54ae3ac lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22733 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684560.028163:0:22733:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d6765f60400/0x44bac02bd54ae3ac lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 22733 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684560.028179:0:22733:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d6765f60400/0x44bac02bd54ae3ac lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 22733 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684560.028185:0:22733:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d6765f60400 already unused, calling callback (ffffffffc18a84f0) 00010000:00010000:0.0:1788684560.028189:0:22733:0:(ldlm_request.c:377:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d6765f60400/0x44bac02bd54ae3ac lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 22733 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684560.028195:0:22733:0:(ldlm_request.c:1415:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d6765f60400/0x44bac02bd54ae3ac lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 22733 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684560.028203:0:22733:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa6028a67 (ffff8d664770fd00) 00010000:00010000:0.0:1788684560.028206:0:22733:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788684560.028209:0:22733:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d6765f60400/0x44bac02bd54ae3ac lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 22733 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684560.028214:0:22733:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d6765f60400/0x44bac02bd54ae3ac lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 22733 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684560.028239:0:22733:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d6765f60000/0x44bac02bd54ae39e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.44@tcp remote: 0xb726964c63ed4122 expref: 13 pid: 22733 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684560.028254:0:22733:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d6765f61200/0x44bac02bd54ae3b3 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.44@tcp remote: 0xb726964c63ed4122 expref: 12 pid: 22733 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684560.028260:0:22733:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff8d664770ff00) 00010000:00010000:0.0:1788684560.028262:0:22733:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1788684560.028264:0:22733:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d6765f61200, rc 0) 00000100:00100000:0.0:1788684560.028334:0:22733:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d664876ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4099400f-835c-46aa-bd1f-63cdd511e591+12:18707:x1875571073248896:12345-192.168.206.44@tcp:101:bash.0 Request processed in 773us (1130us total) trans 0 rc 0/0 00000100:00100000:0.0:1788684560.028362:0:22733:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 36 00000100:00100000:3.0:1788684560.036360:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:2.0:1788684560.036683:0:22744:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073249024 00000100:00100000:2.0:1788684560.036709:0:22744:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073249024 00000100:00100000:2.0:1788684560.036761:0:22744:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 7 00000100:00100000:2.0:1788684560.036772:0:22744:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d664876ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:4099400f-835c-46aa-bd1f-63cdd511e591+5:18707:x1875571073249024:12345-192.168.206.44@tcp:900:bash.0 00000100:00100000:2.0:1788684560.044241:0:22744:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d664876ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:4099400f-835c-46aa-bd1f-63cdd511e591+5:18707:x1875571073249024:12345-192.168.206.44@tcp:900:bash.0 Request processed in 7458us (7878us total) trans 0 rc 0/0 00000100:00100000:2.0:1788684560.044256:0:22744:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 7 00000100:00100000:3.0:1788684560.056490:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:1.0:1788684560.056663:0:22734:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073249280 00000100:00100000:1.0:1788684560.056674:0:22734:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073249280 00000100:00100000:1.0:1788684560.056743:0:22734:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 37 00000100:00100000:1.0:1788684560.056753:0:22734:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d664876d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4099400f-835c-46aa-bd1f-63cdd511e591+12:18707:x1875571073249280:12345-192.168.206.44@tcp:101:bash.0 00010000:00010000:1.0:1788684560.056773:0:22734:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788684560.056809:0:22734:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d66477b1a00/0x44bac02bd54ae3ba lrc: 2/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb726964c63ed4129 expref: -99 pid: 22734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684560.056926:0:22734:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d66477b0200/0x44bac02bd54ae3c1 lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 22734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684560.056943:0:22734:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d66477b1200/0x44bac02bd54ae397 lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.44@tcp remote: 0xb726964c63ed411b expref: 12 pid: 22734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684560.056954:0:22734:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d66477b0200/0x44bac02bd54ae3c1 lrc: 4/0,1 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 22734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684560.056990:0:22734:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8d66477b1200/0x44bac02bd54ae397 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.44@tcp remote: 0xb726964c63ed411b expref: 12 pid: 22734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684560.057004:0:22734:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8d66477b1200/0x44bac02bd54ae397 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.44@tcp remote: 0xb726964c63ed411b expref: 12 pid: 22734 timeout: 741 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788684560.057018:0:22734:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d677fab7480 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:22734:1875571085937664:192.168.206.44@tcp:104: 00000100:00100000:1.0:1788684560.057107:0:22734:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d6750b03240 going to sleep for 11 seconds 00010000:00010000:2.0:1788684560.061995:0:25183:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788684560.062079:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:2.0:1788684560.063688:0:22717:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073249408 00000100:00100000:2.0:1788684560.063703:0:22717:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073249408 00010000:00010000:2.0:1788684560.063742:0:22717:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d66477b1200/0x44bac02bd54ae397 lrc: 5/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.44@tcp remote: 0xb726964c63ed411b expref: 13 pid: 22734 timeout: 741 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788684560.063788:0:22717:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 16 00000100:00100000:2.0:1788684560.063798:0:22717:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d664876e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0e62701e-7d60-4e2d-bd52-05ee75d6c929+13:2393:x1875571073249408:12345-192.168.206.44@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788684560.063814:0:22717:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788684560.063820:0:22717:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8d66477b1200/0x44bac02bd54ae397 lrc: 5/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.44@tcp remote: 0xb726964c63ed411b expref: 13 pid: 22734 timeout: 741 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684560.063835:0:22717:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8d66477b1200/0x44bac02bd54ae397 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.44@tcp remote: 0xb726964c63ed411b expref: 13 pid: 22734 timeout: 741 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684560.063857:0:22717:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff8d664770ff00) 00010000:00010000:2.0:1788684560.063863:0:22717:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff8d66477b0200/0x44bac02bd54ae3c1 lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 22734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684560.063873:0:22717:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d66477b0200/0x44bac02bd54ae3c1 lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50290000000000 pid: 22734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684560.063896:0:22717:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d66477b0200/0x44bac02bd54ae3c1 lrc: 4/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50290000000000 pid: 22734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684560.063926:0:22717:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788684560.063993:0:22717:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d664876e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0e62701e-7d60-4e2d-bd52-05ee75d6c929+13:2393:x1875571073249408:12345-192.168.206.44@tcp:103:ldlm_bl.0 Request processed in 196us (1919us total) trans 0 rc 0/0 00000100:00100000:2.0:1788684560.064001:0:22717:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 16 00010000:00010000:1.0:1788684560.066333:0:22734:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d66477b1200/0x44bac02bd54ae397 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.44@tcp remote: 0xb726964c63ed411b expref: 12 pid: 22734 timeout: 741 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788684560.066357:0:22734:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d677fab7480 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:22734:1875571085937664:192.168.206.44@tcp:104: 00010000:00010000:1.0:1788684560.066558:0:22734:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8d66477b0200/0x44bac02bd54ae3c1 lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 22734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684560.066587:0:22734:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8d66477b0200/0x44bac02bd54ae3c1 lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 22734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684560.066593:0:22734:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d66477b0200/0x44bac02bd54ae3c1 lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 22734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684560.066935:0:22734:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d66477b1800/0x44bac02bd54ae3c8 lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 22734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684560.066950:0:22734:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d66477b1800/0x44bac02bd54ae3c8 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684560.066969:0:22734:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d66477b1800/0x44bac02bd54ae3c8 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684560.067760:0:22734:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d66477b1000/0x44bac02bd54ae3cf lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 22734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684560.067774:0:22734:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d66477b1000/0x44bac02bd54ae3cf lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684560.067782:0:22734:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d66477b1000/0x44bac02bd54ae3cf lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22734 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788684560.067792:0:22734:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00010000:00010000:1.0:1788684560.067819:0:22734:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d66477b0200/0x44bac02bd54ae3c1 lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 22734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684560.067827:0:22734:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d66477b0200/0x44bac02bd54ae3c1 lrc: 2/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 22734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684560.067833:0:22734:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d66477b0200/0x44bac02bd54ae3c1 lrc: 3/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 22734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684560.067852:0:22734:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d66477b0200 already unused, calling callback (ffffffffc18a84f0) 00010000:00010000:1.0:1788684560.067856:0:22734:0:(ldlm_request.c:377:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d66477b0200/0x44bac02bd54ae3c1 lrc: 3/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 22734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684560.067863:0:22734:0:(ldlm_request.c:1415:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d66477b0200/0x44bac02bd54ae3c1 lrc: 4/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 22734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684560.067876:0:22734:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff8d664770ff00) 00010000:00010000:1.0:1788684560.067879:0:22734:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788684560.067883:0:22734:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d66477b0200/0x44bac02bd54ae3c1 lrc: 2/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 22734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684560.067889:0:22734:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d66477b0200/0x44bac02bd54ae3c1 lrc: 0/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 22734 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788684560.067901:0:22734:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000b1b61c11 reply state 000000009395463a transno 12884901896 ns: mdt-lustre-MDT0000_UUID lock: ffff8d66477b1800/0x44bac02bd54ae3c8 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684560.067922:0:22734:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d66477b1800/0x44bac02bd54ae3c8 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684560.067929:0:22734:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0xb42112bc (ffff8d6641867400) 00010000:00010000:1.0:1788684560.067931:0:22734:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1788684560.067935:0:22734:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1788684560.067972:0:22734:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d66477b1a00/0x44bac02bd54ae3ba lrc: 0/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.44@tcp remote: 0xb726964c63ed4129 expref: 15 pid: 22734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684560.067989:0:22734:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d66477b1000/0x44bac02bd54ae3cf lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.44@tcp remote: 0xb726964c63ed4129 expref: 14 pid: 22734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684560.068009:0:22734:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff8d6641867300) 00010000:00010000:1.0:1788684560.068011:0:22734:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 9 00010000:00010000:1.0:1788684560.068014:0:22734:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d66477b1000, rc 0) 00000100:00100000:1.0:1788684560.068272:0:22734:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d664876d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4099400f-835c-46aa-bd1f-63cdd511e591+15:18707:x1875571073249280:12345-192.168.206.44@tcp:101:bash.0 Request processed in 11519us (11790us total) trans 12884901896 rc 0/0 00000100:00100000:1.0:1788684560.068281:0:22734:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 37 00000100:00100000:3.0:1788684560.113076:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:2.0:1788684560.113191:0:23765:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073249536 00000100:00100000:2.0:1788684560.113202:0:23765:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073249536 00000100:00100000:2.0:1788684560.113271:0:23765:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 38 00000100:00100000:2.0:1788684560.113283:0:23765:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d664876d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4099400f-835c-46aa-bd1f-63cdd511e591+15:18707:x1875571073249536:12345-192.168.206.44@tcp:101:bash.0 00010000:00010000:2.0:1788684560.113312:0:23765:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788684560.113336:0:23765:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d5200/0x44bac02bd54ae3dd lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb726964c63ed4130 expref: -99 pid: 23765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684560.113718:0:23765:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d4a00/0x44bac02bd54ae3e4 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 23765 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684560.113733:0:23765:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d4a00/0x44bac02bd54ae3e4 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 23765 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684560.113745:0:23765:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d4a00/0x44bac02bd54ae3e4 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 23765 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788684560.113853:0:23765:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00000004:00200000:2.0:1788684560.113858:0:23765:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788684560.113879:0:23765:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d4a00/0x44bac02bd54ae3e4 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 23765 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684560.113918:0:23765:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d4a00/0x44bac02bd54ae3e4 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 23765 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684560.113948:0:23765:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d5200/0x44bac02bd54ae3dd lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.44@tcp remote: 0xb726964c63ed4130 expref: 17 pid: 23765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684560.113967:0:23765:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d4a00/0x44bac02bd54ae3e4 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.44@tcp remote: 0xb726964c63ed4130 expref: 16 pid: 23765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684560.113976:0:23765:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff8d6641867300) 00010000:00010000:2.0:1788684560.113979:0:23765:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788684560.113982:0:23765:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d66476d4a00, rc 0) 00000100:00100000:2.0:1788684560.114082:0:23765:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d664876d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4099400f-835c-46aa-bd1f-63cdd511e591+16:18707:x1875571073249536:12345-192.168.206.44@tcp:101:bash.0 Request processed in 801us (1015us total) trans 0 rc 0/0 00000100:00100000:2.0:1788684560.114091:0:23765:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 38 00000100:00100000:2.0:1788684560.120315:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:0.0:1788684560.120439:0:22735:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073249792 00000100:00100000:0.0:1788684560.120450:0:22735:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073249792 00000100:00100000:0.0:1788684560.120512:0:22735:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 5 00000100:00100000:0.0:1788684560.120522:0:22735:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6647a63480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4099400f-835c-46aa-bd1f-63cdd511e591+16:18707:x1875571073249792:12345-192.168.206.44@tcp:35:bash.0 00000100:00100000:0.0:1788684560.121029:0:22735:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6647a63480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4099400f-835c-46aa-bd1f-63cdd511e591+17:18707:x1875571073249792:12345-192.168.206.44@tcp:35:bash.0 Request processed in 507us (721us total) trans 12884901897 rc 0/0 00000100:00100000:0.0:1788684560.121037:0:22735:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 5 00000100:00100000:0.0:1788684560.235559:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:1.0:1788684560.235665:0:22732:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073250048 00000100:00100000:1.0:1788684560.235677:0:22732:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073250048 00000100:00100000:1.0:1788684560.235742:0:22732:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 39 00000100:00100000:1.0:1788684560.235753:0:22732:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d66477ef800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4099400f-835c-46aa-bd1f-63cdd511e591+17:18717:x1875571073250048:12345-192.168.206.44@tcp:101:lfs.0 00010000:00010000:1.0:1788684560.235776:0:22732:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788684560.235807:0:22732:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d66477b1a00/0x44bac02bd54ae3eb lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb726964c63ed4137 expref: -99 pid: 22732 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788684560.235899:0:22732:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 4096 00010000:00010000:1.0:1788684560.236005:0:22732:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d66477b1a00/0x44bac02bd54ae3eb lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.44@tcp remote: 0xb726964c63ed4137 expref: 19 pid: 22732 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684560.236020:0:22732:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff8d6743f73e00) 00010000:00010000:1.0:1788684560.236023:0:22732:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788684560.236028:0:22732:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d66477b1a00/0x44bac02bd54ae3eb lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.44@tcp remote: 0xb726964c63ed4137 expref: 19 pid: 22732 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684560.236042:0:22732:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d66477b1a00, rc 0) 00000100:00100000:1.0:1788684560.236102:0:22732:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d66477ef800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4099400f-835c-46aa-bd1f-63cdd511e591+18:18717:x1875571073250048:12345-192.168.206.44@tcp:101:lfs.0 Request processed in 352us (564us total) trans 12884901898 rc 301/301 00000100:00100000:1.0:1788684560.236122:0:22732:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 39 00000100:00100000:3.0:1788684560.246550:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:2.0:1788684560.246828:0:22736:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073250304 00000100:00100000:2.0:1788684560.246839:0:22736:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073250304 00000100:00100000:2.0:1788684560.246896:0:22736:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 6 00000100:00100000:2.0:1788684560.246906:0:22736:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d664876c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4099400f-835c-46aa-bd1f-63cdd511e591+18:18717:x1875571073250304:12345-192.168.206.44@tcp:35:lfs.0 00000100:00100000:2.0:1788684560.247143:0:22736:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d664876c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4099400f-835c-46aa-bd1f-63cdd511e591+19:18717:x1875571073250304:12345-192.168.206.44@tcp:35:lfs.0 Request processed in 227us (603us total) trans 12884901899 rc 0/0 00000100:00100000:2.0:1788684560.247151:0:22736:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 6 00000040:00080000:2.0:1788684560.318092:0:23489:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:2.0:1788684560.332673:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:0.0:1788684560.332895:0:22733:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073250560 00000100:00100000:0.0:1788684560.332919:0:22733:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073250560 00000100:00100000:0.0:1788684560.332985:0:22733:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 40 00000100:00100000:0.0:1788684560.332997:0:22733:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6647a60000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4099400f-835c-46aa-bd1f-63cdd511e591+19:18720:x1875571073250560:12345-192.168.206.44@tcp:101:lfs.0 00010000:00010000:0.0:1788684560.333024:0:22733:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788684560.333047:0:22733:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d6765f60600/0x44bac02bd54ae3f9 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb726964c63ed413e expref: -99 pid: 22733 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684560.333195:0:22733:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d6765f60400/0x44bac02bd54ae400 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 22733 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684560.333211:0:22733:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d6765f60400/0x44bac02bd54ae400 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22733 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684560.333223:0:22733:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d6765f60400/0x44bac02bd54ae400 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22733 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788684560.333234:0:22733:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00010000:00010000:0.0:1788684560.333400:0:22733:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d6765f60600/0x44bac02bd54ae3f9 lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.44@tcp remote: 0xb726964c63ed413e expref: 22 pid: 22733 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684560.333420:0:22733:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d6765f60400/0x44bac02bd54ae400 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.44@tcp remote: 0xb726964c63ed413e expref: 21 pid: 22733 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684560.333430:0:22733:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff8d6641867300) 00010000:00010000:0.0:1788684560.333433:0:22733:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788684560.333436:0:22733:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d6765f60400, rc 0) 00000100:00100000:0.0:1788684560.333497:0:22733:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6647a60000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4099400f-835c-46aa-bd1f-63cdd511e591+21:18720:x1875571073250560:12345-192.168.206.44@tcp:101:lfs.0 Request processed in 502us (834us total) trans 12884901900 rc 0/0 00000100:00100000:0.0:1788684560.333504:0:22733:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 40 00000100:00100000:3.0:1788684560.336969:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:0.0:1788684560.337060:0:22718:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073250816 00000100:00100000:0.0:1788684560.337076:0:22718:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073250816 00000100:00100000:0.0:1788684560.337151:0:22718:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 0 00000100:00100000:0.0:1788684560.337162:0:22718:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d664876f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4099400f-835c-46aa-bd1f-63cdd511e591+21:2390:x1875571073250816:12345-192.168.206.44@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788684560.337178:0:22718:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788684560.337204:0:22718:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d6765f60400/0x44bac02bd54ae400 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.44@tcp remote: 0xb726964c63ed413e expref: 21 pid: 22733 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684560.337223:0:22718:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff8d6641867300) 00010000:00010000:0.0:1788684560.337228:0:22718:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788684560.337288:0:22718:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d664876f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4099400f-835c-46aa-bd1f-63cdd511e591+20:2390:x1875571073250816:12345-192.168.206.44@tcp:103:ldlm_bl.0 Request processed in 128us (327us total) trans 0 rc 0/0 00000100:00100000:0.0:1788684560.337296:0:22718:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 0 00000100:00100000:3.0:1788684560.338836:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:1.0:1788684560.338995:0:22732:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073250688 00000100:00100000:1.0:1788684560.339003:0:22732:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073250688 00000100:00100000:1.0:1788684560.339050:0:22732:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 41 00000100:00100000:1.0:1788684560.339060:0:22732:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d664876dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4099400f-835c-46aa-bd1f-63cdd511e591+20:18720:x1875571073250688:12345-192.168.206.44@tcp:54:lfs.0 00010000:00010000:1.0:1788684560.339120:0:22732:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d66477b1a00/0x44bac02bd54ae40e lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 22732 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684560.339149:0:22732:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d66477b1a00/0x44bac02bd54ae40e lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22732 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684560.339161:0:22732:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d66477b1a00/0x44bac02bd54ae40e lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22732 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684560.339198:0:22732:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d66477b1a00/0x44bac02bd54ae40e lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22732 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684560.339205:0:22732:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d66477b1a00/0x44bac02bd54ae40e lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 22732 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684560.339212:0:22732:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d66477b1a00/0x44bac02bd54ae40e lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 22732 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684560.339217:0:22732:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d66477b1a00 already unused, calling callback (ffffffffc18a84f0) 00010000:00010000:1.0:1788684560.339222:0:22732:0:(ldlm_request.c:377:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d66477b1a00/0x44bac02bd54ae40e lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 22732 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684560.339230:0:22732:0:(ldlm_request.c:1415:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d66477b1a00/0x44bac02bd54ae40e lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 22732 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684560.339239:0:22732:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff8d6641867300) 00010000:00010000:1.0:1788684560.339254:0:22732:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788684560.339260:0:22732:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d66477b1a00/0x44bac02bd54ae40e lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 22732 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684560.339267:0:22732:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d66477b1a00/0x44bac02bd54ae40e lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 22732 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788684560.339338:0:22732:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d664876dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4099400f-835c-46aa-bd1f-63cdd511e591+20:18720:x1875571073250688:12345-192.168.206.44@tcp:54:lfs.0 Request processed in 280us (507us total) trans 0 rc 0/0 00000100:00100000:1.0:1788684560.339346:0:22732:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 41 00000100:00100000:3.0:1788684560.343158:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:2.0:1788684560.343240:0:22736:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073251072 00000100:00100000:2.0:1788684560.343263:0:22736:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073251072 00000100:00100000:2.0:1788684560.343317:0:22736:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 7 00000100:00100000:2.0:1788684560.343327:0:22736:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d664876c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4099400f-835c-46aa-bd1f-63cdd511e591+20:18720:x1875571073251072:12345-192.168.206.44@tcp:35:lfs.0 00000100:00100000:2.0:1788684560.343755:0:22736:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d664876c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4099400f-835c-46aa-bd1f-63cdd511e591+21:18720:x1875571073251072:12345-192.168.206.44@tcp:35:lfs.0 Request processed in 429us (606us total) trans 12884901901 rc 0/0 00000100:00100000:2.0:1788684560.343764:0:22736:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 7 00000100:00100000:1.0:1788684560.509833:0:3626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d66477ec000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3626:1875571085937792:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788684560.509928:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788684560.509992:0:22738:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085937792 00000100:00100000:1.0:1788684560.510000:0:22738:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085937792 00000100:00100000:1.0:1788684560.510051:0:22738:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1788684560.510059:0:22738:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d677fab7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3626:x1875571085937792:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1788684560.510093:0:22738:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:1.0:1788684560.510141:0:22738:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d677fab7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3626:x1875571085937792:12345-0@lo:41:osp-pre-0-1.0 Request processed in 82us (212us total) trans 0 rc 0/0 00000100:00100000:1.0:1788684560.510148:0:22738:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1788684560.510216:0:3626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d66477ec000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3626:1875571085937792:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788684560.510395:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6647a60a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3623:1875571085937920:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788684560.510427:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788684560.510755:0:22737:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085937920 00000100:00100000:1.0:1788684560.510761:0:22737:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085937920 00000100:00100000:1.0:1788684560.510796:0:22737:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1788684560.510803:0:22737:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d66477ef480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3623:x1875571085937920:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1788684560.510826:0:22737:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:1.0:1788684560.510866:0:22737:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d66477ef480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3623:x1875571085937920:12345-0@lo:41:osp-pre-1-0.0 Request processed in 63us (439us total) trans 0 rc 0/0 00000100:00100000:1.0:1788684560.510879:0:22737:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1788684560.510924:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6647a60a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3623:1875571085937920:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788684560.548565:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:0.0:1788684560.548702:0:22733:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073251328 00000100:00100000:0.0:1788684560.548714:0:22733:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073251328 00000100:00100000:0.0:1788684560.548780:0:22733:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 42 00000100:00100000:0.0:1788684560.548799:0:22733:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6777099f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4099400f-835c-46aa-bd1f-63cdd511e591+21:18751:x1875571073251328:12345-192.168.206.44@tcp:101:cat.0 00010000:00010000:0.0:1788684560.548829:0:22733:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788684560.548856:0:22733:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d6765f60400/0x44bac02bd54ae415 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb726964c63ed4145 expref: -99 pid: 22733 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684560.548996:0:22733:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d6765f60600/0x44bac02bd54ae41c lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 22733 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684560.549010:0:22733:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d6765f60600/0x44bac02bd54ae41c lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22733 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684560.549019:0:22733:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d6765f60600/0x44bac02bd54ae41c lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22733 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788684560.549032:0:22733:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00010000:00010000:0.0:1788684560.549186:0:22733:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d6765f60400/0x44bac02bd54ae415 lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.44@tcp remote: 0xb726964c63ed4145 expref: 24 pid: 22733 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684560.549211:0:22733:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d6765f60600/0x44bac02bd54ae41c lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.44@tcp remote: 0xb726964c63ed4145 expref: 23 pid: 22733 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684560.549221:0:22733:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff8d6641867300) 00010000:00010000:0.0:1788684560.549224:0:22733:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788684560.549229:0:22733:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d6765f60600, rc 0) 00000100:00100000:0.0:1788684560.549407:0:22733:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6777099f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4099400f-835c-46aa-bd1f-63cdd511e591+23:18751:x1875571073251328:12345-192.168.206.44@tcp:101:cat.0 Request processed in 570us (815us total) trans 12884901902 rc 0/0 00000100:00100000:0.0:1788684560.549435:0:22733:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 42 00000100:00100000:3.0:1788684560.551358:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:2.0:1788684560.551628:0:22719:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073251456 00000100:00100000:2.0:1788684560.551638:0:22719:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073251456 00000100:00100000:2.0:1788684560.551738:0:22719:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 1 00000100:00100000:2.0:1788684560.551750:0:22719:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d677709bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4099400f-835c-46aa-bd1f-63cdd511e591+23:2390:x1875571073251456:12345-192.168.206.44@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788684560.551767:0:22719:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788684560.551808:0:22719:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d6765f60600/0x44bac02bd54ae41c lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.44@tcp remote: 0xb726964c63ed4145 expref: 23 pid: 22733 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684560.551831:0:22719:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff8d6641867300) 00010000:00010000:2.0:1788684560.551836:0:22719:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788684560.551902:0:22719:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d677709bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4099400f-835c-46aa-bd1f-63cdd511e591+22:2390:x1875571073251456:12345-192.168.206.44@tcp:103:ldlm_bl.0 Request processed in 154us (557us total) trans 0 rc 0/0 00000100:00100000:2.0:1788684560.551920:0:22719:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 1 00000100:00100000:3.0:1788684560.552770:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:0.0:1788684560.552952:0:22735:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073251712 00000100:00100000:0.0:1788684560.552960:0:22735:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073251712 00000100:00100000:0.0:1788684560.553018:0:22735:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 8 00000100:00100000:0.0:1788684560.553029:0:22735:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d677709ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4099400f-835c-46aa-bd1f-63cdd511e591+22:18751:x1875571073251712:12345-192.168.206.44@tcp:35:cat.0 00000100:00100000:0.0:1788684560.553573:0:22735:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d677709ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:4099400f-835c-46aa-bd1f-63cdd511e591+23:18751:x1875571073251712:12345-192.168.206.44@tcp:35:cat.0 Request processed in 543us (807us total) trans 12884901903 rc 0/0 00000100:00100000:0.0:1788684560.553582:0:22735:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 8 00000100:00100000:3.0:1788684560.610211:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:1.0:1788684560.610397:0:22732:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073251968 00000100:00100000:1.0:1788684560.610411:0:22732:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073251968 00000100:00100000:1.0:1788684560.610609:0:22732:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 43 00000100:00100000:1.0:1788684560.610623:0:22732:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d677709a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4099400f-835c-46aa-bd1f-63cdd511e591+23:18758:x1875571073251968:12345-192.168.206.44@tcp:101:dd.0 00010000:00010000:1.0:1788684560.610654:0:22732:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788684560.610681:0:22732:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d66477b1a00/0x44bac02bd54ae42a lrc: 2/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb726964c63ed414c expref: -99 pid: 22732 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684560.611041:0:22732:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d66477b0200/0x44bac02bd54ae431 lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 22732 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684560.611059:0:22732:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d66477b1000/0x44bac02bd54ae3cf lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.44@tcp remote: 0xb726964c63ed4129 expref: 24 pid: 22734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684560.611067:0:22732:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d4a00/0x44bac02bd54ae3e4 lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.44@tcp remote: 0xb726964c63ed4130 expref: 24 pid: 23765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684560.611075:0:22732:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d66477b0200/0x44bac02bd54ae431 lrc: 5/0,1 mode: --/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22732 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684560.611115:0:22732:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d4a00/0x44bac02bd54ae3e4 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.44@tcp remote: 0xb726964c63ed4130 expref: 24 pid: 23765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684560.611142:0:22732:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d4a00/0x44bac02bd54ae3e4 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.44@tcp remote: 0xb726964c63ed4130 expref: 24 pid: 23765 timeout: 741 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788684560.611194:0:22732:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d677fab6a00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:22732:1875571085938048:192.168.206.44@tcp:104: 00010000:00010000:1.0:1788684560.611327:0:22732:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8d66477b1000/0x44bac02bd54ae3cf lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.44@tcp remote: 0xb726964c63ed4129 expref: 24 pid: 22734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684560.611338:0:22732:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8d66477b1000/0x44bac02bd54ae3cf lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.44@tcp remote: 0xb726964c63ed4129 expref: 24 pid: 22734 timeout: 741 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788684560.611347:0:22732:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d677fab6300 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:22732:1875571085938176:192.168.206.44@tcp:104: 00000100:00100000:1.0:1788684560.611413:0:22732:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d6745398480 going to sleep for 11 seconds 00000100:00100000:3.0:1788684560.615856:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:1.0:1788684560.616054:0:22732:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d677fab6a00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:22732:1875571085938048:192.168.206.44@tcp:104: 00000100:00100000:1.0:1788684560.616070:0:22732:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d677fab6300 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:22732:1875571085938176:192.168.206.44@tcp:104: 00010000:00010000:1.0:1788684560.616107:0:22732:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8d66477b0200/0x44bac02bd54ae431 lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22732 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788684560.616501:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:1.0:1788684560.616626:0:22718:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073252096 00000100:00100000:1.0:1788684560.616786:0:22718:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073252096 00010000:00010000:1.0:1788684560.616834:0:22718:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d4a00/0x44bac02bd54ae3e4 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.44@tcp remote: 0xb726964c63ed4130 expref: 25 pid: 23765 timeout: 741 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788684560.616929:0:22718:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073252224 00000100:00100000:1.0:1788684560.616934:0:22718:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073252224 00010000:00010000:1.0:1788684560.616950:0:22718:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d66477b1000/0x44bac02bd54ae3cf lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.44@tcp remote: 0xb726964c63ed4129 expref: 26 pid: 22734 timeout: 741 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788684560.616979:0:22719:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 17 00000100:00100000:3.0:1788684560.616993:0:22719:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d677709b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4099400f-835c-46aa-bd1f-63cdd511e591+26:2392:x1875571073252096:12345-192.168.206.44@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788684560.617028:0:22719:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788684560.617044:0:22719:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d4a00/0x44bac02bd54ae3e4 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.44@tcp remote: 0xb726964c63ed4130 expref: 26 pid: 23765 timeout: 741 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684560.617059:0:22719:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d4a00/0x44bac02bd54ae3e4 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.44@tcp remote: 0xb726964c63ed4130 expref: 26 pid: 23765 timeout: 741 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684560.617084:0:22719:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d4a00/0x44bac02bd54ae3e4 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.44@tcp remote: 0xb726964c63ed4130 expref: 26 pid: 23765 timeout: 741 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684560.617104:0:22719:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff8d6641867300) 00010000:00010000:3.0:1788684560.617109:0:22719:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8d66477b0200/0x44bac02bd54ae431 lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22732 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684560.617119:0:22719:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff8d66477b0200/0x44bac02bd54ae431 lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22732 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684560.617142:0:22719:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788684560.617213:0:22719:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d677709b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4099400f-835c-46aa-bd1f-63cdd511e591+25:2392:x1875571073252096:12345-192.168.206.44@tcp:103:ldlm_bl.0 Request processed in 223us (1372us total) trans 0 rc 0/0 00000100:00100000:3.0:1788684560.617220:0:22719:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 17 00000100:00100000:1.0:1788684560.617284:0:22718:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 18 00000100:00100000:1.0:1788684560.617300:0:22718:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d677fadbc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4099400f-835c-46aa-bd1f-63cdd511e591+24:2393:x1875571073252224:12345-192.168.206.44@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788684560.617308:0:22718:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788684560.617313:0:22718:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8d66477b1000/0x44bac02bd54ae3cf lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.44@tcp remote: 0xb726964c63ed4129 expref: 24 pid: 22734 timeout: 741 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684560.617323:0:22718:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8d66477b1000/0x44bac02bd54ae3cf lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.44@tcp remote: 0xb726964c63ed4129 expref: 24 pid: 22734 timeout: 741 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684560.617338:0:22718:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d66477b1000/0x44bac02bd54ae3cf lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.44@tcp remote: 0xb726964c63ed4129 expref: 24 pid: 22734 timeout: 741 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684560.617350:0:22718:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff8d6641867300) 00010000:00010000:1.0:1788684560.617354:0:22718:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff8d66477b0200/0x44bac02bd54ae431 lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22732 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684560.617363:0:22718:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d66477b0200/0x44bac02bd54ae431 lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 22732 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684560.617417:0:22718:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d66477b0200/0x44bac02bd54ae431 lrc: 4/0,1 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 22732 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684560.617441:0:22718:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788684560.617465:0:22718:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d677fadbc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4099400f-835c-46aa-bd1f-63cdd511e591+23:2393:x1875571073252224:12345-192.168.206.44@tcp:103:ldlm_bl.0 Request processed in 166us (964us total) trans 0 rc 0/0 00000100:00100000:1.0:1788684560.617472:0:22718:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 18 00010000:00010000:0.0:1788684560.617551:0:22732:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8d66477b0200/0x44bac02bd54ae431 lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22732 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684560.617798:0:22732:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d66477b0200/0x44bac02bd54ae431 lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22732 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788684560.617823:0:22732:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00010000:00010000:0.0:1788684560.619297:0:22732:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d66477b1a00/0x44bac02bd54ae42a lrc: 0/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.44@tcp remote: 0xb726964c63ed414c expref: 24 pid: 22732 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684560.619328:0:22732:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d66477b0200/0x44bac02bd54ae431 lrc: 3/0,0 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.44@tcp remote: 0xb726964c63ed414c expref: 23 pid: 22732 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684560.619339:0:22732:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff8d6641867300) 00010000:00010000:0.0:1788684560.619342:0:22732:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1788684560.619345:0:22732:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d66477b0200, rc 0) 00000100:00100000:0.0:1788684560.619609:0:22732:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d677709a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4099400f-835c-46aa-bd1f-63cdd511e591+23:18758:x1875571073251968:12345-192.168.206.44@tcp:101:dd.0 Request processed in 8988us (9407us total) trans 12884901904 rc 0/0 00000100:00100000:0.0:1788684560.619619:0:22732:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 43 00000100:00100000:3.0:1788684560.621834:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:2.0:1788684560.622234:0:23765:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073252352 00000100:00100000:2.0:1788684560.622244:0:23765:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073252352 00000100:00100000:2.0:1788684560.622388:0:23765:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 44 00000100:00100000:2.0:1788684560.622403:0:23765:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d677709b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4099400f-835c-46aa-bd1f-63cdd511e591+23:18758:x1875571073252352:12345-192.168.206.44@tcp:101:dd.0 00010000:00010000:2.0:1788684560.622487:0:23765:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788684560.622513:0:23765:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d5a00/0x44bac02bd54ae43f lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb726964c63ed4153 expref: -99 pid: 23765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684560.622572:0:23765:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d5200/0x44bac02bd54ae446 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 23765 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684560.622587:0:23765:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d5200/0x44bac02bd54ae446 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 23765 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684560.622599:0:23765:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d5200/0x44bac02bd54ae446 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 23765 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684560.622719:0:23765:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d5a00/0x44bac02bd54ae43f lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.44@tcp remote: 0xb726964c63ed4153 expref: 25 pid: 23765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684560.622734:0:23765:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d5200/0x44bac02bd54ae446 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.44@tcp remote: 0xb726964c63ed4153 expref: 24 pid: 23765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684560.622744:0:23765:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff8d6641867300) 00010000:00010000:2.0:1788684560.622747:0:23765:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1788684560.622752:0:23765:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d66476d5200, rc 0) 00000100:00100000:2.0:1788684560.627219:0:23765:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d677709b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4099400f-835c-46aa-bd1f-63cdd511e591+24:18758:x1875571073252352:12345-192.168.206.44@tcp:101:dd.0 Request processed in 4802us (5376us total) trans 0 rc 0/0 00000100:00100000:2.0:1788684560.627235:0:23765:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 44 00000100:00100000:3.0:1788684560.629983:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:0.0:1788684560.630079:0:22734:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073252608 00000100:00100000:0.0:1788684560.630093:0:22734:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073252608 00000100:00100000:0.0:1788684560.630169:0:22734:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 45 00000100:00100000:0.0:1788684560.630180:0:22734:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6777099880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4099400f-835c-46aa-bd1f-63cdd511e591+24:18758:x1875571073252608:12345-192.168.206.44@tcp:36:dd.0 00010000:00010000:0.0:1788684560.630858:0:22734:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d6765f61600/0x44bac02bd54ae44d lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 22734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684560.630880:0:22734:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d6765f61600/0x44bac02bd54ae44d lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684560.630892:0:22734:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d6765f61600/0x44bac02bd54ae44d lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22734 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788684560.630952:0:22734:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901905 00000004:00010000:0.0:1788684560.630990:0:22734:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000005c321ca0 reply state 00000000760acb61 transno 12884901906 ns: mdt-lustre-MDT0000_UUID lock: ffff8d6765f61600/0x44bac02bd54ae44d lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684560.631004:0:22734:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d6765f61600/0x44bac02bd54ae44d lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684560.631012:0:22734:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff8d6641867300) 00010000:00010000:0.0:1788684560.631015:0:22734:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1788684560.631020:0:22734:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788684560.631183:0:22734:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6777099880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4099400f-835c-46aa-bd1f-63cdd511e591+27:18758:x1875571073252608:12345-192.168.206.44@tcp:36:dd.0 Request processed in 1002us (1209us total) trans 12884901906 rc 0/0 00000100:00100000:0.0:1788684560.631193:0:22734:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 45 00000020:00080000:0.0:1788684560.631199:0:22734:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1788684560.634659:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:3.0:1788684560.634776:0:22733:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073252736 00000100:00100000:3.0:1788684560.634787:0:22733:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073252736 00000100:00100000:3.0:1788684560.634886:0:22733:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 46 00000100:00100000:3.0:1788684560.634897:0:22733:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d66477ec000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4099400f-835c-46aa-bd1f-63cdd511e591+27:18758:x1875571073252736:12345-192.168.206.44@tcp:101:dd.0 00010000:00010000:3.0:1788684560.634935:0:22733:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788684560.634961:0:22733:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d6647890400/0x44bac02bd54ae454 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb726964c63ed415a expref: -99 pid: 22733 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684560.635055:0:22733:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d6647890400/0x44bac02bd54ae454 lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.44@tcp remote: 0xb726964c63ed415a expref: 28 pid: 22733 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684560.635072:0:22733:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d6647890400/0x44bac02bd54ae454 lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.44@tcp remote: 0xb726964c63ed415a expref: 28 pid: 22733 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684560.635094:0:22733:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff8d6641867300) 00010000:00010000:3.0:1788684560.635098:0:22733:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788684560.635101:0:22733:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d6647890400, rc 0) 00000100:00100000:3.0:1788684560.635179:0:22733:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d66477ec000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4099400f-835c-46aa-bd1f-63cdd511e591+28:18758:x1875571073252736:12345-192.168.206.44@tcp:101:dd.0 Request processed in 283us (534us total) trans 0 rc 0/0 00000100:00100000:3.0:1788684560.635186:0:22733:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 46 00000100:00100000:3.0:1788684560.651193:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:1.0:1788684560.651447:0:22718:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073252992 00000100:00100000:1.0:1788684560.651459:0:22718:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073252992 00000100:00100000:1.0:1788684560.651537:0:22718:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 2 00000100:00100000:1.0:1788684560.651548:0:22718:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d677709aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4099400f-835c-46aa-bd1f-63cdd511e591+28:18758:x1875571073252992:12345-192.168.206.44@tcp:103:dd.0 00010000:00010000:1.0:1788684560.651584:0:22718:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788684560.651617:0:22718:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d6647890400/0x44bac02bd54ae454 lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.44@tcp remote: 0xb726964c63ed415a expref: 28 pid: 22733 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684560.651652:0:22718:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff8d6641867300) 00010000:00010000:1.0:1788684560.651659:0:22718:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788684560.651731:0:22718:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d677709aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:4099400f-835c-46aa-bd1f-63cdd511e591+27:18758:x1875571073252992:12345-192.168.206.44@tcp:103:dd.0 Request processed in 184us (552us total) trans 0 rc 0/0 00000100:00100000:1.0:1788684560.651739:0:22718:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 2 00000100:00100000:0.0:1788684560.654342:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:2.0:1788684560.654733:0:22732:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073253120 00000100:00100000:2.0:1788684560.654743:0:22732:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073253120 00000100:00100000:2.0:1788684560.654924:0:22732:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 47 00000100:00100000:2.0:1788684560.654938:0:22732:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d677fa73800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4099400f-835c-46aa-bd1f-63cdd511e591+27:18758:x1875571073253120:12345-192.168.206.44@tcp:58:dd.0 00010000:00010000:2.0:1788684560.655250:0:22732:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d5a00/0x44bac02bd54ae45b lrc: 3/0,1 mode: --/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 22732 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684560.655296:0:22732:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d5a00/0x44bac02bd54ae45b lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22732 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684560.655311:0:22732:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d5a00/0x44bac02bd54ae45b lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22732 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788684560.661552:0:22732:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788684560.661623:0:22732:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].3, 64 off8384 00000040:00080000:2.0:1788684560.663287:0:22732:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x14:0x0].1, 136 off8328 00000100:00100000:2.0:1788684560.665245:0:22732:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d677fa73800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4099400f-835c-46aa-bd1f-63cdd511e591+27:18758:x1875571073253120:12345-192.168.206.44@tcp:58:dd.0 Request processed in 10295us (10901us total) trans 0 rc 0/0 00000100:00100000:2.0:1788684560.665262:0:22732:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 47 00000100:00100000:0.0:1788684560.671762:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:2.0:1788684560.672145:0:23765:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073253248 00000100:00100000:2.0:1788684560.672157:0:23765:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073253248 00000100:00100000:2.0:1788684560.672237:0:23765:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 48 00000100:00100000:2.0:1788684560.672250:0:23765:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d677fa72300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4099400f-835c-46aa-bd1f-63cdd511e591+27:18758:x1875571073253248:12345-192.168.206.44@tcp:101:dd.0 00010000:00010000:2.0:1788684560.672274:0:23765:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788684560.672302:0:23765:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d5c00/0x44bac02bd54ae462 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb726964c63ed4161 expref: -99 pid: 23765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684560.673149:0:23765:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d5a00/0x44bac02bd54ae45b lrc: 2/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 22732 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684560.673165:0:23765:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d5c00/0x44bac02bd54ae462 lrc: 4/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.44@tcp remote: 0xb726964c63ed4161 expref: 28 pid: 23765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684560.673191:0:23765:0:(ldlm_request.c:384:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d5a00/0x44bac02bd54ae45b lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 22732 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684560.673209:0:23765:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d5c00/0x44bac02bd54ae462 lrc: 3/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.44@tcp remote: 0xb726964c63ed4161 expref: 28 pid: 23765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684560.673225:0:23765:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff8d6641867300) 00010000:00010000:3.0:1788684560.673228:0:23765:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788684560.673232:0:23765:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d5c00/0x44bac02bd54ae462 lrc: 3/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.44@tcp remote: 0xb726964c63ed4161 expref: 28 pid: 23765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684560.673239:0:23765:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d66476d5c00, rc 0) 00000100:00100000:3.0:1788684560.673454:0:23765:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d677fa72300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4099400f-835c-46aa-bd1f-63cdd511e591+28:18758:x1875571073253248:12345-192.168.206.44@tcp:101:dd.0 Request processed in 1206us (1707us total) trans 0 rc 0/0 00000100:00100000:3.0:1788684560.673463:0:23765:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 48 00000040:00080000:3.0:1788684560.703301:0:22768:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:3.0:1788684560.703312:0:22768:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x14:0x0] at index 3 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788684560.703343:0:22768:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x14:0x0] index 2 count 2 00000040:00080000:3.0:1788684560.703353:0:22768:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 4 count 2 00000100:00100000:3.0:1788684560.703558:0:22768:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d677709bb80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:22768:1875571085938304:192.168.206.44@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1788684560.703664:0:22768:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d6750025d80 going to sleep for 11 seconds 00000100:00100000:1.0:1788684560.711607:0:22768:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d677709bb80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:22768:1875571085938304:192.168.206.44@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1788684560.712510:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:1.0:1788684560.712947:0:22734:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073253376 00000100:00100000:1.0:1788684560.712958:0:22734:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073253376 00000100:00100000:1.0:1788684560.713039:0:22734:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 49 00000100:00100000:1.0:1788684560.713050:0:22734:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d677fa71f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4099400f-835c-46aa-bd1f-63cdd511e591+28:18760:x1875571073253376:12345-192.168.206.44@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1788684560.713090:0:22734:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x2000013a1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1788684560.713250:0:22734:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d677fa71f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4099400f-835c-46aa-bd1f-63cdd511e591+28:18760:x1875571073253376:12345-192.168.206.44@tcp:53:lhsmtool_posix.0 Request processed in 200us (744us total) trans 0 rc 0/0 00000100:00100000:1.0:1788684560.713259:0:22734:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 49 00000100:00100000:0.0:1788684560.717440:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:3.0:1788684560.717800:0:22733:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073253504 00000100:00100000:3.0:1788684560.717812:0:22733:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073253504 00000100:00100000:3.0:1788684560.717885:0:22733:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 50 00000100:00100000:3.0:1788684560.717896:0:22733:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d677fa71880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4099400f-835c-46aa-bd1f-63cdd511e591+28:18760:x1875571073253504:12345-192.168.206.44@tcp:34:lhsmtool_posix.0 00010000:00010000:3.0:1788684560.717996:0:22733:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d6647890000/0x44bac02bd54ae469 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 22733 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684560.718017:0:22733:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d6647890000/0x44bac02bd54ae469 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22733 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684560.718030:0:22733:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d6647890000/0x44bac02bd54ae469 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22733 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684560.720826:0:22733:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d6647891c00/0x44bac02bd54ae470 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 22733 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684560.720851:0:22733:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d6647891c00/0x44bac02bd54ae470 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22733 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684560.720867:0:22733:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d6647891c00/0x44bac02bd54ae470 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22733 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684560.720924:0:22733:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d6647890600/0x44bac02bd54ae477 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 22733 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684560.720934:0:22733:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d6647890600/0x44bac02bd54ae477 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 22733 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684560.721825:0:22733:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d6647890600/0x44bac02bd54ae477 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 22733 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788684560.721896:0:22733:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00000004:00200000:3.0:1788684560.722558:0:22733:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1788684560.722577:0:22733:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d6647890600/0x44bac02bd54ae477 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 22733 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684560.722594:0:22733:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d6647890000/0x44bac02bd54ae469 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22733 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684560.722602:0:22733:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d6647890000/0x44bac02bd54ae469 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 22733 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684560.722610:0:22733:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d6647890000/0x44bac02bd54ae469 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 22733 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684560.722616:0:22733:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d6647890000 already unused, calling callback (ffffffffc18a84f0) 00010000:00010000:3.0:1788684560.722620:0:22733:0:(ldlm_request.c:377:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d6647890000/0x44bac02bd54ae469 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 22733 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684560.722628:0:22733:0:(ldlm_request.c:1415:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d6647890000/0x44bac02bd54ae469 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 22733 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684560.722644:0:22733:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8d6750b6a100) 00010000:00010000:3.0:1788684560.722647:0:22733:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788684560.722652:0:22733:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d6647890000/0x44bac02bd54ae469 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 22733 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684560.722659:0:22733:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d6647890000/0x44bac02bd54ae469 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 22733 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684560.722677:0:22733:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d6647891c00/0x44bac02bd54ae470 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22733 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684560.722684:0:22733:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d6647891c00/0x44bac02bd54ae470 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 22733 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684560.722710:0:22733:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d6647891c00/0x44bac02bd54ae470 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22733 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684560.722715:0:22733:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d6647891c00 already unused, calling callback (ffffffffc18a84f0) 00010000:00010000:3.0:1788684560.722719:0:22733:0:(ldlm_request.c:377:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d6647891c00/0x44bac02bd54ae470 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22733 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684560.722725:0:22733:0:(ldlm_request.c:1415:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d6647891c00/0x44bac02bd54ae470 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 22733 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684560.722733:0:22733:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x925dcd63 (ffff8d6750b6ae00) 00010000:00010000:3.0:1788684560.722735:0:22733:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788684560.722739:0:22733:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d6647891c00/0x44bac02bd54ae470 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22733 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684560.722744:0:22733:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d6647891c00/0x44bac02bd54ae470 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22733 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684560.722763:0:22733:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d6647890600/0x44bac02bd54ae477 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 22733 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684560.722769:0:22733:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d6647890600/0x44bac02bd54ae477 lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 22733 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684560.722774:0:22733:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d6647890600/0x44bac02bd54ae477 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 22733 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684560.722779:0:22733:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d6647890600 already unused, calling callback (ffffffffc18a84f0) 00010000:00010000:3.0:1788684560.722782:0:22733:0:(ldlm_request.c:377:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d6647890600/0x44bac02bd54ae477 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 22733 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684560.722806:0:22733:0:(ldlm_request.c:1415:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d6647890600/0x44bac02bd54ae477 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 22733 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684560.722814:0:22733:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff8d6641867300) 00010000:00010000:3.0:1788684560.722817:0:22733:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788684560.722820:0:22733:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d6647890600/0x44bac02bd54ae477 lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 22733 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684560.722826:0:22733:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d6647890600/0x44bac02bd54ae477 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 22733 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788684560.722932:0:22733:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d677fa71880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4099400f-835c-46aa-bd1f-63cdd511e591+28:18760:x1875571073253504:12345-192.168.206.44@tcp:34:lhsmtool_posix.0 Request processed in 5034us (5502us total) trans 0 rc 0/0 00000100:00100000:3.0:1788684560.725417:0:22733:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 50 00000100:00100000:0.0:1788684560.730062:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:1.0:1788684560.732984:0:22734:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073253760 00000100:00100000:1.0:1788684560.733006:0:22734:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073253760 00000100:00100000:1.0:1788684560.733201:0:22734:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 51 00000100:00100000:1.0:1788684560.733216:0:22734:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d677fa72a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4099400f-835c-46aa-bd1f-63cdd511e591+28:18760:x1875571073253760:12345-192.168.206.44@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788684560.733243:0:22734:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788684560.733269:0:22734:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d66477b1000/0x44bac02bd54ae47e lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb726964c63ed4168 expref: -99 pid: 22734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684560.733449:0:22734:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d66477b1200/0x44bac02bd54ae485 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 22734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684560.733467:0:22734:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d66477b1200/0x44bac02bd54ae485 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 22734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684560.733481:0:22734:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d66477b1200/0x44bac02bd54ae485 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 22734 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788684560.733494:0:22734:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00010000:00010000:1.0:1788684560.733598:0:22734:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d66477b1200/0x44bac02bd54ae485 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 22734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684560.733606:0:22734:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d66477b1200/0x44bac02bd54ae485 lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 22734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684560.733613:0:22734:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d66477b1200/0x44bac02bd54ae485 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 22734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684560.733619:0:22734:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d66477b1200 already unused, calling callback (ffffffffc18a84f0) 00010000:00010000:1.0:1788684560.733624:0:22734:0:(ldlm_request.c:377:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d66477b1200/0x44bac02bd54ae485 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 22734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684560.733954:0:22734:0:(ldlm_request.c:1415:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d66477b1200/0x44bac02bd54ae485 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 22734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684560.733982:0:22734:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff8d6641867300) 00010000:00010000:1.0:1788684560.733985:0:22734:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1788684560.733992:0:22734:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d66477b1200/0x44bac02bd54ae485 lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 22734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684560.734010:0:22734:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d66477b1200/0x44bac02bd54ae485 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 22734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684560.734066:0:22734:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d66477b1000/0x44bac02bd54ae47e lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.44@tcp remote: 0xb726964c63ed4168 expref: 30 pid: 22734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684560.734078:0:22734:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff8d6750b6a100) 00010000:00010000:1.0:1788684560.734080:0:22734:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788684560.734085:0:22734:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d66477b1000/0x44bac02bd54ae47e lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.206.44@tcp remote: 0xb726964c63ed4168 expref: 30 pid: 22734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684560.734095:0:22734:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d66477b1000, rc 0) 00000100:00100000:1.0:1788684560.734265:0:22734:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d677fa72a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4099400f-835c-46aa-bd1f-63cdd511e591+29:18760:x1875571073253760:12345-192.168.206.44@tcp:101:lhsmtool_posix.0 Request processed in 1052us (4218us total) trans 12884901907 rc 301/301 00000100:00100000:1.0:1788684560.734275:0:22734:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 51 00000100:00100000:0.0:1788684560.737749:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:2.0:1788684560.738010:0:23765:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073253888 00000100:00100000:2.0:1788684560.738022:0:23765:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073253888 00000100:00100000:2.0:1788684560.738097:0:23765:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 52 00000100:00100000:2.0:1788684560.738109:0:23765:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d677fa70380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4099400f-835c-46aa-bd1f-63cdd511e591+29:18760:x1875571073253888:12345-192.168.206.44@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1788684560.738176:0:23765:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x2000013a1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1788684560.738335:0:23765:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d677fa70380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4099400f-835c-46aa-bd1f-63cdd511e591+29:18760:x1875571073253888:12345-192.168.206.44@tcp:53:lhsmtool_posix.0 Request processed in 228us (599us total) trans 0 rc 0/0 00000100:00100000:2.0:1788684560.738363:0:23765:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 52 00000100:00100000:0.0:1788684560.742176:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:2.0:1788684560.742336:0:22732:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073254144 00000100:00100000:2.0:1788684560.742347:0:22732:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073254144 00000100:00100000:2.0:1788684560.742454:0:22732:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 53 00000100:00100000:2.0:1788684560.742473:0:22732:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d677fa70e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4099400f-835c-46aa-bd1f-63cdd511e591+29:18760:x1875571073254144:12345-192.168.206.44@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788684560.742499:0:22732:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788684560.742526:0:22732:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d4200/0x44bac02bd54ae493 lrc: 2/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb726964c63ed416f expref: -99 pid: 22732 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1788684560.743161:0:22732:0:(osp_internal.h:553:osp_update_last_fid()) Gap in objids: start=[0x280000401:0x6:0x0], count =60 00000004:00080000:2.0:1788684560.743170:0:22732:0:(osp_object.c:1645:osp_create()) Writing gap [0x280000401:0x6:0x0]+60 in llog 00000004:00080000:2.0:1788684560.743194:0:22732:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x42:0x0], index 0: 0 00010000:00010000:2.0:1788684560.743409:0:22732:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d5400/0x44bac02bd54ae49a lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 22732 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684560.743427:0:22732:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d5400/0x44bac02bd54ae49a lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22732 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684560.743440:0:22732:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d5400/0x44bac02bd54ae49a lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22732 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684560.743518:0:22732:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d4200/0x44bac02bd54ae493 lrc: 0/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.44@tcp remote: 0xb726964c63ed416f expref: 32 pid: 22732 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684560.743538:0:22732:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d5400/0x44bac02bd54ae49a lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.44@tcp remote: 0xb726964c63ed416f expref: 31 pid: 22732 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684560.743548:0:22732:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff8d664770f300) 00010000:00010000:2.0:1788684560.743569:0:22732:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788684560.743574:0:22732:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d66476d5400, rc 0) 00000100:00100000:2.0:1788684560.744269:0:22732:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d677fa70e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4099400f-835c-46aa-bd1f-63cdd511e591+31:18760:x1875571073254144:12345-192.168.206.44@tcp:101:lhsmtool_posix.0 Request processed in 1799us (2101us total) trans 12884901908 rc 0/0 00000100:00100000:2.0:1788684560.744279:0:22732:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 53 00000100:00100000:0.0:1788684560.753599:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:3.0:1788684560.756027:0:22733:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073254400 00000100:00100000:3.0:1788684560.756042:0:22733:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073254400 00000100:00100000:3.0:1788684560.756117:0:22733:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 54 00000100:00100000:3.0:1788684560.756128:0:22733:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d677fa70000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4099400f-835c-46aa-bd1f-63cdd511e591+31:18760:x1875571073254400:12345-192.168.206.44@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1788684560.756200:0:22733:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788684560.756228:0:22733:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d5400/0x44bac02bd54ae49a lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.44@tcp remote: 0xb726964c63ed416f expref: 31 pid: 22732 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684560.756247:0:22733:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff8d664770f300) 00010000:00010000:3.0:1788684560.756258:0:22733:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788684560.756280:0:22733:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d6647890600/0x44bac02bd54ae4a8 lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 22733 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684560.756295:0:22733:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d6647890600/0x44bac02bd54ae4a8 lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22733 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684560.756318:0:22733:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d6647890600/0x44bac02bd54ae4a8 lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22733 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684560.756359:0:22733:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d6647891c00/0x44bac02bd54ae4af lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x1:0x0].0x5233851f bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 22733 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684560.756420:0:22733:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d6647891c00/0x44bac02bd54ae4af lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x5233851f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22733 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684560.756428:0:22733:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d6647891c00/0x44bac02bd54ae4af lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x5233851f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22733 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684560.756475:0:22733:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d6647890600/0x44bac02bd54ae4a8 lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22733 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684560.756482:0:22733:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d6647890600/0x44bac02bd54ae4a8 lrc: 2/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 22733 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684560.756488:0:22733:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d6647890600/0x44bac02bd54ae4a8 lrc: 3/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22733 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684560.756493:0:22733:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d6647890600 already unused, calling callback (ffffffffc18a84f0) 00010000:00010000:3.0:1788684560.756498:0:22733:0:(ldlm_request.c:377:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d6647890600/0x44bac02bd54ae4a8 lrc: 3/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22733 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684560.756505:0:22733:0:(ldlm_request.c:1415:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d6647890600/0x44bac02bd54ae4a8 lrc: 4/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 22733 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684560.756514:0:22733:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff8d664770ff00) 00010000:00010000:3.0:1788684560.756517:0:22733:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788684560.756521:0:22733:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d6647890600/0x44bac02bd54ae4a8 lrc: 2/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22733 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684560.756534:0:22733:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d6647890600/0x44bac02bd54ae4a8 lrc: 0/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22733 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684560.756546:0:22733:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d6647891c00/0x44bac02bd54ae4af lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x5233851f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22733 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684560.756552:0:22733:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d6647891c00/0x44bac02bd54ae4af lrc: 2/0,0 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x5233851f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 22733 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684560.756558:0:22733:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d6647891c00/0x44bac02bd54ae4af lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x5233851f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22733 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684560.756562:0:22733:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d6647891c00 already unused, calling callback (ffffffffc18a84f0) 00010000:00010000:3.0:1788684560.756566:0:22733:0:(ldlm_request.c:377:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d6647891c00/0x44bac02bd54ae4af lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x5233851f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22733 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684560.756572:0:22733:0:(ldlm_request.c:1415:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d6647891c00/0x44bac02bd54ae4af lrc: 4/0,0 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x5233851f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 22733 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684560.756580:0:22733:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x5233851f (ffff8d6750b6ae00) 00010000:00010000:3.0:1788684560.756583:0:22733:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788684560.756585:0:22733:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d6647891c00/0x44bac02bd54ae4af lrc: 2/0,0 mode: --/PW res: [0x2000013a1:0x1:0x0].0x5233851f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22733 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684560.756591:0:22733:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d6647891c00/0x44bac02bd54ae4af lrc: 0/0,0 mode: --/PW res: [0x2000013a1:0x1:0x0].0x5233851f bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22733 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788684560.756683:0:22733:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d677fa70000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4099400f-835c-46aa-bd1f-63cdd511e591+30:18760:x1875571073254400:12345-192.168.206.44@tcp:36:lhsmtool_posix.0 Request processed in 557us (3099us total) trans 0 rc -2/-2 00000100:00100000:3.0:1788684560.756691:0:22733:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 54 00000100:00100000:0.0:1788684560.759136:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:3.0:1788684560.767320:0:23765:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073254528 00000100:00100000:3.0:1788684560.767344:0:23765:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073254528 00000100:00100000:3.0:1788684560.767824:0:23765:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 55 00000100:00100000:3.0:1788684560.767838:0:23765:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d677fa72680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4099400f-835c-46aa-bd1f-63cdd511e591+30:18760:x1875571073254528:12345-192.168.206.44@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788684560.767870:0:23765:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788684560.767900:0:23765:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d6647890000/0x44bac02bd54ae4b6 lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb726964c63ed4176 expref: -99 pid: 23765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684560.767956:0:23765:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d6647891000/0x44bac02bd54ae4bd lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 23765 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684560.767983:0:23765:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d6647891000/0x44bac02bd54ae4bd lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 23765 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684560.767997:0:23765:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d6647891000/0x44bac02bd54ae4bd lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 23765 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684560.768145:0:23765:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d6647890000/0x44bac02bd54ae4b6 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.44@tcp remote: 0xb726964c63ed4176 expref: 32 pid: 23765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684560.768169:0:23765:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d6647891000/0x44bac02bd54ae4bd lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.44@tcp remote: 0xb726964c63ed4176 expref: 31 pid: 23765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684560.768180:0:23765:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff8d6750b6ac00) 00010000:00010000:3.0:1788684560.768184:0:23765:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1788684560.768188:0:23765:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d6647891000, rc 0) 00000100:00100000:3.0:1788684560.768277:0:23765:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d677fa72680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4099400f-835c-46aa-bd1f-63cdd511e591+31:18760:x1875571073254528:12345-192.168.206.44@tcp:101:lhsmtool_posix.0 Request processed in 441us (9156us total) trans 0 rc 0/0 00000100:00100000:3.0:1788684560.768284:0:23765:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 55 00000100:00100000:1.0:1788684560.777917:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:0.0:1788684560.778947:0:22734:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073254784 00000100:00100000:0.0:1788684560.778965:0:22734:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073254784 00000100:00100000:0.0:1788684560.780109:0:22734:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 56 00000100:00100000:0.0:1788684560.780122:0:22734:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d677fab7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4099400f-835c-46aa-bd1f-63cdd511e591+31:18760:x1875571073254784:12345-192.168.206.44@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1788684560.780233:0:22734:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d6765f60000/0x44bac02bd54ae4c4 lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 22734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684560.780256:0:22734:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d6765f60000/0x44bac02bd54ae4c4 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684560.780269:0:22734:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d6765f60000/0x44bac02bd54ae4c4 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22734 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788684560.780537:0:22734:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x10:0x0].2, 88 off8344 00000004:00080000:0.0:1788684560.780550:0:22734:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 641774182643ns, next at 642774179621ns, rc = 0 00000004:00010000:0.0:1788684560.780613:0:22734:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000f0b0ee98 reply state 00000000e0970c3b transno 12884901909 ns: mdt-lustre-MDT0000_UUID lock: ffff8d6765f60000/0x44bac02bd54ae4c4 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684560.780628:0:22734:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d6765f60000/0x44bac02bd54ae4c4 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684560.781136:0:22734:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff8d6750b6ac00) 00010000:00010000:0.0:1788684560.781140:0:22734:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:0.0:1788684560.781145:0:22734:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788684560.781315:0:22734:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d677fab7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4099400f-835c-46aa-bd1f-63cdd511e591+33:18760:x1875571073254784:12345-192.168.206.44@tcp:36:lhsmtool_posix.0 Request processed in 1193us (3418us total) trans 12884901909 rc 0/0 00000100:00100000:0.0:1788684560.781323:0:22734:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 56 00000100:00100000:0.0:1788684560.791497:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:2.0:1788684560.791774:0:22732:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073254912 00000100:00100000:2.0:1788684560.791787:0:22732:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073254912 00000100:00100000:2.0:1788684560.791867:0:22732:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 57 00000100:00100000:2.0:1788684560.791879:0:22732:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d677fa71180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4099400f-835c-46aa-bd1f-63cdd511e591+33:18760:x1875571073254912:12345-192.168.206.44@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788684560.791920:0:22732:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788684560.791947:0:22732:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d4200/0x44bac02bd54ae4cb lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb726964c63ed417d expref: -99 pid: 22732 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684560.792025:0:22732:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d4200/0x44bac02bd54ae4cb lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.206.44@tcp remote: 0xb726964c63ed417d expref: 34 pid: 22732 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684560.792041:0:22732:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d4200/0x44bac02bd54ae4cb lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.44@tcp remote: 0xb726964c63ed417d expref: 34 pid: 22732 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684560.792063:0:22732:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff8d6750b6ac00) 00010000:00010000:2.0:1788684560.792067:0:22732:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788684560.792071:0:22732:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d66476d4200, rc 0) 00000100:00100000:2.0:1788684560.792137:0:22732:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d677fa71180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4099400f-835c-46aa-bd1f-63cdd511e591+34:18760:x1875571073254912:12345-192.168.206.44@tcp:101:lhsmtool_posix.0 Request processed in 260us (654us total) trans 0 rc 0/0 00000100:00100000:2.0:1788684560.792145:0:22732:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 57 00000100:00100000:1.0:1788684560.800019:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:2.0:1788684560.800182:0:24763:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073255040 00000100:00100000:2.0:1788684560.800195:0:24763:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073255040 00000100:00100000:2.0:1788684560.800417:0:24763:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 21 00000100:00100000:2.0:1788684560.800442:0:24763:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d677fab6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4099400f-835c-46aa-bd1f-63cdd511e591+5:2393:x1875571073255040:12345-192.168.206.44@tcp:2:lhsmtool_posix.0 00000100:00100000:2.0:1788684560.800789:0:24763:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d677fab6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:4099400f-835c-46aa-bd1f-63cdd511e591+6:2393:x1875571073255040:12345-192.168.206.44@tcp:2:lhsmtool_posix.0 Request processed in 349us (785us total) trans 12884901891 rc 0/0 00000100:00100000:2.0:1788684560.800799:0:24763:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 21 00000100:00080000:1.0:1788684560.800943:0:22728:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788684560.812857:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:2.0:1788684560.812960:0:22736:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073255296 00000100:00100000:2.0:1788684560.812973:0:22736:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073255296 00000100:00100000:2.0:1788684560.813079:0:22736:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 9 00000100:00100000:2.0:1788684560.813093:0:22736:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d677709b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4099400f-835c-46aa-bd1f-63cdd511e591+34:18760:x1875571073255296:12345-192.168.206.44@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1788684560.813603:0:22736:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d677709b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4099400f-835c-46aa-bd1f-63cdd511e591+35:18760:x1875571073255296:12345-192.168.206.44@tcp:35:lhsmtool_posix.0 Request processed in 510us (1036us total) trans 12884901910 rc 0/0 00000100:00100000:2.0:1788684560.813613:0:22736:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 9 00000100:00100000:3.0:1788684560.817221:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:0.0:1788684560.817307:0:22733:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073255552 00000100:00100000:0.0:1788684560.817320:0:22733:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073255552 00000100:00100000:0.0:1788684560.817415:0:22733:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 58 00000100:00100000:0.0:1788684560.817436:0:22733:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d677709bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4099400f-835c-46aa-bd1f-63cdd511e591+35:18760:x1875571073255552:12345-192.168.206.44@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1788684560.818249:0:22733:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d677709bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4099400f-835c-46aa-bd1f-63cdd511e591+35:18760:x1875571073255552:12345-192.168.206.44@tcp:57:lhsmtool_posix.0 Request processed in 810us (1037us total) trans 0 rc 0/0 00000100:00100000:0.0:1788684560.818262:0:22733:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 58 00000100:00100000:3.0:1788684560.825734:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:2.0:1788684560.826176:0:23765:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073255680 00000100:00100000:2.0:1788684560.826190:0:23765:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073255680 00000100:00100000:2.0:1788684560.826271:0:23765:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 59 00000100:00100000:2.0:1788684560.826284:0:23765:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d664856ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4099400f-835c-46aa-bd1f-63cdd511e591+35:18760:x1875571073255680:12345-192.168.206.44@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788684560.826311:0:23765:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788684560.826340:0:23765:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d5600/0x44bac02bd54ae4d2 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb726964c63ed4184 expref: -99 pid: 23765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684560.826493:0:23765:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d5400/0x44bac02bd54ae4d9 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 23765 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684560.826510:0:23765:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d5400/0x44bac02bd54ae4d9 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 23765 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684560.826522:0:23765:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d5400/0x44bac02bd54ae4d9 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 23765 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788684560.826601:0:23765:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788684560.826625:0:23765:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d5400/0x44bac02bd54ae4d9 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 23765 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684560.826659:0:23765:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d5600/0x44bac02bd54ae4d2 lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.44@tcp remote: 0xb726964c63ed4184 expref: 37 pid: 23765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684560.826680:0:23765:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d5400/0x44bac02bd54ae4d9 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.44@tcp remote: 0xb726964c63ed4184 expref: 36 pid: 23765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684560.826690:0:23765:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff8d6750b6ac00) 00010000:00010000:2.0:1788684560.826692:0:23765:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1788684560.826696:0:23765:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d66476d5400, rc 0) 00000100:00100000:2.0:1788684560.827489:0:23765:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d664856ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4099400f-835c-46aa-bd1f-63cdd511e591+36:18760:x1875571073255680:12345-192.168.206.44@tcp:101:lhsmtool_posix.0 Request processed in 1202us (1764us total) trans 0 rc 0/0 00000100:00100000:2.0:1788684560.827500:0:23765:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 59 00000100:00100000:3.0:1788684560.832264:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:2.0:1788684560.832568:0:25188:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073255808 00000100:00100000:2.0:1788684560.832580:0:25188:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073255808 00000100:00100000:2.0:1788684560.832653:0:25188:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 22 00000100:00100000:2.0:1788684560.832666:0:25188:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d664856d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:4099400f-835c-46aa-bd1f-63cdd511e591+6:2392:x1875571073255808:12345-192.168.206.44@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788684560.832688:0:25188:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788684560.832714:0:25188:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000174c6641/0x44bac02bd54ae4e0 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xb726964c63ed418b expref: -99 pid: 25188 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788684560.832745:0:25188:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x42:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a9d2910, blocks: 0x0 00010000:00010000:2.0:1788684560.833047:0:25188:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x42:0x0].0x0 since=641s v=(0 0) 00010000:00010000:2.0:1788684560.833069:0:25188:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788684560.833082:0:25188:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000174c6641/0x44bac02bd54ae4e0 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.44@tcp remote: 0xb726964c63ed418b expref: 7 pid: 25188 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684560.833107:0:25188:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000174c6641/0x44bac02bd54ae4e0 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.44@tcp remote: 0xb726964c63ed418b expref: 7 pid: 25188 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684560.833865:0:25188:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d66476d5600, rc 0) 00000100:00100000:2.0:1788684560.835283:0:25188:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d664856d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:4099400f-835c-46aa-bd1f-63cdd511e591+7:2392:x1875571073255808:12345-192.168.206.44@tcp:101:lhsmtool_posix.0 Request processed in 1305us (1718us total) trans 0 rc 0/0 00000100:00100000:2.0:1788684560.835298:0:25188:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 22 00000100:00100000:3.0:1788684560.842558:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:0.0:1788684560.842678:0:22733:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073256064 00000100:00100000:0.0:1788684560.842691:0:22733:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073256064 00000100:00100000:0.0:1788684560.842786:0:22733:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 60 00000100:00100000:0.0:1788684560.842798:0:22733:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d664856f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4099400f-835c-46aa-bd1f-63cdd511e591+36:18760:x1875571073256064:12345-192.168.206.44@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1788684560.842945:0:22733:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d664856f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4099400f-835c-46aa-bd1f-63cdd511e591+36:18760:x1875571073256064:12345-192.168.206.44@tcp:57:lhsmtool_posix.0 Request processed in 149us (402us total) trans 0 rc 0/0 00000100:00100000:0.0:1788684560.842953:0:22733:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 60 00000100:00100000:2.0:1788684560.846873:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:3.0:1788684560.847005:0:23765:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073256192 00000100:00100000:3.0:1788684560.847018:0:23765:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073256192 00000100:00100000:3.0:1788684560.847083:0:23765:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 61 00000100:00100000:3.0:1788684560.847094:0:23765:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6647a60a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4099400f-835c-46aa-bd1f-63cdd511e591+36:18760:x1875571073256192:12345-192.168.206.44@tcp:44:lhsmtool_posix.0 00000001:00080000:0.0:1788684560.853549:0:22711:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 12884901910 is committed 00000004:00080000:0.0:1788684560.853569:0:22711:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2 committed 00000001:00080000:0.0:1788684560.853615:0:22711:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 12884901895 is committed 00010000:00010000:1.0:1788684560.853837:0:3609:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8d6765f60e00/0x44bac02bd54ae36d lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22732 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684560.853852:0:3609:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d6765f60e00/0x44bac02bd54ae36d lrc: 2/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 22732 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684560.853860:0:3609:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d6765f60e00/0x44bac02bd54ae36d lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 22732 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684560.853867:0:3609:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d6765f60e00 already unused, calling callback (ffffffffc18a84f0) 00010000:00010000:1.0:1788684560.853889:0:3609:0:(ldlm_request.c:377:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d6765f60e00/0x44bac02bd54ae36d lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 22732 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684560.853898:0:3609:0:(ldlm_request.c:1415:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d6765f60e00/0x44bac02bd54ae36d lrc: 4/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 22732 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684560.853929:0:3609:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff8d664770ff00) 00010000:00010000:1.0:1788684560.853932:0:3609:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00010000:00010000:1.0:1788684560.853938:0:3609:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d6765f60e00/0x44bac02bd54ae36d lrc: 2/0,0 mode: --/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 22732 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684560.853945:0:3609:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d6765f60e00/0x44bac02bd54ae36d lrc: 0/0,0 mode: --/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 22732 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684560.854090:0:3610:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d4000/0x44bac02bd54ae2e1 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 23765 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684560.854098:0:3610:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d4000/0x44bac02bd54ae2e1 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 23765 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684560.854103:0:3610:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d4000/0x44bac02bd54ae2e1 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 23765 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684560.854108:0:3610:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d66476d4000 already unused, calling callback (ffffffffc18a84f0) 00010000:00010000:2.0:1788684560.854111:0:3610:0:(ldlm_request.c:377:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d4000/0x44bac02bd54ae2e1 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 23765 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684560.854118:0:3610:0:(ldlm_request.c:1415:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d4000/0x44bac02bd54ae2e1 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 23765 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684560.854128:0:3610:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa6028a67 (ffff8d664770fd00) 00010000:00010000:2.0:1788684560.854139:0:3610:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788684560.854144:0:3610:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d4000/0x44bac02bd54ae2e1 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 23765 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684560.854150:0:3610:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d4000/0x44bac02bd54ae2e1 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 23765 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684560.854170:0:3610:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d4800/0x44bac02bd54ae2e8 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 23765 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684560.854176:0:3610:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d4800/0x44bac02bd54ae2e8 lrc: 2/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 23765 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684560.854181:0:3610:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d4800/0x44bac02bd54ae2e8 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 23765 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684560.854186:0:3610:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d66476d4800 already unused, calling callback (ffffffffc18a84f0) 00010000:00010000:2.0:1788684560.854189:0:3610:0:(ldlm_request.c:377:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d4800/0x44bac02bd54ae2e8 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 23765 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684560.854194:0:3610:0:(ldlm_request.c:1415:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d4800/0x44bac02bd54ae2e8 lrc: 4/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 23765 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684560.854203:0:3610:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff8d664770ff00) 00010000:00010000:2.0:1788684560.854205:0:3610:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788684560.854208:0:3610:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d4800/0x44bac02bd54ae2e8 lrc: 2/0,0 mode: --/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 23765 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684560.854214:0:3610:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d4800/0x44bac02bd54ae2e8 lrc: 0/0,0 mode: --/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 23765 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684560.854226:0:3610:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8d66477b1800/0x44bac02bd54ae3c8 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684560.854243:0:3610:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d66477b1800/0x44bac02bd54ae3c8 lrc: 2/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 22734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684560.854249:0:3610:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d66477b1800/0x44bac02bd54ae3c8 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684560.854255:0:3610:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d66477b1800 already unused, calling callback (ffffffffc18a84f0) 00010000:00010000:2.0:1788684560.854259:0:3610:0:(ldlm_request.c:377:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d66477b1800/0x44bac02bd54ae3c8 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684560.854265:0:3610:0:(ldlm_request.c:1415:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d66477b1800/0x44bac02bd54ae3c8 lrc: 4/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 22734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684560.854273:0:3610:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0xb42112bc (ffff8d6641867400) 00010000:00010000:2.0:1788684560.854275:0:3610:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788684560.854278:0:3610:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d66477b1800/0x44bac02bd54ae3c8 lrc: 2/0,0 mode: --/TXN res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684560.854283:0:3610:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d66477b1800/0x44bac02bd54ae3c8 lrc: 0/0,0 mode: --/TXN res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684560.854300:0:3610:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8d6765f61600/0x44bac02bd54ae44d lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 22734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684560.854306:0:3610:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d6765f61600/0x44bac02bd54ae44d lrc: 2/0,0 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 22734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684560.854312:0:3610:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d6765f61600/0x44bac02bd54ae44d lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 22734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684560.854317:0:3610:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d6765f61600 already unused, calling callback (ffffffffc18a84f0) 00010000:00010000:2.0:1788684560.854333:0:3610:0:(ldlm_request.c:377:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d6765f61600/0x44bac02bd54ae44d lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 22734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684560.854340:0:3610:0:(ldlm_request.c:1415:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d6765f61600/0x44bac02bd54ae44d lrc: 4/0,0 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 22734 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788684560.854344:0:3623:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00010000:00010000:2.0:1788684560.854349:0:3610:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff8d6641867300) 00010000:00010000:2.0:1788684560.854351:0:3610:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788684560.854559:0:3610:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d6765f61600/0x44bac02bd54ae44d lrc: 2/0,0 mode: --/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 22734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684560.854568:0:3610:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d6765f61600/0x44bac02bd54ae44d lrc: 0/0,0 mode: --/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 22734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684560.854582:0:3610:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff8d6765f60000/0x44bac02bd54ae4c4 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684560.854588:0:3610:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d6765f60000/0x44bac02bd54ae4c4 lrc: 2/0,0 mode: TXN/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 22734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684560.854594:0:3610:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d6765f60000/0x44bac02bd54ae4c4 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684560.854599:0:3610:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d6765f60000 already unused, calling callback (ffffffffc18a84f0) 00010000:00010000:2.0:1788684560.854602:0:3610:0:(ldlm_request.c:377:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d6765f60000/0x44bac02bd54ae4c4 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684560.854608:0:3610:0:(ldlm_request.c:1415:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d6765f60000/0x44bac02bd54ae4c4 lrc: 4/0,0 mode: TXN/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 22734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684560.854616:0:3610:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff8d6750b6ac00) 00010000:00010000:2.0:1788684560.854618:0:3610:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1788684560.854627:0:3610:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d6765f60000/0x44bac02bd54ae4c4 lrc: 2/0,0 mode: --/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684560.854633:0:3610:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d6765f60000/0x44bac02bd54ae4c4 lrc: 0/0,0 mode: --/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22734 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788684560.855405:0:23765:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6647a60a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:4099400f-835c-46aa-bd1f-63cdd511e591+15:18760:x1875571073256192:12345-192.168.206.44@tcp:44:lhsmtool_posix.0 Request processed in 8302us (8623us total) trans 0 rc 0/0 00000100:00100000:3.0:1788684560.855420:0:23765:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 61 00000100:00100000:3.0:1788684560.859575:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:0.0:1788684560.859764:0:24241:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073256320 00000100:00100000:0.0:1788684560.859783:0:24241:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073256320 00000100:00100000:0.0:1788684560.859852:0:24241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 23 00000100:00100000:0.0:1788684560.859864:0:24241:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d664856e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4099400f-835c-46aa-bd1f-63cdd511e591+7:2393:x1875571073256320:12345-192.168.206.44@tcp:16:lhsmtool_posix.0 00000100:00100000:0.0:1788684560.860020:0:24241:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d664856e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4099400f-835c-46aa-bd1f-63cdd511e591+7:2393:x1875571073256320:12345-192.168.206.44@tcp:16:lhsmtool_posix.0 Request processed in 158us (460us total) trans 0 rc 0/0 00000100:00100000:0.0:1788684560.860047:0:24241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 23 00000100:00100000:1.0:1788684560.862680:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d664856df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3623:1875571085938432:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1788684560.862795:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788684560.863175:0:24763:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085938432 00000100:00100000:3.0:1788684560.863185:0:24763:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085938432 00000100:00100000:3.0:1788684560.863272:0:24763:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1788684560.863284:0:24763:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d677fab6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3623:x1875571085938432:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:3.0:1788684560.863499:0:24763:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x42:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1788684560.863503:0:24763:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x42:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:3.0:1788684560.863506:0:24763:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x42:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1788684560.863508:0:24763:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x42:0x0] updating lvb ctime from disk: 1788684560 -> 1788684560 00002000:00010000:3.0:1788684560.863511:0:24763:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x42:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:3.0:1788684560.863581:0:24763:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d677fab6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3623:x1875571085938432:12345-0@lo:2:osp-syn-0-0.0 Request processed in 299us (786us total) trans 12884901892 rc 0/0 00000100:00100000:3.0:1788684560.863589:0:24763:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000004:00080000:2.0:1788684560.863722:0:3623:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff8d664856df80/2, rc 0, transno 12884901892 00000100:00100000:2.0:1788684560.863730:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d664856df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3623:1875571085938432:0@lo:2:osp-syn-0-0.0 00000100:00080000:1.0:1788684560.863952:0:22728:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788684560.869869:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:1.0:1788684560.869968:0:22734:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073256576 00000100:00100000:1.0:1788684560.869982:0:22734:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073256576 00000100:00100000:1.0:1788684560.870068:0:22734:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 62 00000100:00100000:1.0:1788684560.870080:0:22734:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6647a62300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4099400f-835c-46aa-bd1f-63cdd511e591+15:18760:x1875571073256576:12345-192.168.206.44@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1788684560.870196:0:22734:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788684560.870232:0:22734:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d5400/0x44bac02bd54ae4d9 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.206.44@tcp remote: 0xb726964c63ed4184 expref: 15 pid: 23765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684560.870254:0:22734:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff8d6750b6ac00) 00010000:00010000:1.0:1788684560.870260:0:22734:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788684560.870299:0:22734:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d66477b1400/0x44bac02bd54ae4e7 lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 22734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684560.870325:0:22734:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d66477b1400/0x44bac02bd54ae4e7 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684560.870337:0:22734:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d66477b1400/0x44bac02bd54ae4e7 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22734 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788684560.870543:0:22734:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000c6d14bd0 reply state 000000008c4a3241 transno 12884901911 ns: mdt-lustre-MDT0000_UUID lock: ffff8d66477b1400/0x44bac02bd54ae4e7 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684560.870556:0:22734:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d66477b1400/0x44bac02bd54ae4e7 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684560.870563:0:22734:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff8d6750b6ac00) 00010000:00010000:1.0:1788684560.870566:0:22734:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1788684560.870568:0:22734:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788684560.870688:0:22734:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6647a62300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4099400f-835c-46aa-bd1f-63cdd511e591+16:18760:x1875571073256576:12345-192.168.206.44@tcp:36:lhsmtool_posix.0 Request processed in 610us (834us total) trans 12884901911 rc 0/0 00000100:00100000:1.0:1788684560.870695:0:22734:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 62 00000100:00100000:2.0:1788684560.873500:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:0.0:1788684560.873599:0:25188:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073256704 00000100:00100000:0.0:1788684560.873611:0:25188:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073256704 00000100:00100000:0.0:1788684560.873678:0:25188:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 25 00000100:00100000:0.0:1788684560.873690:0:25188:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d675e782050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:4099400f-835c-46aa-bd1f-63cdd511e591+7:2393:x1875571073256704:12345-192.168.206.44@tcp:2:lhsmtool_posix.0 00002000:00010000:0.0:1788684560.873889:0:25188:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x42:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1788684560.873894:0:25188:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x42:0x0] updating lvb mtime from disk: 0 -> 1788684560 00002000:00010000:0.0:1788684560.873896:0:25188:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x42:0x0] updating lvb atime from disk: 0 -> 1788684560 00002000:00010000:0.0:1788684560.873899:0:25188:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x42:0x0] updating lvb ctime from disk: 1788684560 -> 1788684560 00002000:00010000:0.0:1788684560.873901:0:25188:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x42:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:0.0:1788684560.873991:0:25188:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d675e782050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:4099400f-835c-46aa-bd1f-63cdd511e591+8:2393:x1875571073256704:12345-192.168.206.44@tcp:2:lhsmtool_posix.0 Request processed in 302us (502us total) trans 12884901893 rc 0/0 00000100:00100000:0.0:1788684560.873999:0:25188:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 25 00000100:00100000:2.0:1788684560.877223:0:3616:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:0.0:1788684560.877501:0:24241:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073256832 00000100:00100000:0.0:1788684560.877514:0:24241:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073256832 00000100:00100000:0.0:1788684560.877583:0:24241:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 26 00000100:00100000:0.0:1788684560.877594:0:24241:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6647a62680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4099400f-835c-46aa-bd1f-63cdd511e591+8:2393:x1875571073256832:12345-192.168.206.44@tcp:1:lhsmtool_posix.0 00010000:00010000:0.0:1788684560.877646:0:24241:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000e66a96a6/0x44bac02bd54ae4ee lrc: 3/1,0 mode: --/PR res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684560.877666:0:24241:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788684560.877671:0:24241:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788684560.877678:0:24241:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e66a96a6/0x44bac02bd54ae4ee lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 24241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684560.877693:0:24241:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e66a96a6/0x44bac02bd54ae4ee lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 24241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684560.877737:0:24241:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000e66a96a6/0x44bac02bd54ae4ee lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 24241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684560.877745:0:24241:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e66a96a6/0x44bac02bd54ae4ee lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 24241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684560.877754:0:24241:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e66a96a6/0x44bac02bd54ae4ee lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 24241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684560.877947:0:24241:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d6765f60600 already unused, calling callback (ffffffffc0cae340) 00010000:00010000:0.0:1788684560.877952:0:24241:0:(ldlm_request.c:377:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e66a96a6/0x44bac02bd54ae4ee lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 24241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684560.877961:0:24241:0:(ldlm_request.c:1415:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e66a96a6/0x44bac02bd54ae4ee lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 24241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684560.877979:0:24241:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e66a96a6/0x44bac02bd54ae4ee lrc: 2/0,0 mode: --/PR res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 24241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684560.877986:0:24241:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e66a96a6/0x44bac02bd54ae4ee lrc: 0/0,0 mode: --/PR res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 24241 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788684560.878079:0:24241:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6647a62680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:4099400f-835c-46aa-bd1f-63cdd511e591+8:2393:x1875571073256832:12345-192.168.206.44@tcp:1:lhsmtool_posix.0 Request processed in 486us (870us total) trans 0 rc 0/0 00000100:00100000:0.0:1788684560.878097:0:24241:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 26 00000100:00100000:2.0:1788684560.882953:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:0.0:1788684560.883068:0:22732:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073257088 00000100:00100000:0.0:1788684560.883082:0:22732:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073257088 00000100:00100000:0.0:1788684560.883263:0:22732:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 63 00000100:00100000:0.0:1788684560.883274:0:22732:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6647a63b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4099400f-835c-46aa-bd1f-63cdd511e591+16:18760:x1875571073257088:12345-192.168.206.44@tcp:57:lhsmtool_posix.0 00010000:00010000:0.0:1788684560.883398:0:22732:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d6765f60e00/0x44bac02bd54ae4f5 lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 22732 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684560.883419:0:22732:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d5200/0x44bac02bd54ae446 lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.44@tcp remote: 0xb726964c63ed4153 expref: 16 pid: 23765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684560.883430:0:22732:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d6765f60e00/0x44bac02bd54ae4f5 lrc: 4/0,1 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 22732 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684560.883472:0:22732:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d5200/0x44bac02bd54ae446 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.206.44@tcp remote: 0xb726964c63ed4153 expref: 16 pid: 23765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684560.883489:0:22732:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d5200/0x44bac02bd54ae446 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.206.44@tcp remote: 0xb726964c63ed4153 expref: 16 pid: 23765 timeout: 741 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788684560.883505:0:22732:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d677fa70700 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:22732:1875571085938560:192.168.206.44@tcp:104: 00000100:00100000:0.0:1788684560.883599:0:22732:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d67413709c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788684560.886186:0:22732:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d677fa70700 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:22732:1875571085938560:192.168.206.44@tcp:104: 00010000:00010000:0.0:1788684560.886222:0:22732:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8d6765f60e00/0x44bac02bd54ae4f5 lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 22732 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788684560.890026:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:1.0:1788684560.890304:0:22717:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073257216 00000100:00100000:1.0:1788684560.890316:0:22717:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073257216 00010000:00010000:1.0:1788684560.890569:0:22717:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d5200/0x44bac02bd54ae446 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.44@tcp remote: 0xb726964c63ed4153 expref: 17 pid: 23765 timeout: 741 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788684560.890685:0:22717:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 19 00000100:00100000:1.0:1788684560.890696:0:22717:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6647a61c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4099400f-835c-46aa-bd1f-63cdd511e591+17:2392:x1875571073257216:12345-192.168.206.44@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788684560.890712:0:22717:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788684560.890720:0:22717:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d5200/0x44bac02bd54ae446 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.206.44@tcp remote: 0xb726964c63ed4153 expref: 17 pid: 23765 timeout: 741 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684560.890779:0:22717:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d5200/0x44bac02bd54ae446 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.206.44@tcp remote: 0xb726964c63ed4153 expref: 17 pid: 23765 timeout: 741 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684560.890807:0:22717:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d5200/0x44bac02bd54ae446 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.206.44@tcp remote: 0xb726964c63ed4153 expref: 17 pid: 23765 timeout: 741 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684560.890826:0:22717:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff8d6641867300) 00010000:00010000:1.0:1788684560.890832:0:22717:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d5c00/0x44bac02bd54ae462 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.44@tcp remote: 0xb726964c63ed4161 expref: 16 pid: 23765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684560.890844:0:22717:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff8d6765f60e00/0x44bac02bd54ae4f5 lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 22732 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684560.890851:0:22717:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d6765f60e00/0x44bac02bd54ae4f5 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 22732 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684560.890859:0:22717:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d6765f60e00/0x44bac02bd54ae4f5 lrc: 4/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 22732 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684560.890895:0:22717:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788684560.890976:0:22717:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6647a61c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4099400f-835c-46aa-bd1f-63cdd511e591+16:2392:x1875571073257216:12345-192.168.206.44@tcp:103:ldlm_bl.0 Request processed in 281us (961us total) trans 0 rc 0/0 00000100:00100000:1.0:1788684560.890984:0:22717:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 19 00010000:00010000:2.0:1788684560.891053:0:22732:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8d6765f60e00/0x44bac02bd54ae4f5 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22732 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684560.891062:0:22732:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d6765f60e00/0x44bac02bd54ae4f5 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22732 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684560.891329:0:22732:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d4800/0x44bac02bd54ae4fc lrc: 3/0,1 mode: --/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 22732 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684560.891345:0:22732:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d4200/0x44bac02bd54ae4cb lrc: 2/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.44@tcp remote: 0xb726964c63ed417d expref: 16 pid: 22732 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684560.891353:0:22732:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d4800/0x44bac02bd54ae4fc lrc: 4/0,1 mode: --/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22732 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684560.891409:0:22732:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d4200/0x44bac02bd54ae4cb lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.206.44@tcp remote: 0xb726964c63ed417d expref: 16 pid: 22732 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684560.891439:0:22732:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d4200/0x44bac02bd54ae4cb lrc: 4/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.206.44@tcp remote: 0xb726964c63ed417d expref: 16 pid: 22732 timeout: 741 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788684560.891468:0:22732:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6647a61500 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:22732:1875571085938688:192.168.206.44@tcp:104: 00000100:00100000:2.0:1788684560.891537:0:22732:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d67773173c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788684560.894688:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:2.0:1788684560.894706:0:22732:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6647a61500 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:22732:1875571085938688:192.168.206.44@tcp:104: 00010000:00010000:2.0:1788684560.894738:0:22732:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d4800/0x44bac02bd54ae4fc lrc: 3/0,1 mode: --/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22732 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788684560.894811:0:22719:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073257344 00000100:00100000:3.0:1788684560.894819:0:22719:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073257344 00010000:00010000:3.0:1788684560.894991:0:22719:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d4200/0x44bac02bd54ae4cb lrc: 4/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.206.44@tcp remote: 0xb726964c63ed417d expref: 17 pid: 22732 timeout: 741 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788684560.895152:0:22719:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 20 00000100:00100000:3.0:1788684560.895164:0:22719:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d677fa70700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4099400f-835c-46aa-bd1f-63cdd511e591+17:2393:x1875571073257344:12345-192.168.206.44@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788684560.895182:0:22719:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788684560.895190:0:22719:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d4200/0x44bac02bd54ae4cb lrc: 4/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.206.44@tcp remote: 0xb726964c63ed417d expref: 17 pid: 22732 timeout: 741 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684560.895203:0:22719:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d4200/0x44bac02bd54ae4cb lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.206.44@tcp remote: 0xb726964c63ed417d expref: 17 pid: 22732 timeout: 741 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684560.895230:0:22719:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d4200/0x44bac02bd54ae4cb lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.206.44@tcp remote: 0xb726964c63ed417d expref: 17 pid: 22732 timeout: 741 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684560.895248:0:22719:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff8d6750b6ac00) 00010000:00010000:3.0:1788684560.895254:0:22719:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d4800/0x44bac02bd54ae4fc lrc: 3/0,1 mode: --/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22732 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684560.895264:0:22719:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d4800/0x44bac02bd54ae4fc lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 22732 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684560.895273:0:22719:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d4800/0x44bac02bd54ae4fc lrc: 4/0,1 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 22732 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684560.895305:0:22719:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788684560.895535:0:22719:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d677fa70700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4099400f-835c-46aa-bd1f-63cdd511e591+16:2393:x1875571073257344:12345-192.168.206.44@tcp:103:ldlm_bl.0 Request processed in 359us (848us total) trans 0 rc 0/0 00000100:00100000:3.0:1788684560.895551:0:22719:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 20 00010000:00010000:2.0:1788684560.895659:0:22732:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d4800/0x44bac02bd54ae4fc lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22732 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684560.895669:0:22732:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d4800/0x44bac02bd54ae4fc lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22732 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788684560.895815:0:22732:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901912 00000001:00080000:2.0:1788684560.895959:0:22732:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901913 00000001:00080000:2.0:1788684560.895998:0:22732:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901914 00000100:00100000:2.0:1788684560.896100:0:22732:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6647a61500 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:22732:1875571085938816:0@lo:1000:mdt00_000.0 00000100:00100000:2.0:1788684560.896356:0:22732:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788684560.896426:0:22732:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d6777317000 going to sleep for 11 seconds 00000100:00100000:1.0:1788684560.896444:0:24164:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085938816 00000100:00100000:1.0:1788684560.896453:0:24164:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085938816 00000100:00100000:1.0:1788684560.896500:0:24164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1788684560.896511:0:24164:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6647a63100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:22732:x1875571085938816:12345-0@lo:1000:mdt00_000.0 00000100:00100000:1.0:1788684560.896641:0:24164:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6647a63100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:22732:x1875571085938816:12345-0@lo:1000:mdt00_000.0 Request processed in 132us (285us total) trans 0 rc 0/0 00000100:00100000:1.0:1788684560.896649:0:24164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1788684560.898036:0:22732:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6647a61500 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:22732:1875571085938816:0@lo:1000:mdt00_000.0 00000001:00080000:2.0:1788684560.898324:0:22732:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901915 00000100:00100000:2.0:1788684560.898429:0:22732:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6647a61500 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:22732:1875571085938944:0@lo:1000:mdt00_000.0 00000100:00100000:2.0:1788684560.898739:0:22732:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788684560.898775:0:22732:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d6742d17900 going to sleep for 11 seconds 00000100:00100000:0.0:1788684560.898897:0:22738:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085938944 00000100:00100000:0.0:1788684560.898917:0:22738:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085938944 00000100:00100000:0.0:1788684560.899007:0:22738:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1788684560.899017:0:22738:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6647a61880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:22732:x1875571085938944:12345-0@lo:1000:mdt00_000.0 00000100:00100000:0.0:1788684560.899411:0:22738:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6647a61880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:22732:x1875571085938944:12345-0@lo:1000:mdt00_000.0 Request processed in 394us (670us total) trans 12884901894 rc 0/0 00000100:00100000:0.0:1788684560.899420:0:22738:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1788684560.899700:0:22732:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6647a61500 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:22732:1875571085938944:0@lo:1000:mdt00_000.0 00010000:00010000:1.0:1788684560.900956:0:22732:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d4800/0x44bac02bd54ae4fc lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22732 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684560.900972:0:22732:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d4800/0x44bac02bd54ae4fc lrc: 2/0,0 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 22732 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684560.900979:0:22732:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d4800/0x44bac02bd54ae4fc lrc: 3/0,0 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 22732 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684560.900985:0:22732:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d66476d4800 already unused, calling callback (ffffffffc18a84f0) 00010000:00010000:1.0:1788684560.900990:0:22732:0:(ldlm_request.c:377:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d4800/0x44bac02bd54ae4fc lrc: 3/0,0 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 22732 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684560.900998:0:22732:0:(ldlm_request.c:1415:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d4800/0x44bac02bd54ae4fc lrc: 4/0,0 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 22732 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684560.901017:0:22732:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff8d6750b6ac00) 00010000:00010000:1.0:1788684560.901020:0:22732:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788684560.901025:0:22732:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d4800/0x44bac02bd54ae4fc lrc: 2/0,0 mode: --/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 22732 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684560.901176:0:22732:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d4800/0x44bac02bd54ae4fc lrc: 0/0,0 mode: --/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 22732 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684560.901223:0:22732:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d5a00/0x44bac02bd54ae45b lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 22732 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684560.901250:0:22732:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d5a00/0x44bac02bd54ae45b lrc: 2/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 22732 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684560.901257:0:22732:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d5a00/0x44bac02bd54ae45b lrc: 3/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 22732 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684560.901262:0:22732:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d66476d5a00 already unused, calling callback (ffffffffc18a84f0) 00010000:00010000:1.0:1788684560.901265:0:22732:0:(ldlm_request.c:377:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d5a00/0x44bac02bd54ae45b lrc: 3/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 22732 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684560.901272:0:22732:0:(ldlm_request.c:1415:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d5a00/0x44bac02bd54ae45b lrc: 4/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 22732 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684560.901282:0:22732:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff8d6641867300) 00010000:00010000:1.0:1788684560.901284:0:22732:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788684560.901292:0:22732:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d5c00/0x44bac02bd54ae462 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.44@tcp remote: 0xb726964c63ed4161 expref: 19 pid: 23765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684560.901306:0:22732:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d5c00/0x44bac02bd54ae462 lrc: 2/0,0 mode: CR/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.206.44@tcp remote: 0xb726964c63ed4161 expref: 19 pid: 23765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684560.901316:0:22732:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d5c00/0x44bac02bd54ae462 lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.206.44@tcp remote: 0xb726964c63ed4161 expref: 19 pid: 23765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684560.902231:0:22732:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d5c00/0x44bac02bd54ae462 lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.206.44@tcp remote: 0xb726964c63ed4161 expref: 19 pid: 23765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788684560.902253:0:22732:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d677fab6a00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:22732:1875571085939072:192.168.206.44@tcp:105: 00000100:00100000:1.0:1788684560.902777:0:22732:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d6745398300 going to sleep for 11 seconds 00000100:00100000:0.0:1788684560.908455:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:2.0:1788684560.908546:0:22736:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073257472 00000100:00100000:2.0:1788684560.908558:0:22736:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073257472 00000100:00100000:2.0:1788684560.908651:0:22736:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 10 00000100:00100000:2.0:1788684560.908663:0:22736:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d677fad4850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4099400f-835c-46aa-bd1f-63cdd511e591+20:18758:x1875571073257472:12345-192.168.206.44@tcp:49:dd.0 00000100:00100000:1.0:1788684560.908723:0:22732:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d677fab6a00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:22732:1875571085939072:192.168.206.44@tcp:105: 00010000:00010000:1.0:1788684560.908761:0:22732:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d5a00/0x44bac02bd54ae45b lrc: 2/0,0 mode: --/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 22732 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684560.908779:0:22732:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d5a00/0x44bac02bd54ae45b lrc: 0/0,0 mode: --/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 22732 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684560.908814:0:22732:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8d66477b0c00/0x44bac02bd54ae503 lrc: 3/0,1 mode: --/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 22732 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684560.908825:0:22732:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d66477b0c00/0x44bac02bd54ae503 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22732 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684560.908835:0:22732:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d66477b0c00/0x44bac02bd54ae503 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22732 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684560.908845:0:22732:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff8d66477b0c00/0x44bac02bd54ae503 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22732 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684560.908849:0:22732:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d66477b0c00/0x44bac02bd54ae503 lrc: 2/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 22732 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684560.908854:0:22732:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d66477b0c00/0x44bac02bd54ae503 lrc: 3/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22732 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684560.908858:0:22732:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d66477b0c00 already unused, calling callback (ffffffffc18a84f0) 00010000:00010000:1.0:1788684560.908861:0:22732:0:(ldlm_request.c:377:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d66477b0c00/0x44bac02bd54ae503 lrc: 3/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22732 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684560.908865:0:22732:0:(ldlm_request.c:1415:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d66477b0c00/0x44bac02bd54ae503 lrc: 4/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 22732 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684560.908889:0:22732:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff8d6641867300) 00010000:00010000:1.0:1788684560.908891:0:22732:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788684560.908893:0:22732:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d66477b0c00/0x44bac02bd54ae503 lrc: 2/0,0 mode: --/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22732 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684560.908897:0:22732:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d66477b0c00/0x44bac02bd54ae503 lrc: 0/0,0 mode: --/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22732 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684560.908903:0:22732:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d6765f60e00/0x44bac02bd54ae4f5 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22732 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684560.908921:0:22732:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d6765f60e00/0x44bac02bd54ae4f5 lrc: 2/0,0 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 22732 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684560.908926:0:22732:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d6765f60e00/0x44bac02bd54ae4f5 lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 22732 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684560.908936:0:22732:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d6765f60e00 already unused, calling callback (ffffffffc18a84f0) 00010000:00010000:1.0:1788684560.908939:0:22732:0:(ldlm_request.c:377:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d6765f60e00/0x44bac02bd54ae4f5 lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 22732 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684560.909011:0:22732:0:(ldlm_request.c:1415:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d6765f60e00/0x44bac02bd54ae4f5 lrc: 4/0,0 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 22732 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684560.909024:0:22732:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff8d6641867300) 00010000:00010000:1.0:1788684560.909027:0:22732:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1788684560.909031:0:22732:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d6765f60e00/0x44bac02bd54ae4f5 lrc: 2/0,0 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 22732 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684560.909037:0:22732:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d6765f60e00/0x44bac02bd54ae4f5 lrc: 0/0,0 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 22732 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788684560.909159:0:22736:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d677fad4850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4099400f-835c-46aa-bd1f-63cdd511e591+20:18758:x1875571073257472:12345-192.168.206.44@tcp:49:dd.0 Request processed in 172us (392us total) trans 0 rc 0/0 00000100:00100000:2.0:1788684560.909171:0:22736:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 10 00000040:00080000:3.0:1788684560.909422:0:22768:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:3.0:1788684560.909427:0:22768:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x14:0x0] at index 3 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788684560.909447:0:22768:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x14:0x0] index 2 count 2 00000040:00080000:3.0:1788684560.909453:0:22768:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 4 count 2 00000100:00100000:1.0:1788684560.909551:0:22732:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6647a63b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:4099400f-835c-46aa-bd1f-63cdd511e591+19:18760:x1875571073257088:12345-192.168.206.44@tcp:57:lhsmtool_posix.0 Request processed in 26274us (26611us total) trans 12884901916 rc 0/0 00000100:00100000:1.0:1788684560.909563:0:22732:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 63 00000020:00080000:1.0:1788684560.909569:0:22732:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000100:00100000:0.0:1788684560.916189:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:2.0:1788684560.916314:0:22736:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073257728 00000100:00100000:2.0:1788684560.916325:0:22736:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073257728 00000100:00100000:2.0:1788684560.916508:0:22736:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 11 00000100:00100000:2.0:1788684560.916520:0:22736:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d677fa73100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4099400f-835c-46aa-bd1f-63cdd511e591+19:18760:x1875571073257728:12345-192.168.206.44@tcp:35:lhsmtool_posix.0 00000004:00080000:2.0:1788684560.916961:0:22736:0:(mdd_object.c:4014:mdd_close()) Object [0x2000013a1:0x3:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:2.0:1788684560.917002:0:22736:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901917 00010000:00010000:2.0:1788684560.917041:0:22736:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d5a00/0x44bac02bd54ae50a lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 22736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684560.917062:0:22736:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d5a00/0x44bac02bd54ae50a lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010080000000 pid: 22736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684560.917075:0:22736:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d5a00/0x44bac02bd54ae50a lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 22736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684560.917085:0:22736:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d5a00/0x44bac02bd54ae50a lrc: 4/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 22736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684560.917093:0:22736:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d5a00/0x44bac02bd54ae50a lrc: 4/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 22736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684560.917099:0:22736:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d5a00/0x44bac02bd54ae50a lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 22736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684560.917152:0:22736:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788684560.917363:0:22721:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788684560.917387:0:22721:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d5a00/0x44bac02bd54ae50a lrc: 2/0,0 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 22736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684560.917395:0:22721:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d66476d5a00 already unused, calling callback (ffffffffc0cae340) 00010000:00010000:1.0:1788684560.917399:0:22721:0:(ldlm_request.c:377:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d5a00/0x44bac02bd54ae50a lrc: 2/0,0 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 22736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684560.917408:0:22721:0:(ldlm_request.c:1415:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d5a00/0x44bac02bd54ae50a lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40018480000000 pid: 22736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684560.917423:0:22721:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff8d6750b6ac00) 00010000:00010000:1.0:1788684560.917427:0:22721:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1788684560.917432:0:22721:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d5a00/0x44bac02bd54ae50a lrc: 1/0,0 mode: --/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 22736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684560.917438:0:22721:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d66476d5a00/0x44bac02bd54ae50a lrc: 0/0,0 mode: --/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 22736 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684560.917453:0:22721:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788684560.917455:0:22721:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788684560.917457:0:22721:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788684560.917511:0:22736:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d677fa73100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:4099400f-835c-46aa-bd1f-63cdd511e591+21:18760:x1875571073257728:12345-192.168.206.44@tcp:35:lhsmtool_posix.0 Request processed in 992us (1334us total) trans 12884901918 rc 0/0 00000100:00100000:2.0:1788684560.917521:0:22736:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 11 00000020:00080000:2.0:1788684560.917527:0:22736:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1788684560.918354:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:1.0:1788684560.918664:0:22734:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073257856 00000100:00100000:1.0:1788684560.918672:0:22734:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073257856 00000100:00100000:1.0:1788684560.918722:0:22734:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 64 00000100:00100000:1.0:1788684560.918731:0:22734:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d664856dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4099400f-835c-46aa-bd1f-63cdd511e591+21:18758:x1875571073257856:12345-192.168.206.44@tcp:101:dd.0 00010000:00010000:1.0:1788684560.918777:0:22734:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788684560.918796:0:22734:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d66477b0c00/0x44bac02bd54ae511 lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xb726964c63ed4192 expref: -99 pid: 22734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684560.918833:0:22734:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff8d66477b0a00/0x44bac02bd54ae518 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 22734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684560.918856:0:22734:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff8d66477b0a00/0x44bac02bd54ae518 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684560.918866:0:22734:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff8d66477b0a00/0x44bac02bd54ae518 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22734 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684560.919024:0:22734:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff8d66477b0c00/0x44bac02bd54ae511 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.206.44@tcp remote: 0xb726964c63ed4192 expref: 23 pid: 22734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684560.919042:0:22734:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff8d66477b0a00/0x44bac02bd54ae518 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.206.44@tcp remote: 0xb726964c63ed4192 expref: 22 pid: 22734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684560.919051:0:22734:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff8d6641867300) 00010000:00010000:1.0:1788684560.919054:0:22734:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1788684560.919057:0:22734:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff8d66477b0a00, rc 0) 00000100:00100000:1.0:1788684560.919653:0:22734:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d664856dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4099400f-835c-46aa-bd1f-63cdd511e591+22:18758:x1875571073257856:12345-192.168.206.44@tcp:101:dd.0 Request processed in 920us (1300us total) trans 0 rc 0/0 00000100:00100000:1.0:1788684560.919661:0:22734:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 64 00000100:00100000:3.0:1788684560.949917:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:1.0:1788684560.951583:0:24244:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073257984 00000100:00100000:1.0:1788684560.951600:0:24244:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073257984 00000100:00100000:1.0:1788684560.951694:0:24244:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 0 00000100:00100000:1.0:1788684560.951708:0:24244:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d664856c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:4099400f-835c-46aa-bd1f-63cdd511e591+8:2392:x1875571073257984:12345-192.168.206.44@tcp:4:dd.0 00010000:00010000:1.0:1788684560.951970:0:24244:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000006e3fc98/0x44bac02bd54ae51f lrc: 3/0,1 mode: --/PW res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684560.951995:0:24244:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000174c6641/0x44bac02bd54ae4e0 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.206.44@tcp remote: 0xb726964c63ed418b expref: 8 pid: 25188 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684560.952005:0:24244:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788684560.952010:0:24244:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788684560.952015:0:24244:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000006e3fc98/0x44bac02bd54ae51f lrc: 4/0,1 mode: --/PW res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 24244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684560.952061:0:24244:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000174c6641/0x44bac02bd54ae4e0 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.206.44@tcp remote: 0xb726964c63ed418b expref: 8 pid: 25188 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684560.952077:0:24244:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000174c6641/0x44bac02bd54ae4e0 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.206.44@tcp remote: 0xb726964c63ed418b expref: 8 pid: 25188 timeout: 741 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788684560.952093:0:24244:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d677fab6a00 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_000:lustre-OST0000_UUID:24244:1875571085939200:192.168.206.44@tcp:104: 00000100:00100000:2.0:1788684560.952591:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:0.0:1788684560.952709:0:24246:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 3 min 3 max 116 00000100:00100000:0.0:1788684560.952718:0:24246:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_003' 00000100:00100000:1.0:1788684560.954184:0:24244:0:(client.c:2716:ptlrpc_set_wait()) set ffff8d6745398300 going to sleep for 11 seconds 00000100:00100000:0.0:1788684560.957190:0:24246:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073258112 00000100:00100000:0.0:1788684560.957207:0:24246:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073258112 00000100:00100000:1.0:1788684560.961844:0:24244:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d677fab6a00 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_000:lustre-OST0000_UUID:24244:1875571085939200:192.168.206.44@tcp:104: 00010000:00010000:1.0:1788684560.961885:0:24244:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000006e3fc98/0x44bac02bd54ae51f lrc: 3/0,1 mode: --/PW res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 24244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788684560.963184:0:25778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 1 00000100:00100000:2.0:1788684560.963206:0:25778:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6647a63480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:4099400f-835c-46aa-bd1f-63cdd511e591+9:2393:x1875571073258112:12345-192.168.206.44@tcp:4:dd.0 00010000:00010000:2.0:1788684560.963248:0:25778:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000eb34edc0/0x44bac02bd54ae526 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x42:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684560.963303:0:25778:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788684560.963308:0:25778:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788684560.963312:0:25778:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000eb34edc0/0x44bac02bd54ae526 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x42:0x0].0x0 rrc: 4 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 25778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684560.963322:0:25778:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000eb34edc0/0x44bac02bd54ae526 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x42:0x0].0x0 rrc: 4 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 25778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788684560.966919:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:1.0:1788684560.967094:0:22717:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073258240 00000100:00100000:1.0:1788684560.967106:0:22717:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073258240 00010000:00010000:1.0:1788684560.967149:0:22717:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000174c6641/0x44bac02bd54ae4e0 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.44@tcp remote: 0xb726964c63ed418b expref: 10 pid: 25188 timeout: 741 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788684560.967272:0:22717:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 21 00000100:00100000:1.0:1788684560.967283:0:22717:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6647a60380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4099400f-835c-46aa-bd1f-63cdd511e591+10:2393:x1875571073258240:12345-192.168.206.44@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788684560.967299:0:22717:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788684560.967323:0:22717:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000174c6641/0x44bac02bd54ae4e0 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.206.44@tcp remote: 0xb726964c63ed418b expref: 10 pid: 25188 timeout: 741 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684560.967339:0:22717:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000174c6641/0x44bac02bd54ae4e0 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x42:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.206.44@tcp remote: 0xb726964c63ed418b expref: 10 pid: 25188 timeout: 741 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684560.967364:0:22717:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000174c6641/0x44bac02bd54ae4e0 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x42:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.206.44@tcp remote: 0xb726964c63ed418b expref: 10 pid: 25188 timeout: 741 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684560.967439:0:22717:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788684560.967444:0:22717:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788684560.967451:0:22717:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000006e3fc98/0x44bac02bd54ae51f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 4 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 24244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684560.967461:0:22717:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000006e3fc98/0x44bac02bd54ae51f lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 4 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 24244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684560.967477:0:22717:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788684560.967480:0:22717:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788684560.967484:0:22717:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000eb34edc0/0x44bac02bd54ae526 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 4 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 25778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684560.967527:0:22717:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000eb34edc0/0x44bac02bd54ae526 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 4 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 25778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788684560.967565:0:22717:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788684560.967635:0:22717:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6647a60380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4099400f-835c-46aa-bd1f-63cdd511e591+9:2393:x1875571073258240:12345-192.168.206.44@tcp:103:ldlm_bl.0 Request processed in 343us (726us total) trans 0 rc 0/0 00000100:00100000:1.0:1788684560.967645:0:22717:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 21 00010000:00010000:3.0:1788684560.967679:0:24244:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000006e3fc98/0x44bac02bd54ae51f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 24244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788684560.967700:0:24244:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000006e3fc98/0x44bac02bd54ae51f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 24244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684560.967712:0:25778:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000eb34edc0/0x44bac02bd54ae526 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 25778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684560.967724:0:25778:0:(ldlm_request.c:556:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000eb34edc0/0x44bac02bd54ae526 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 25778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684561.086604:0:25184:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1788684561.132610:0:24235:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 12884901895 is committed 00000001:00080000:3.0:1788684561.132627:0:24235:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 12884901894 is committed 00002000:00010000:2.0:1788684561.135702:0:25778:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x42:0x0] updating lvb size from disk: 0 -> 7654321 00002000:00010000:2.0:1788684561.135716:0:25778:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x42:0x0] updating lvb blocks from disk: 0 -> 6760 00010000:00010000:2.0:1788684561.135738:0:25778:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000eb34edc0/0x44bac02bd54ae526 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 25778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684561.135754:0:25778:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000eb34edc0/0x44bac02bd54ae526 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 25778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684561.135765:0:25778:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000eb34edc0/0x44bac02bd54ae526 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 25778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684561.135773:0:25778:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d66476d4800 already unused, calling callback (ffffffffc0cae340) 00010000:00010000:2.0:1788684561.135778:0:25778:0:(ldlm_request.c:377:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000eb34edc0/0x44bac02bd54ae526 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 25778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684561.135789:0:25778:0:(ldlm_request.c:1415:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000eb34edc0/0x44bac02bd54ae526 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 25778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684561.135812:0:25778:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000eb34edc0/0x44bac02bd54ae526 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 25778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788684561.135821:0:25778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000eb34edc0/0x44bac02bd54ae526 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x42:0x0].0x0 rrc: 3 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 25778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788684561.135980:0:25778:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6647a63480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:4099400f-835c-46aa-bd1f-63cdd511e591+7:2393:x1875571073258112:12345-192.168.206.44@tcp:4:dd.0 Request processed in 172774us (183382us total) trans 12884901895 rc 0/0 00000100:00100000:2.0:1788684561.136009:0:25778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 1 00000001:00080000:1.0:1788684561.194459:0:24235:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 12884901896 is committed 00002000:00010000:0.0:1788684561.194990:0:24244:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x42:0x0] updating lvb blocks from disk: 6760 -> 14952 00010000:00010000:0.0:1788684561.195013:0:24244:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000006e3fc98/0x44bac02bd54ae51f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 24244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684561.195027:0:24244:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000006e3fc98/0x44bac02bd54ae51f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 24244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684561.195037:0:24244:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000006e3fc98/0x44bac02bd54ae51f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 24244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684561.195044:0:24244:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff8d66477b0c00 already unused, calling callback (ffffffffc0cae340) 00010000:00010000:0.0:1788684561.195049:0:24244:0:(ldlm_request.c:377:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000006e3fc98/0x44bac02bd54ae51f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 24244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684561.195059:0:24244:0:(ldlm_request.c:1415:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000006e3fc98/0x44bac02bd54ae51f lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 24244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684561.195096:0:24244:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000006e3fc98/0x44bac02bd54ae51f lrc: 2/0,0 mode: --/PW res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 24244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788684561.195105:0:24244:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000006e3fc98/0x44bac02bd54ae51f lrc: 0/0,0 mode: --/PW res: [0x280000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 24244 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788684561.195262:0:24244:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d664856c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:4099400f-835c-46aa-bd1f-63cdd511e591+5:2392:x1875571073257984:12345-192.168.206.44@tcp:4:dd.0 Request processed in 243552us (246150us total) trans 12884901896 rc 0/0 00000100:00100000:0.0:1788684561.195274:0:24244:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 0 00000040:00080000:2.0:1788684561.342027:0:23489:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:1.0:1788684561.596088:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:1.0:1788684561.596139:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:1.0:1788684561.596168:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:1.0:1788684561.596204:0:3618:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:3.0:1788684561.596230:0:23765:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073258624 00000100:00100000:1.0:1788684561.596231:0:22732:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073259136 00000100:00100000:3.0:1788684561.596242:0:23765:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073258624 00000100:00100000:1.0:1788684561.596242:0:22732:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073259136 00000100:00100000:2.0:1788684561.596272:0:22727:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073258368 00000100:00100000:2.0:1788684561.596276:0:22727:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073258368 00000100:00100000:0.0:1788684561.596332:0:24240:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073258880 00000100:00100000:0.0:1788684561.596342:0:24240:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073258880 00000100:00100000:0.0:1788684561.596409:0:24240:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 16 00000100:00100000:0.0:1788684561.596419:0:24240:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d677fab5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4099400f-835c-46aa-bd1f-63cdd511e591+5:2392:x1875571073258880:12345-192.168.206.44@tcp:400:kworker.0 00000100:00100000:0.0:1788684561.596483:0:24240:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d677fab5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:4099400f-835c-46aa-bd1f-63cdd511e591+5:2392:x1875571073258880:12345-192.168.206.44@tcp:400:kworker.0 Request processed in 66us (315us total) trans 0 rc 0/0 00000100:00100000:0.0:1788684561.596490:0:24240:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 16 00000100:00100000:0.0:1788684561.596513:0:22733:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 55 00000100:00100000:0.0:1788684561.596519:0:22733:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d677fab6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4099400f-835c-46aa-bd1f-63cdd511e591+5:2392:x1875571073258624:12345-192.168.206.44@tcp:400:kworker.0 00000100:00100000:0.0:1788684561.596544:0:22733:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d677fab6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:4099400f-835c-46aa-bd1f-63cdd511e591+5:2392:x1875571073258624:12345-192.168.206.44@tcp:400:kworker.0 Request processed in 25us (406us total) trans 0 rc 0/0 00000100:00100000:0.0:1788684561.596550:0:22733:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 55 00000100:00100000:2.0:1788684561.596623:0:22727:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 166 00000100:00100000:2.0:1788684561.596631:0:22727:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6746cae450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9f969391-6479-4864-94e2-df3227346f88+13:2392:x1875571073258368:12345-192.168.206.44@tcp:400:kworker.0 00000100:00100000:2.0:1788684561.596657:0:22727:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6746cae450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:9f969391-6479-4864-94e2-df3227346f88+13:2392:x1875571073258368:12345-192.168.206.44@tcp:400:kworker.0 Request processed in 28us (581us total) trans 0 rc 0/0 00000100:00100000:2.0:1788684561.596662:0:22727:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 166 00000100:00100000:2.0:1788684561.596704:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:2.0:1788684561.596762:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:2.0:1788684561.596797:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:2.0:1788684561.596869:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:2.0:1788684561.596884:0:3617:0:(events.c:344:request_in_callback()) peer: 12345-192.168.206.44@tcp (source: 12345-192.168.206.44@tcp) 00000100:00100000:2.0:1788684561.596929:0:24238:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073259392 00000100:00100000:2.0:1788684561.596934:0:24238:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073259392 00000100:00100000:2.0:1788684561.596975:0:24238:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073258752 00000100:00100000:2.0:1788684561.596979:0:24238:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073258752 00000100:00100000:2.0:1788684561.596990:0:24238:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073259264 00000100:00100000:2.0:1788684561.596992:0:24238:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073259264 00000100:00100000:2.0:1788684561.597007:0:24238:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 17 00000100:00100000:2.0:1788684561.597013:0:24238:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6647a61180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0e62701e-7d60-4e2d-bd52-05ee75d6c929+5:2392:x1875571073259392:12345-192.168.206.44@tcp:400:kworker.0 00000100:00100000:2.0:1788684561.597044:0:24238:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6647a61180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0e62701e-7d60-4e2d-bd52-05ee75d6c929+5:2392:x1875571073259392:12345-192.168.206.44@tcp:400:kworker.0 Request processed in 32us (340us total) trans 0 rc 0/0 00000100:00100000:2.0:1788684561.597051:0:24238:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 17 00000100:00100000:2.0:1788684561.597062:0:24238:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 18 00000100:00100000:2.0:1788684561.597081:0:24238:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d677fbc0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4099400f-835c-46aa-bd1f-63cdd511e591+5:2392:x1875571073258752:12345-192.168.206.44@tcp:400:kworker.0 00000100:00100000:2.0:1788684561.597107:0:24238:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d677fbc0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:4099400f-835c-46aa-bd1f-63cdd511e591+5:2392:x1875571073258752:12345-192.168.206.44@tcp:400:kworker.0 Request processed in 28us (310us total) trans 0 rc 0/0 00000100:00100000:2.0:1788684561.597113:0:24238:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 18 00000100:00100000:2.0:1788684561.597124:0:24238:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 19 00000100:00100000:2.0:1788684561.597130:0:24238:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d677fbc2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0e62701e-7d60-4e2d-bd52-05ee75d6c929+5:2392:x1875571073259264:12345-192.168.206.44@tcp:400:kworker.0 00000100:00100000:2.0:1788684561.597151:0:24238:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d677fbc2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0e62701e-7d60-4e2d-bd52-05ee75d6c929+5:2392:x1875571073259264:12345-192.168.206.44@tcp:400:kworker.0 Request processed in 22us (266us total) trans 0 rc 0/0 00000100:00100000:2.0:1788684561.597157:0:24238:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 19 00000100:00080000:2.0:1788684561.597237:0:22728:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788684561.597242:0:22728:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788684561.597245:0:22728:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788684561.597262:0:22734:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073258496 00000100:00100000:2.0:1788684561.597265:0:22734:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073258496 00000100:00100000:3.0:1788684561.600051:0:23765:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571073259008 00000100:00100000:3.0:1788684561.600069:0:23765:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571073259008 00000100:00100000:1.0:1788684561.602161:0:22732:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 56 00000100:00100000:1.0:1788684561.602185:0:22732:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d677fab4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0e62701e-7d60-4e2d-bd52-05ee75d6c929+5:2392:x1875571073259136:12345-192.168.206.44@tcp:400:kworker.0 00000100:00100000:1.0:1788684561.603613:0:22732:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d677fab4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0e62701e-7d60-4e2d-bd52-05ee75d6c929+5:2392:x1875571073259136:12345-192.168.206.44@tcp:400:kworker.0 Request processed in 1433us (7401us total) trans 0 rc 0/0 00000100:00100000:1.0:1788684561.603626:0:22732:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 56 00000100:00080000:1.0:1788684561.603809:0:22728:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788684561.607044:0:22734:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 57 00000100:00100000:2.0:1788684561.607063:0:22734:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d677fbc3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4099400f-835c-46aa-bd1f-63cdd511e591+22:2392:x1875571073258496:12345-192.168.206.44@tcp:400:kworker.0 00000100:00100000:2.0:1788684561.607155:0:22734:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d677fbc3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:4099400f-835c-46aa-bd1f-63cdd511e591+22:2392:x1875571073258496:12345-192.168.206.44@tcp:400:kworker.0 Request processed in 99us (10392us total) trans 0 rc 0/0 00000100:00100000:2.0:1788684561.607162:0:22734:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 57 00000100:00100000:2.0:1788684561.607180:0:22734:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.206.44@tcp, seq: 58 00000100:00100000:2.0:1788684561.607186:0:22734:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d677fbc0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0e62701e-7d60-4e2d-bd52-05ee75d6c929+6:2392:x1875571073259008:12345-192.168.206.44@tcp:400:kworker.0 00000100:00100000:2.0:1788684561.607211:0:22734:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d677fbc0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0e62701e-7d60-4e2d-bd52-05ee75d6c929+6:2392:x1875571073259008:12345-192.168.206.44@tcp:400:kworker.0 Request processed in 26us (10343us total) trans 0 rc 0/0 00000100:00100000:2.0:1788684561.607218:0:22734:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.206.44@tcp, seq: 58 00000100:00100000:1.0:1788684562.045985:0:3626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d677fab5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3626:1875571085939456:0@lo:400:kworker.0 00000100:00100000:1.0:1788684562.046101:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788684562.046419:0:3626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d664876c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3626:1875571085939968:0@lo:400:kworker.0 00000100:00100000:1.0:1788684562.046455:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788684562.046480:0:3626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d664876f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3626:1875571085940480:0@lo:400:kworker.0 00000100:00100000:1.0:1788684562.046534:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788684562.046564:0:3626:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [2->3] 00000100:00100000:1.0:1788684562.046572:0:3626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d677fab5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:cebd1789-51a4-46ff-b167-6b1633e930a1:3626:1875571085939328:0@lo:400:kworker.0 00000100:00100000:1.0:1788684562.046605:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788684562.046640:0:3626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d677fab6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3626:1875571085939840:0@lo:400:kworker.0 00000100:00100000:1.0:1788684562.046668:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788684562.046699:0:3626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d664876e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3626:1875571085940352:0@lo:400:kworker.0 00000100:00100000:1.0:1788684562.046725:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788684562.046749:0:3626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d677fa82a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3626:1875571085940864:0@lo:400:kworker.0 00000100:00100000:0.0:1788684562.046912:0:22733:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085940480 00000100:00100000:0.0:1788684562.046923:0:22733:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085940480 00000100:00100000:0.0:1788684562.046992:0:22733:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085939840 00000100:00100000:0.0:1788684562.047003:0:22733:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085939840 00000100:00100000:1.0:1788684562.048312:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788684562.048379:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d677fab4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3623:1875571085939584:0@lo:400:kworker.0 00000100:00100000:1.0:1788684562.048417:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788684562.048439:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d664876c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3623:1875571085940096:0@lo:400:kworker.0 00000100:00100000:1.0:1788684562.048458:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788684562.048475:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d677fa83100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3623:1875571085940608:0@lo:400:kworker.0 00000100:00100000:1.0:1788684562.048493:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788684562.048511:0:3623:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:1.0:1788684562.048518:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d677fab6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3623:1875571085939712:0@lo:400:kworker.0 00000100:00100000:1.0:1788684562.048539:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788684562.048560:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d664876e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3623:1875571085940224:0@lo:400:kworker.0 00000100:00100000:1.0:1788684562.048584:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788684562.048604:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d677fa81880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3623:1875571085940736:0@lo:400:kworker.0 00000100:00100000:1.0:1788684562.048624:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788684562.048655:0:24164:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085939456 00000100:00100000:1.0:1788684562.048668:0:24164:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085939456 00000100:00100000:1.0:1788684562.048709:0:24164:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085939968 00000100:00100000:1.0:1788684562.048712:0:24164:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085939968 00000100:00100000:1.0:1788684562.048726:0:24164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1788684562.048734:0:24164:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6747a6d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3626:x1875571085939456:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788684562.048790:0:24164:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6747a6d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3626:x1875571085939456:12345-0@lo:400:kworker.0 Request processed in 57us (2691us total) trans 0 rc 0/0 00000100:00100000:1.0:1788684562.048797:0:24164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1788684562.048813:0:24164:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1788684562.048819:0:24164:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6747a6c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3626:x1875571085939968:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788684562.048844:0:24164:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6747a6c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3626:x1875571085939968:12345-0@lo:400:kworker.0 Request processed in 26us (2389us total) trans 0 rc 0/0 00000100:00100000:1.0:1788684562.048850:0:24164:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1788684562.048870:0:22732:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085940352 00000100:00100000:1.0:1788684562.048873:0:22732:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085940352 00000100:00100000:1.0:1788684562.048891:0:22732:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085940864 00000100:00100000:1.0:1788684562.048893:0:22732:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085940864 00000100:00100000:1.0:1788684562.048919:0:22732:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085940608 00000100:00100000:1.0:1788684562.048922:0:22732:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085940608 00000100:00100000:1.0:1788684562.048934:0:22732:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085940736 00000100:00100000:1.0:1788684562.048936:0:22732:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085940736 00000100:00100000:1.0:1788684562.048952:0:22732:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1788684562.048960:0:22732:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6747a6f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3626:x1875571085940480:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788684562.048991:0:22732:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6747a6f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3626:x1875571085940480:12345-0@lo:400:kworker.0 Request processed in 32us (2456us total) trans 0 rc 0/0 00000100:00100000:1.0:1788684562.048997:0:22732:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1788684562.049009:0:22732:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1788684562.049333:0:23765:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1788684562.049344:0:23765:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6645a00700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3626:x1875571085940864:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788684562.049409:0:23765:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6645a00700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3626:x1875571085940864:12345-0@lo:400:kworker.0 Request processed in 68us (1103us total) trans 0 rc 0/0 00000100:00100000:3.0:1788684562.049415:0:23765:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1788684562.049430:0:23765:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1788684562.049435:0:23765:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6645a01880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3623:x1875571085940608:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788684562.049464:0:23765:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6645a01880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3623:x1875571085940608:12345-0@lo:400:kworker.0 Request processed in 30us (970us total) trans 0 rc 0/0 00000100:00100000:3.0:1788684562.049470:0:23765:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1788684562.049489:0:23765:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1788684562.049494:0:23765:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6645a03100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3623:x1875571085940736:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788684562.049521:0:23765:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6645a03100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3623:x1875571085940736:12345-0@lo:400:kworker.0 Request processed in 27us (895us total) trans 0 rc 0/0 00000100:00100000:3.0:1788684562.049527:0:23765:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1788684562.049574:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d677fa81880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3623:1875571085940736:0@lo:400:kworker.0 00010000:00080000:3.0:1788684562.049589:0:3623:0:(ldlm_request.c:1670:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d677fa83100 x1875571085940608/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788684578 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788684562.049600:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d677fa83100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3623:1875571085940608:0@lo:400:kworker.0 00000100:00100000:3.0:1788684562.049665:0:24240:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085939584 00000100:00100000:3.0:1788684562.049669:0:24240:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085939584 00000100:00100000:3.0:1788684562.049702:0:24240:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085940096 00000100:00100000:3.0:1788684562.049705:0:24240:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085940096 00000100:00100000:3.0:1788684562.049716:0:24240:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085939712 00000100:00100000:3.0:1788684562.049718:0:24240:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085939712 00000100:00100000:3.0:1788684562.049729:0:24240:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085940224 00000100:00100000:3.0:1788684562.049731:0:24240:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085940224 00000100:00100000:3.0:1788684562.049742:0:24240:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1788684562.049748:0:24240:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6645a01c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3623:x1875571085939584:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788684562.049796:0:24240:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6645a01c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3623:x1875571085939584:12345-0@lo:400:kworker.0 Request processed in 47us (1377us total) trans 0 rc 0/0 00000100:00100000:3.0:1788684562.049802:0:24240:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1788684562.049814:0:24240:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1788684562.049819:0:24240:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6645a03b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3623:x1875571085940096:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788684562.049841:0:24240:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6645a03b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3623:x1875571085940096:12345-0@lo:400:kworker.0 Request processed in 23us (1382us total) trans 0 rc 0/0 00000100:00100000:3.0:1788684562.049856:0:24240:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1788684562.049866:0:24240:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1788684562.049872:0:24240:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6645a02680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3623:x1875571085939712:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788684562.049912:0:24240:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6645a02680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3623:x1875571085939712:12345-0@lo:400:kworker.0 Request processed in 40us (1371us total) trans 0 rc 0/0 00000100:00100000:3.0:1788684562.049917:0:24240:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1788684562.049928:0:24240:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1788684562.049935:0:24240:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6645a00e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3623:x1875571085940224:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788684562.049962:0:24240:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6645a00e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3623:x1875571085940224:12345-0@lo:400:kworker.0 Request processed in 28us (1378us total) trans 0 rc 0/0 00000100:00100000:3.0:1788684562.049968:0:24240:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00080000:3.0:1788684562.049989:0:22728:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788684562.049994:0:22728:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788684562.049996:0:22728:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1788684562.049999:0:22728:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788684562.050225:0:22725:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085939328 00000100:00100000:3.0:1788684562.050231:0:22725:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085939328 00000100:00100000:3.0:1788684562.050267:0:22725:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 167 00000100:00100000:3.0:1788684562.050274:0:22725:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6746caf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cebd1789-51a4-46ff-b167-6b1633e930a1+24:3626:x1875571085939328:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788684562.050322:0:22725:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6746caf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cebd1789-51a4-46ff-b167-6b1633e930a1+24:3626:x1875571085939328:12345-0@lo:400:kworker.0 Request processed in 49us (3717us total) trans 0 rc 0/0 00000100:00100000:3.0:1788684562.050328:0:22725:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 167 00000100:00100000:3.0:1788684562.050423:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d677fab6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3623:1875571085939712:0@lo:400:kworker.0 00000100:00100000:3.0:1788684562.050434:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d664876e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3623:1875571085940224:0@lo:400:kworker.0 00000100:00100000:3.0:1788684562.050445:0:3623:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 12884901894 gen 2 00000004:00080000:3.0:1788684562.050457:0:3623:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff8d664856df80, transno 12884901892 00000004:00080000:3.0:1788684562.050469:0:3623:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 12884901894 committed transno 12884901894 00000100:00100000:3.0:1788684562.050489:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d677fab4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3623:1875571085939584:0@lo:400:kworker.0 00000100:00100000:3.0:1788684562.050503:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d664876c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3623:1875571085940096:0@lo:400:kworker.0 00000100:00100000:2.0:1788684562.050876:0:3625:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788684562.050908:0:3625:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d677fbc3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3625:1875571085940992:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788684562.050957:0:3625:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788684562.050998:0:24243:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085940992 00000100:00100000:2.0:1788684562.051003:0:24243:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085940992 00000100:00100000:2.0:1788684562.051047:0:24243:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1788684562.051054:0:24243:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d66479a4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3625:x1875571085940992:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1788684562.051079:0:24243:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3915849728 avail 3684327424 00000100:00100000:2.0:1788684562.051277:0:24243:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d66479a4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3625:x1875571085940992:12345-0@lo:13:osp-pre-1-1.0 Request processed in 222us (318us total) trans 0 rc 0/0 00000100:00100000:2.0:1788684562.051285:0:24243:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1788684562.051326:0:3625:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d677fbc3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3625:1875571085940992:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788684562.051343:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d66479a7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3623:1875571085941120:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788684562.051396:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788684562.051418:0:24243:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085941120 00000100:00100000:2.0:1788684562.051421:0:24243:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085941120 00000100:00100000:2.0:1788684562.051438:0:24243:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1788684562.051443:0:24243:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d66479a5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3623:x1875571085941120:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788684562.051459:0:24243:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 4218880 granted 26324672 pending 0 free 3915857920 avail 3684335616 00000100:00100000:2.0:1788684562.051485:0:24243:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d66479a5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3623:x1875571085941120:12345-0@lo:13:osp-pre-0-0.0 Request processed in 42us (89us total) trans 0 rc 0/0 00000100:00100000:2.0:1788684562.051491:0:24243:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1788684562.051526:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d66479a7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3623:1875571085941120:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788684562.051804:0:3626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d677fab5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:cebd1789-51a4-46ff-b167-6b1633e930a1:3626:1875571085939328:0@lo:400:kworker.0 00010000:00080000:2.0:1788684562.051823:0:3626:0:(ldlm_request.c:1670:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff8d677fa82a00 x1875571085940864/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788684578 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788684562.051848:0:3626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d677fa82a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3626:1875571085940864:0@lo:400:kworker.0 00000100:00100000:2.0:1788684562.051863:0:3626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d677fab5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3626:1875571085939456:0@lo:400:kworker.0 00000100:00100000:2.0:1788684562.051875:0:3626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d664876c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3626:1875571085939968:0@lo:400:kworker.0 00000100:00100000:2.0:1788684562.051888:0:3626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d664876f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3626:1875571085940480:0@lo:400:kworker.0 00000100:00100000:0.0:1788684562.052051:0:22733:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1788684562.052061:0:22733:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6747a6d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3626:x1875571085939840:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788684562.052108:0:22733:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6747a6d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3626:x1875571085939840:12345-0@lo:400:kworker.0 Request processed in 50us (5440us total) trans 0 rc 0/0 00000100:00100000:0.0:1788684562.052267:0:22733:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1788684562.052301:0:3626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d677fab6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3626:1875571085939840:0@lo:400:kworker.0 00000100:00100000:1.0:1788684562.056654:0:22732:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d6747a6ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3626:x1875571085940352:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788684562.056886:0:22732:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d6747a6ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3626:x1875571085940352:12345-0@lo:400:kworker.0 Request processed in 7866us (10155us total) trans 0 rc 0/0 00000100:00100000:1.0:1788684562.056908:0:22732:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1788684562.057007:0:3626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d664876e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3626:1875571085940352:0@lo:400:kworker.0 00000100:00100000:3.0:1788684562.057357:0:3623:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788684562.057395:0:3623:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d664856df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3623:1875571085941248:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788684562.057453:0:3623:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788684562.057501:0:24243:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085941248 00000100:00100000:3.0:1788684562.057509:0:24243:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085941248 00000100:00100000:3.0:1788684562.057564:0:24243:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1788684562.057574:0:24243:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d664856d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3623:x1875571085941248:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788684562.057597:0:24243:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3915849728 avail 3684327424 00000100:00100000:3.0:1788684562.057641:0:24243:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d664856d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3623:x1875571085941248:12345-0@lo:13:osp-pre-1-0.0 Request processed in 69us (189us total) trans 0 rc 0/0 00000100:00100000:3.0:1788684562.057648:0:24243:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1788684562.057691:0:3623:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d664856df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3623:1875571085941248:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1788684562.110811:0:22720:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1788684562.698827:0:25815:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: sanity-pcc test_1d: @@@@@@ FAIL: expected /mnt/pcc.d1d.sanity-pcc/d1d.sanity-pcc/13a3/0x2000013a1:0x2:0x0 size: 7654321 got: 0 00010000:00010000:2.0:1788684563.133538:0:25183:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788684564.095082:0:3625:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff8d6645a03800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3625:1875571085941376:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788684564.095234:0:3625:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788684564.098012:0:24243:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875571085941376 00000100:00100000:1.0:1788684564.098153:0:24243:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875571085941376 00000100:00100000:3.0:1788684564.099569:0:24243:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1788684564.099588:0:24243:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff8d66479a7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3625:x1875571085941376:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1788684564.099629:0:24243:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 4218880 granted 26324672 pending 0 free 3915857920 avail 3684335616 00000100:00100000:3.0:1788684564.099736:0:24243:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff8d66479a7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3625:x1875571085941376:12345-0@lo:13:osp-pre-0-1.0 Request processed in 153us (4502us total) trans 0 rc 0/0 00000100:00100000:3.0:1788684564.099744:0:24243:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00080000:1.0:1788684564.099829:0:22728:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788684564.103068:0:3625:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff8d6645a03800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3625:1875571085941376:0@lo:13:osp-pre-0-1.0 00010000:00010000:3.0:1788684564.160159:0:22721:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) Debug log: 14051 lines, 14051 kept, 0 dropped, 0 bad.