00000100:00100000:2.0F:1789403460.681091:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:3.0F:1789403460.681194:0:17217:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038171648 00000100:00100000:3.0:1789403460.681212:0:17217:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038171648 00000100:00100000:3.0:1789403460.681280:0:17217:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 165 00000100:00100000:3.0:1789403460.681291:0:17217:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a248410050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:70eabb3e-21f5-4353-a0a0-bbe22517a3d6+13:2390:x1876325038171648:12345-192.168.203.43@tcp:400:kworker.0 00000100:00100000:3.0:1789403460.681380:0:17217:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a248410050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:70eabb3e-21f5-4353-a0a0-bbe22517a3d6+13:2390:x1876325038171648:12345-192.168.203.43@tcp:400:kworker.0 Request processed in 91us (300us total) trans 0 rc 0/0 00000100:00100000:3.0:1789403460.681422:0:17217:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 165 00000100:00100000:2.0:1789403460.688957:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:2.0:1789403460.688994:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:2.0:1789403460.689028:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:2.0:1789403460.689052:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:2.0:1789403460.689072:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:2.0:1789403460.689111:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:2.0:1789403460.689140:0:18731:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038172160 00000100:00100000:2.0:1789403460.689149:0:18731:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038172160 00000100:00100000:2.0:1789403460.689206:0:18731:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038172672 00000100:00100000:2.0:1789403460.689209:0:18731:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038172672 00000100:00100000:2.0:1789403460.689236:0:18731:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038172032 00000100:00100000:2.0:1789403460.689239:0:18731:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038172032 00000100:00100000:2.0:1789403460.689263:0:18731:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 21 00000100:00100000:2.0:1789403460.689274:0:18731:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a1442b7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6e04e948-ba92-4319-8cea-8a865bfd1e14+5:2390:x1876325038172160:12345-192.168.203.43@tcp:400:kworker.0 00000100:00100000:2.0:1789403460.689344:0:18731:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a1442b7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6e04e948-ba92-4319-8cea-8a865bfd1e14+5:2390:x1876325038172160:12345-192.168.203.43@tcp:400:kworker.0 Request processed in 73us (314us total) trans 0 rc 0/0 00000100:00100000:2.0:1789403460.689367:0:18731:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 21 00000100:00100000:2.0:1789403460.689408:0:18731:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 22 00000100:00100000:2.0:1789403460.689417:0:18731:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a281912300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0fd9fbb3-6ee9-4661-b027-6d4be7a889f0+5:2390:x1876325038172672:12345-192.168.203.43@tcp:400:kworker.0 00000100:00100000:0.0F:1789403460.689477:0:17226:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038171776 00000100:00100000:0.0:1789403460.689488:0:17226:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038171776 00000100:00100000:1.0F:1789403460.689665:0:17225:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038171904 00000100:00100000:1.0:1789403460.689676:0:17225:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038171904 00000100:00100000:0.0:1789403460.689713:0:17226:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038172416 00000100:00100000:0.0:1789403460.689718:0:17226:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038172416 00000100:00100000:2.0:1789403460.689722:0:18731:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a281912300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0fd9fbb3-6ee9-4661-b027-6d4be7a889f0+5:2390:x1876325038172672:12345-192.168.203.43@tcp:400:kworker.0 Request processed in 304us (646us total) trans 0 rc 0/0 00000100:00100000:2.0:1789403460.689741:0:18731:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 22 00000100:00100000:2.0:1789403460.689758:0:18731:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 23 00000100:00100000:2.0:1789403460.689765:0:18731:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a143510700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6e04e948-ba92-4319-8cea-8a865bfd1e14+5:2389:x1876325038172032:12345-192.168.203.43@tcp:400:kworker.0 00000100:00100000:2.0:1789403460.689791:0:18731:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a143510700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:6e04e948-ba92-4319-8cea-8a865bfd1e14+5:2389:x1876325038172032:12345-192.168.203.43@tcp:400:kworker.0 Request processed in 28us (680us total) trans 0 rc 0/0 00000100:00100000:2.0:1789403460.689806:0:18731:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 23 00000100:00100000:0.0:1789403460.692835:0:17226:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 59 00000100:00100000:0.0:1789403460.692854:0:17226:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a1442eca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6e04e948-ba92-4319-8cea-8a865bfd1e14+22:2389:x1876325038171776:12345-192.168.203.43@tcp:400:kworker.0 00000100:00100000:0.0:1789403460.692929:0:17226:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a1442eca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6e04e948-ba92-4319-8cea-8a865bfd1e14+22:2389:x1876325038171776:12345-192.168.203.43@tcp:400:kworker.0 Request processed in 83us (3979us total) trans 0 rc 0/0 00000100:00100000:0.0:1789403460.692938:0:17226:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 59 00000100:00100000:0.0:1789403460.692959:0:17226:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 60 00000100:00100000:0.0:1789403460.692967:0:17226:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a1442ee680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6e04e948-ba92-4319-8cea-8a865bfd1e14+5:2390:x1876325038171904:12345-192.168.203.43@tcp:400:kworker.0 00000100:00100000:0.0:1789403460.692993:0:17226:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a1442ee680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6e04e948-ba92-4319-8cea-8a865bfd1e14+5:2390:x1876325038171904:12345-192.168.203.43@tcp:400:kworker.0 Request processed in 27us (3998us total) trans 0 rc 0/0 00000100:00100000:0.0:1789403460.693000:0:17226:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 60 00000100:00100000:0.0:1789403460.693015:0:17226:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 61 00000100:00100000:0.0:1789403460.693023:0:17226:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a142500700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0fd9fbb3-6ee9-4661-b027-6d4be7a889f0+5:2390:x1876325038172416:12345-192.168.203.43@tcp:400:kworker.0 00000100:00100000:0.0:1789403460.693049:0:17226:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a142500700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0fd9fbb3-6ee9-4661-b027-6d4be7a889f0+5:2390:x1876325038172416:12345-192.168.203.43@tcp:400:kworker.0 Request processed in 28us (3996us total) trans 0 rc 0/0 00000100:00100000:0.0:1789403460.693056:0:17226:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 61 00000100:00080000:2.0:1789403460.693468:0:17220:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1789403460.693474:0:17220:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789403460.693478:0:17220:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1789403460.693480:0:17220:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789403460.693592:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:0.0:1789403460.693639:0:17225:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038172288 00000100:00100000:0.0:1789403460.693648:0:17225:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038172288 00000100:00100000:2.0:1789403460.693671:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00080000:2.0:1789403460.693754:0:17220:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789403460.693767:0:18731:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038172544 00000100:00100000:2.0:1789403460.693772:0:18731:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038172544 00000100:00100000:0.0:1789403460.693775:0:17225:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 62 00000100:00100000:0.0:1789403460.693786:0:17225:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a143512a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0fd9fbb3-6ee9-4661-b027-6d4be7a889f0+6:2389:x1876325038172288:12345-192.168.203.43@tcp:400:kworker.0 00000100:00100000:2.0:1789403460.693810:0:18731:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 24 00000100:00100000:2.0:1789403460.693820:0:18731:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a143511180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0fd9fbb3-6ee9-4661-b027-6d4be7a889f0+5:2389:x1876325038172544:12345-192.168.203.43@tcp:400:kworker.0 00000100:00100000:0.0:1789403460.693831:0:17225:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a143512a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0fd9fbb3-6ee9-4661-b027-6d4be7a889f0+6:2389:x1876325038172288:12345-192.168.203.43@tcp:400:kworker.0 Request processed in 46us (238us total) trans 0 rc 0/0 00000100:00100000:0.0:1789403460.693839:0:17225:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 62 00000100:00100000:2.0:1789403460.693855:0:18731:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a143511180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0fd9fbb3-6ee9-4661-b027-6d4be7a889f0+5:2389:x1876325038172544:12345-192.168.203.43@tcp:400:kworker.0 Request processed in 35us (182us total) trans 0 rc 0/0 00000100:00100000:2.0:1789403460.693863:0:18731:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 24 00000100:00080000:2.0:1789403460.693885:0:17220:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1789403460.850065:0:17213:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789403461.874002:0:17978:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1789403461.884326:0:17204:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934623 is committed 00000020:00080000:2.0:1789403461.884351:0:17204:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff90a27a7be600 refcount 2 committed 0 result 0 batchid 4294967529 00000020:00080000:2.0:1789403461.884356:0:17204:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff90a252797400 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff90a27a7bec00 00000020:00080000:2.0:1789403461.884359:0:17204:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff90a252797c00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff90a281a68200 00010000:00010000:2.0:1789403461.884415:0:3613:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90a248af1a00/0x5fb08b1e5b76249a lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 19353 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403461.884426:0:3613:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a248af1a00/0x5fb08b1e5b76249a lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 19353 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403461.884434:0:3613:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90a248af1a00/0x5fb08b1e5b76249a lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 19353 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403461.884457:0:3613:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a248af1a00 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:2.0:1789403461.884462:0:3613:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a248af1a00/0x5fb08b1e5b76249a lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 19353 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403461.884469:0:3613:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a248af1a00/0x5fb08b1e5b76249a lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 19353 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403461.884486:0:3613:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff90a142512000) 00010000:00010000:2.0:1789403461.884489:0:3613:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789403461.884494:0:3613:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90a248af1a00/0x5fb08b1e5b76249a lrc: 2/0,0 mode: --/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 19353 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403461.884500:0:3613:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a248af1a00/0x5fb08b1e5b76249a lrc: 0/0,0 mode: --/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 19353 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00080000:2.0:1789403461.884535:0:17263:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 4294967529 committed batchid 8 00000020:00080000:2.0:1789403461.884606:0:17263:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000100:00100000:3.0:1789403462.385704:0:3627:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a1441d9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3627:1876325050821632:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1789403462.385780:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789403462.385861:0:18735:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050821632 00000100:00100000:1.0:1789403462.385869:0:18735:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050821632 00000100:00100000:1.0:1789403462.385935:0:18735:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1789403462.385945:0:18735:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a144b2b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3627:x1876325050821632:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1789403462.385973:0:18735:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 4218880 granted 26324672 pending 0 free 3915849728 avail 3684327424 00000100:00080000:0.0:1789403462.387021:0:17220:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789403462.387253:0:18735:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a144b2b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3627:x1876325050821632:12345-0@lo:13:osp-pre-0-1.0 Request processed in 1307us (1469us total) trans 0 rc 0/0 00000100:00100000:1.0:1789403462.387266:0:18735:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1789403462.391049:0:3627:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a1441d9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3627:1876325050821632:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1789403462.879598:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:0.0:1789403462.879645:0:17226:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038172800 00000100:00100000:0.0:1789403462.879654:0:17226:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038172800 00000100:00100000:0.0:1789403462.879739:0:17226:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 65 00000100:00100000:0.0:1789403462.879751:0:17226:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a143511500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6e04e948-ba92-4319-8cea-8a865bfd1e14+13:15568:x1876325038172800:12345-192.168.203.43@tcp:60:lhsmtool_posix.0 00000100:00100000:0.0:1789403462.879873:0:17226:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a143511500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6e04e948-ba92-4319-8cea-8a865bfd1e14+13:15568:x1876325038172800:12345-192.168.203.43@tcp:60:lhsmtool_posix.0 Request processed in 116us (274us total) trans 0 rc 0/0 00000100:00100000:0.0:1789403462.879882:0:17226:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 65 00000100:00080000:1.0:1789403462.879885:0:17220:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789403462.886531:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:1.0:1789403462.893073:0:17225:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038172928 00000100:00100000:1.0:1789403462.893085:0:17225:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038172928 00000100:00100000:1.0:1789403462.893194:0:17225:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 66 00000100:00100000:1.0:1789403462.893206:0:17225:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a1441dad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6e04e948-ba92-4319-8cea-8a865bfd1e14+5:15568:x1876325038172928:12345-192.168.203.43@tcp:60:lhsmtool_posix.0 00000100:00100000:1.0:1789403462.893309:0:17225:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a1441dad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:6e04e948-ba92-4319-8cea-8a865bfd1e14+5:15568:x1876325038172928:12345-192.168.203.43@tcp:60:lhsmtool_posix.0 Request processed in 105us (6786us total) trans 0 rc 0/0 00000100:00100000:1.0:1789403462.893316:0:17225:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 66 00000100:00080000:0.0:1789403462.900200:0:17220:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:2.0:1789403462.900366:0:17212:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789403462.900805:0:3629:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1789403462.900826:0:3629:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a143513800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3629:1876325050821760:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1789403462.900888:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789403462.900935:0:17229:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050821760 00000100:00100000:2.0:1789403462.900944:0:17229:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050821760 00000100:00100000:2.0:1789403462.900997:0:17229:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1789403462.901007:0:17229:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a1441d9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3629:x1876325050821760:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1789403462.901038:0:17229:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:2.0:1789403462.901092:0:17229:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a1441d9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3629:x1876325050821760:12345-0@lo:41:osp-pre-1-0.0 Request processed in 87us (203us total) trans 0 rc 0/0 00000100:00100000:2.0:1789403462.901100:0:17229:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1789403462.904129:0:3629:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a143513800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3629:1876325050821760:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1789403462.905599:0:3629:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a143513800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3629:1876325050821888:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1789403462.905663:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789403462.905760:0:17230:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050821888 00000100:00100000:1.0:1789403462.905769:0:17230:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050821888 00000100:00100000:1.0:1789403462.905817:0:17230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1789403462.905827:0:17230:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a144b2ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3629:x1876325050821888:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1789403462.905857:0:17230:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446293504 avail 1300054016 00000100:00100000:1.0:1789403462.909252:0:17230:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a144b2ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3629:x1876325050821888:12345-0@lo:41:osp-pre-0-1.0 Request processed in 3417us (3579us total) trans 0 rc 0/0 00000100:00100000:1.0:1789403462.909268:0:17230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1789403462.912648:0:3629:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a143513800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3629:1876325050821888:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1789403462.912813:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:3.0:1789403462.912997:0:17228:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038173184 00000100:00100000:3.0:1789403462.913004:0:17228:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038173184 00000100:00100000:3.0:1789403462.913052:0:17228:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 12 00000100:00100000:3.0:1789403462.913060:0:17228:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a144048380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6e04e948-ba92-4319-8cea-8a865bfd1e14+13:15568:x1876325038173184:12345-192.168.203.43@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1789403462.913249:0:17228:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a144048380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6e04e948-ba92-4319-8cea-8a865bfd1e14+14:15568:x1876325038173184:12345-192.168.203.43@tcp:35:lhsmtool_posix.0 Request processed in 189us (440us total) trans 8589934624 rc 0/0 00000100:00100000:3.0:1789403462.913257:0:17228:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 12 00010000:00010000:3.0:1789403463.922417:0:17213:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789403464.947531:0:3627:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1789403464.947559:0:3627:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a143513800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3627:1876325050822016:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789403464.947624:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1789403464.948032:0:17978:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789403464.950960:0:3628:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a144b29880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3628:1876325050822272:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1789403464.951019:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789403464.951092:0:18734:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050822016 00000100:00100000:3.0:1789403464.951100:0:18734:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050822016 00000100:00100000:3.0:1789403464.951146:0:18734:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050822272 00000100:00100000:3.0:1789403464.951149:0:18734:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050822272 00000100:00100000:3.0:1789403464.951164:0:18734:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1789403464.951174:0:18734:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a246f3e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3627:x1876325050822016:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789403464.951240:0:18734:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 4218880 granted 26324672 pending 0 free 3915849728 avail 3684327424 00000100:00100000:3.0:1789403464.951282:0:18734:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a246f3e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3627:x1876325050822016:12345-0@lo:13:osp-pre-0-0.0 Request processed in 110us (3658us total) trans 0 rc 0/0 00000100:00100000:3.0:1789403464.951289:0:18734:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1789403464.951305:0:18734:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1789403464.951312:0:18734:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a144b28e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3628:x1876325050822272:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1789403464.951331:0:18734:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:3.0:1789403464.951363:0:18734:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a144b28e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3628:x1876325050822272:12345-0@lo:13:osp-pre-1-1.0 Request processed in 52us (344us total) trans 0 rc 0/0 00000100:00100000:3.0:1789403464.951368:0:18734:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00080000:3.0:1789403464.951383:0:17220:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789403464.951711:0:3626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a144049880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3626:1876325050822528:0@lo:400:kworker.0 00000100:00100000:1.0:1789403464.951770:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789403464.951800:0:3626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a14404bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3626:1876325050823040:0@lo:400:kworker.0 00000100:00100000:1.0:1789403464.951824:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789403464.951842:0:3626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a14404ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3626:1876325050823552:0@lo:400:kworker.0 00000100:00100000:1.0:1789403464.951863:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789403464.951882:0:3626:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [1->0] 00000100:00100000:1.0:1789403464.951888:0:3626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a144b28380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3626:1876325050822144:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789403464.951908:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789403464.951926:0:3626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a144048e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3626:1876325050822656:0@lo:400:kworker.0 00000100:00100000:1.0:1789403464.951949:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789403464.951963:0:3626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a144049180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3626:1876325050823168:0@lo:400:kworker.0 00000100:00100000:1.0:1789403464.951999:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789403464.952017:0:3626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a144049f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3626:1876325050823680:0@lo:400:kworker.0 00000100:00100000:1.0:1789403464.952039:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789403464.952065:0:19382:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050822528 00000100:00100000:1.0:1789403464.952070:0:19382:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050822528 00000100:00100000:1.0:1789403464.952098:0:19382:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1789403464.952104:0:19382:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a144048a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3626:x1876325050822528:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789403464.952143:0:19382:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a144048a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3626:x1876325050822528:12345-0@lo:400:kworker.0 Request processed in 38us (372us total) trans 0 rc 0/0 00000100:00100000:1.0:1789403464.952148:0:19382:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1789403464.952165:0:17226:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050823552 00000100:00100000:1.0:1789403464.952169:0:17226:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050823552 00000100:00100000:1.0:1789403464.952194:0:17226:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050823168 00000100:00100000:1.0:1789403464.952197:0:17226:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050823168 00000100:00100000:1.0:1789403464.952209:0:17226:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050823680 00000100:00100000:1.0:1789403464.952217:0:17226:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050823680 00000100:00100000:1.0:1789403464.952235:0:17226:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1789403464.952242:0:17226:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a14404aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3626:x1876325050823552:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789403464.952274:0:17226:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a14404aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3626:x1876325050823552:12345-0@lo:400:kworker.0 Request processed in 33us (410us total) trans 0 rc 0/0 00000100:00100000:1.0:1789403464.952279:0:17226:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1789403464.952292:0:17226:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1789403464.952298:0:17226:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a141aaf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3626:x1876325050823168:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789403464.952320:0:17226:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a141aaf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3626:x1876325050823168:12345-0@lo:400:kworker.0 Request processed in 23us (321us total) trans 0 rc 0/0 00000100:00100000:1.0:1789403464.952324:0:17226:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1789403464.952333:0:17226:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1789403464.952338:0:17226:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a141aaea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3626:x1876325050823680:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789403464.952359:0:17226:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a141aaea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3626:x1876325050823680:12345-0@lo:400:kworker.0 Request processed in 21us (319us total) trans 0 rc 0/0 00000100:00100000:1.0:1789403464.952363:0:17226:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1789403464.952420:0:3629:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a14404a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:41b7c44b-9a12-452a-b9e6-b5b285399ec4:3629:1876325050822400:0@lo:400:kworker.0 00000100:00100000:1.0:1789403464.952451:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789403464.952475:0:3629:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a144049500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3629:1876325050822912:0@lo:400:kworker.0 00000100:00100000:1.0:1789403464.952497:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789403464.952513:0:3629:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a144048000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3629:1876325050823424:0@lo:400:kworker.0 00000100:00100000:1.0:1789403464.952531:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789403464.952547:0:3629:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:1.0:1789403464.952553:0:3629:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a14404b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3629:1876325050822784:0@lo:400:kworker.0 00000100:00100000:1.0:1789403464.952576:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789403464.952600:0:3629:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a144049c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3629:1876325050823296:0@lo:400:kworker.0 00000100:00100000:1.0:1789403464.952619:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789403464.952639:0:17218:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050822400 00000100:00100000:1.0:1789403464.952642:0:17218:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050822400 00000100:00100000:1.0:1789403464.952669:0:17218:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 166 00000100:00100000:1.0:1789403464.952675:0:17218:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a248412050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:41b7c44b-9a12-452a-b9e6-b5b285399ec4+24:3629:x1876325050822400:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789403464.952719:0:17218:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a248412050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:41b7c44b-9a12-452a-b9e6-b5b285399ec4+24:3629:x1876325050822400:12345-0@lo:400:kworker.0 Request processed in 44us (267us total) trans 0 rc 0/0 00000100:00100000:1.0:1789403464.952725:0:17218:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 166 00000100:00100000:1.0:1789403464.952749:0:17229:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050822912 00000100:00100000:1.0:1789403464.952752:0:17229:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050822912 00000100:00100000:1.0:1789403464.952773:0:17229:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1789403464.952780:0:17229:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a141aadc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3629:x1876325050822912:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789403464.952808:0:17229:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a141aadc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3629:x1876325050822912:12345-0@lo:400:kworker.0 Request processed in 29us (311us total) trans 0 rc 0/0 00000100:00100000:1.0:1789403464.952813:0:17229:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1789403464.952830:0:17225:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050823424 00000100:00100000:1.0:1789403464.952834:0:17225:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050823424 00000100:00100000:1.0:1789403464.952850:0:17225:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050822784 00000100:00100000:1.0:1789403464.952853:0:17225:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050822784 00000100:00100000:1.0:1789403464.952863:0:17225:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050823296 00000100:00100000:1.0:1789403464.952865:0:17225:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050823296 00000100:00100000:1.0:1789403464.952877:0:17225:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1789403464.952883:0:17225:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a141aace00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3629:x1876325050823424:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789403464.952914:0:17225:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a141aace00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3629:x1876325050823424:12345-0@lo:400:kworker.0 Request processed in 31us (381us total) trans 0 rc 0/0 00000100:00100000:1.0:1789403464.952920:0:17225:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1789403464.952931:0:17225:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1789403464.952944:0:17225:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a141aac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3629:x1876325050822784:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789403464.952973:0:17225:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a141aac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3629:x1876325050822784:12345-0@lo:400:kworker.0 Request processed in 30us (396us total) trans 0 rc 0/0 00000100:00100000:1.0:1789403464.952978:0:17225:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1789403464.952991:0:17225:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1789403464.952997:0:17225:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a141aad880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3629:x1876325050823296:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789403464.953021:0:17225:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a141aad880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3629:x1876325050823296:12345-0@lo:400:kworker.0 Request processed in 24us (401us total) trans 0 rc 0/0 00000100:00100000:1.0:1789403464.953026:0:17225:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1789403464.953063:0:3629:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a14404b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3629:1876325050822784:0@lo:400:kworker.0 00000100:00100000:1.0:1789403464.953073:0:3629:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a144049c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3629:1876325050823296:0@lo:400:kworker.0 00000100:00100000:1.0:1789403464.953080:0:3629:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a14404a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:41b7c44b-9a12-452a-b9e6-b5b285399ec4:3629:1876325050822400:0@lo:400:kworker.0 00000100:00100000:1.0:1789403464.953087:0:3629:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a144049500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3629:1876325050822912:0@lo:400:kworker.0 00010000:00080000:1.0:1789403464.953096:0:3629:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90a144048000 x1876325050823424/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789403480 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789403464.953105:0:3629:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a144048000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3629:1876325050823424:0@lo:400:kworker.0 00000100:00100000:1.0:1789403464.953132:0:18734:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050822144 00000100:00100000:1.0:1789403464.953135:0:18734:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050822144 00000100:00100000:1.0:1789403464.953160:0:18734:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1789403464.953167:0:18734:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a14404a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3626:x1876325050822144:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789403464.953179:0:18734:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:1.0:1789403464.953210:0:18734:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a14404a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3626:x1876325050822144:12345-0@lo:13:osp-pre-1-0.0 Request processed in 43us (1300us total) trans 0 rc 0/0 00000100:00100000:1.0:1789403464.953224:0:18734:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1789403464.953256:0:3626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a144b28380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3626:1876325050822144:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789403464.953266:0:3626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a144049180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3626:1876325050823168:0@lo:400:kworker.0 00010000:00080000:1.0:1789403464.953275:0:3626:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90a144049f80 x1876325050823680/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789403480 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789403464.953282:0:3626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a144049f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3626:1876325050823680:0@lo:400:kworker.0 00000100:00100000:1.0:1789403464.953290:0:3626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a144049880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3626:1876325050822528:0@lo:400:kworker.0 00000100:00100000:1.0:1789403464.953298:0:3626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a14404ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3626:1876325050823552:0@lo:400:kworker.0 00000100:00080000:3.0:1789403464.953472:0:17220:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789403464.953476:0:17220:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1789403464.953478:0:17220:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789403464.953480:0:17220:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789403464.953507:0:3628:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a144b29880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3628:1876325050822272:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1789403464.953549:0:18733:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050823040 00000100:00100000:3.0:1789403464.953553:0:18733:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050823040 00000100:00100000:3.0:1789403464.953589:0:18733:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050822656 00000100:00100000:3.0:1789403464.953592:0:18733:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050822656 00000100:00100000:3.0:1789403464.953607:0:18733:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1789403464.953613:0:18733:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a144048700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3626:x1876325050823040:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789403464.953830:0:18733:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a144048700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3626:x1876325050823040:12345-0@lo:400:kworker.0 Request processed in 216us (2005us total) trans 0 rc 0/0 00000100:00100000:3.0:1789403464.953838:0:18733:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1789403464.953851:0:18733:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1789403464.953858:0:18733:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a141aae300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3626:x1876325050822656:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789403464.953886:0:18733:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a141aae300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3626:x1876325050822656:12345-0@lo:400:kworker.0 Request processed in 29us (1936us total) trans 0 rc 0/0 00000100:00100000:3.0:1789403464.953891:0:18733:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1789403464.953924:0:3627:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a143513800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3627:1876325050822016:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1789403464.954068:0:17220:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789403464.954088:0:3626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a144048e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3626:1876325050822656:0@lo:400:kworker.0 00000100:00100000:1.0:1789403464.954097:0:3626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a14404bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3626:1876325050823040:0@lo:400:kworker.0 00000001:02000400:0.0:1789403464.961194:0:20600:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1d: Test Project ID with remote access ========================================================== 12:31:03 (1789403463) 00000040:00080000:0.0:1789403465.585723:0:17259:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:0.0:1789403465.585733:0:17259:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1789403465.585756:0:17259:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:0.0:1789403465.585764:0:17259:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:0.0:1789403465.813872:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:0.0:1789403465.814579:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:0.0:1789403465.814624:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:0.0:1789403465.814653:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:0.0:1789403465.814714:0:17226:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038173568 00000100:00100000:0.0:1789403465.814724:0:17226:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038173568 00000100:00100000:0.0:1789403465.814822:0:17226:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038173440 00000100:00100000:0.0:1789403465.814825:0:17226:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038173440 00000100:00100000:0.0:1789403465.814862:0:17226:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 69 00000100:00100000:0.0:1789403465.814871:0:17226:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a1441d9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6e04e948-ba92-4319-8cea-8a865bfd1e14+5:2388:x1876325038173568:12345-192.168.203.43@tcp:400:kworker.0 00000100:00100000:0.0:1789403465.818488:0:17226:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a1441d9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6e04e948-ba92-4319-8cea-8a865bfd1e14+5:2388:x1876325038173568:12345-192.168.203.43@tcp:400:kworker.0 Request processed in 3605us (3896us total) trans 0 rc 0/0 00000100:00100000:0.0:1789403465.818503:0:17226:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 69 00000100:00100000:0.0:1789403465.818543:0:17226:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 70 00000100:00100000:0.0:1789403465.818556:0:17226:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a144183800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6e04e948-ba92-4319-8cea-8a865bfd1e14+14:2388:x1876325038173440:12345-192.168.203.43@tcp:400:kworker.0 00000100:00100000:0.0:1789403465.818599:0:17226:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a144183800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:6e04e948-ba92-4319-8cea-8a865bfd1e14+14:2388:x1876325038173440:12345-192.168.203.43@tcp:400:kworker.0 Request processed in 48us (3975us total) trans 0 rc 0/0 00000100:00100000:0.0:1789403465.818606:0:17226:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 70 00000100:00080000:0.0:1789403465.818647:0:17220:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789403465.818652:0:17220:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1789403465.818663:0:19834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038173696 00000100:00100000:0.0:1789403465.818670:0:19834:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038173696 00000100:00100000:0.0:1789403465.818724:0:19834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 27 00000100:00100000:0.0:1789403465.818731:0:19834:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a2488b7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:6e04e948-ba92-4319-8cea-8a865bfd1e14+5:2388:x1876325038173696:12345-192.168.203.43@tcp:400:kworker.0 00000100:00100000:0.0:1789403465.818757:0:19834:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a2488b7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:6e04e948-ba92-4319-8cea-8a865bfd1e14+5:2388:x1876325038173696:12345-192.168.203.43@tcp:400:kworker.0 Request processed in 28us (4104us total) trans 0 rc 0/0 00000100:00100000:0.0:1789403465.818763:0:19834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 27 00000100:00080000:0.0:1789403465.818775:0:17220:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789403465.824942:0:17219:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038173312 00000100:00100000:1.0:1789403465.824958:0:17219:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038173312 00000100:00100000:1.0:1789403465.825189:0:17218:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 167 00000100:00100000:1.0:1789403465.825200:0:17218:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a27500c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:70eabb3e-21f5-4353-a0a0-bbe22517a3d6+13:2388:x1876325038173312:12345-192.168.203.43@tcp:400:kworker.0 00000100:00100000:1.0:1789403465.825279:0:17218:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a27500c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:70eabb3e-21f5-4353-a0a0-bbe22517a3d6+13:2388:x1876325038173312:12345-192.168.203.43@tcp:400:kworker.0 Request processed in 81us (11417us total) trans 0 rc 0/0 00000100:00100000:1.0:1789403465.825287:0:17218:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 167 00000100:00100000:2.0:1789403465.828496:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:2.0:1789403465.828528:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:2.0:1789403465.828559:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:2.0:1789403465.828580:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:2.0:1789403465.828610:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:3.0:1789403465.828787:0:19353:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038173952 00000100:00100000:3.0:1789403465.828796:0:19353:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038173952 00000100:00100000:3.0:1789403465.828865:0:19353:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038174080 00000100:00100000:3.0:1789403465.828868:0:19353:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038174080 00000100:00100000:3.0:1789403465.828901:0:19353:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 71 00000100:00100000:3.0:1789403465.828911:0:19353:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a246f3f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0fd9fbb3-6ee9-4661-b027-6d4be7a889f0+6:2388:x1876325038173952:12345-192.168.203.43@tcp:400:kworker.0 00000100:00100000:3.0:1789403465.828985:0:19353:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a246f3f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0fd9fbb3-6ee9-4661-b027-6d4be7a889f0+6:2388:x1876325038173952:12345-192.168.203.43@tcp:400:kworker.0 Request processed in 75us (499us total) trans 0 rc 0/0 00000100:00100000:3.0:1789403465.828993:0:19353:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 71 00000100:00100000:3.0:1789403465.829011:0:19353:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 72 00000100:00100000:3.0:1789403465.829018:0:19353:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a246f3ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0fd9fbb3-6ee9-4661-b027-6d4be7a889f0+5:2388:x1876325038174080:12345-192.168.203.43@tcp:400:kworker.0 00000100:00100000:3.0:1789403465.829200:0:19353:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a246f3ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0fd9fbb3-6ee9-4661-b027-6d4be7a889f0+5:2388:x1876325038174080:12345-192.168.203.43@tcp:400:kworker.0 Request processed in 27us (516us total) trans 0 rc 0/0 00000100:00100000:3.0:1789403465.829209:0:19353:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 72 00000100:00100000:3.0:1789403465.829233:0:18732:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038173824 00000100:00100000:3.0:1789403465.829236:0:18732:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038173824 00000100:00100000:3.0:1789403465.829276:0:18732:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038174208 00000100:00100000:3.0:1789403465.829279:0:18732:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038174208 00000100:00100000:3.0:1789403465.829297:0:18732:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038174336 00000100:00100000:3.0:1789403465.829299:0:18732:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038174336 00000100:00100000:3.0:1789403465.829313:0:18732:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 27 00000100:00100000:3.0:1789403465.829318:0:18732:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a246f3d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6e04e948-ba92-4319-8cea-8a865bfd1e14+5:2386:x1876325038173824:12345-192.168.203.43@tcp:9:kworker.0 00000020:00000080:3.0:1789403465.829335:0:18732:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x5fb08b1e5b7621d0 00000100:00080000:3.0:1789403465.829349:0:18732:0:(import.c:65:import_set_state_nolock()) ffff90a14455a000 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1789403465.829430:0:18732:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 8589934594 00000100:00100000:3.0:1789403465.829565:0:18732:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a246f3d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6e04e948-ba92-4319-8cea-8a865bfd1e14+2:2386:x1876325038173824:12345-192.168.203.43@tcp:9:kworker.0 Request processed in 246us (1005us total) trans 0 rc 0/0 00000100:00100000:3.0:1789403465.829573:0:18732:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 27 00000100:00100000:3.0:1789403465.829586:0:18732:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 28 00000100:00100000:3.0:1789403465.829592:0:18732:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a246f3c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0fd9fbb3-6ee9-4661-b027-6d4be7a889f0+5:2386:x1876325038174208:12345-192.168.203.43@tcp:9:kworker.0 00000020:00000080:3.0:1789403465.830331:0:18732:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x5fb08b1e5b762208 00000100:00080000:3.0:1789403465.830343:0:18732:0:(import.c:65:import_set_state_nolock()) ffff90a143337000 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1789403465.830375:0:18732:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 8589934600 00000100:00100000:3.0:1789403465.830496:0:18732:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a246f3c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0fd9fbb3-6ee9-4661-b027-6d4be7a889f0+2:2386:x1876325038174208:12345-192.168.203.43@tcp:9:kworker.0 Request processed in 903us (1914us total) trans 0 rc 0/0 00000100:00100000:3.0:1789403465.830504:0:18732:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 28 00000100:00100000:3.0:1789403465.830519:0:18732:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 29 00000100:00100000:3.0:1789403465.830527:0:18732:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a246f3df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0fd9fbb3-6ee9-4661-b027-6d4be7a889f0+5:2386:x1876325038174336:12345-192.168.203.43@tcp:9:kworker.0 00000020:00000080:3.0:1789403465.830540:0:18732:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x5fb08b1e5b76220f 00000100:00080000:3.0:1789403465.830546:0:18732:0:(import.c:65:import_set_state_nolock()) ffff90a144558800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1789403465.830569:0:18732:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 8589934594 00000100:00100000:3.0:1789403465.830622:0:18732:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a246f3df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0fd9fbb3-6ee9-4661-b027-6d4be7a889f0+2:2386:x1876325038174336:12345-192.168.203.43@tcp:9:kworker.0 Request processed in 96us (2011us total) trans 0 rc 0/0 00000100:00100000:3.0:1789403465.830638:0:18732:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 29 00010000:00010000:3.0:1789403465.830844:0:17212:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789403465.830849:0:17213:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789403465.830854:0:17978:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1789403465.831150:0:17220:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1789403465.831155:0:17220:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789403465.831160:0:17220:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1789403465.831162:0:17220:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1789403465.972670:0:17212:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789403466.997165:0:17213:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789403467.506064:0:3628:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a2488b4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3628:1876325050823808:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1789403467.506127:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789403467.506268:0:20364:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050823808 00000100:00100000:2.0:1789403467.506276:0:20364:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050823808 00000100:00100000:2.0:1789403467.506342:0:20364:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1789403467.506353:0:20364:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a144b29880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3628:x1876325050823808:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1789403467.506381:0:20364:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 4218880 granted 17886912 pending 0 free 3915849728 avail 3684327424 00000100:00080000:0.0:1789403467.506575:0:17220:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789403467.506998:0:20364:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a144b29880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3628:x1876325050823808:12345-0@lo:13:osp-pre-0-1.0 Request processed in 647us (869us total) trans 0 rc 0/0 00000100:00100000:2.0:1789403467.507007:0:20364:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1789403467.507058:0:3628:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a2488b4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3628:1876325050823808:0@lo:13:osp-pre-0-1.0 00000040:00080000:0.0:1789403468.018360:0:17976:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:2.0:1789403468.021617:0:3628:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789403468.021639:0:3628:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a246f3d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3628:1876325050823936:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1789403468.021741:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789403468.021786:0:17230:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050823936 00000100:00100000:2.0:1789403468.021793:0:17230:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050823936 00000100:00100000:2.0:1789403468.021850:0:17230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1789403468.021859:0:17230:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a27c923100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3628:x1876325050823936:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1789403468.021896:0:17230:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446293504 avail 1300054016 00000100:00100000:2.0:1789403468.021940:0:17230:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a27c923100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3628:x1876325050823936:12345-0@lo:41:osp-pre-0-1.0 Request processed in 83us (199us total) trans 0 rc 0/0 00000100:00100000:2.0:1789403468.021947:0:17230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1789403468.022110:0:3626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a2488b7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3626:1876325050824064:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1789403468.022139:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789403468.022419:0:3628:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a246f3d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3628:1876325050823936:0@lo:41:osp-pre-0-1.0 00010000:00010000:2.0:1789403468.022573:0:17978:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789403468.022599:0:19382:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050824064 00000100:00100000:2.0:1789403468.022604:0:19382:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050824064 00000100:00100000:2.0:1789403468.022629:0:19382:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1789403468.022635:0:19382:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a2488b5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3626:x1876325050824064:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1789403468.022673:0:19382:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:2.0:1789403468.022751:0:19382:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a2488b5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3626:x1876325050824064:12345-0@lo:41:osp-pre-1-0.0 Request processed in 116us (610us total) trans 0 rc 0/0 00000100:00100000:2.0:1789403468.022757:0:19382:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1789403468.023053:0:3626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a2488b7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3626:1876325050824064:0@lo:41:osp-pre-1-0.0 00000001:00080000:0.0:1789403468.027734:0:17204:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934624 is committed 00000020:00080000:0.0:1789403468.027752:0:17204:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 4294967529 batchid updated 00000020:00080000:2.0:1789403468.027971:0:17263:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4294967529 00000020:00080000:2.0:1789403468.027982:0:17263:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4294967529 00010000:00010000:3.0:1789403469.041651:0:17212:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789403469.260590:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:3.0:1789403469.260679:0:17228:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038174592 00000100:00100000:3.0:1789403469.260690:0:17228:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038174592 00000100:00100000:3.0:1789403469.260815:0:17228:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 13 00000100:00100000:3.0:1789403469.260828:0:17228:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a141aadf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6e04e948-ba92-4319-8cea-8a865bfd1e14+13:16321:x1876325038174592:12345-192.168.203.43@tcp:35:umount.0 00000001:00080000:3.0:1789403469.261079:0:17228:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934625 00000001:00080000:3.0:1789403469.261164:0:17228:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934626 00000100:00100000:3.0:1789403469.261283:0:17228:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a141aadf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:6e04e948-ba92-4319-8cea-8a865bfd1e14+16:16321:x1876325038174592:12345-192.168.203.43@tcp:35:umount.0 Request processed in 458us (700us total) trans 8589934627 rc 0/0 00000100:00100000:3.0:1789403469.261292:0:17228:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 13 00000020:00080000:3.0:1789403469.261297:0:17228:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00000100:00080000:0.0:1789403469.263248:0:17220:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789403469.270739:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:3.0:1789403469.270783:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:2.0:1789403469.270877:0:17211:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038174720 00000100:00100000:2.0:1789403469.270887:0:17211:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038174720 00000100:00100000:2.0:1789403469.270948:0:17211:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038174848 00000100:00100000:2.0:1789403469.270951:0:17211:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038174848 00000100:00100000:2.0:1789403469.270984:0:17211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 3 00000100:00100000:2.0:1789403469.270995:0:17211:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a144b2a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:70eabb3e-21f5-4353-a0a0-bbe22517a3d6+14:2389:x1876325038174720:12345-192.168.203.43@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789403469.271011:0:17211:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789403469.271031:0:17211:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90a270184200/0x5fb08b1e5b7621a6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x44801000000000 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb128af6 expref: 14 pid: 17218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403469.271048:0:17211:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789403469.271109:0:17211:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a144b2a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:70eabb3e-21f5-4353-a0a0-bbe22517a3d6+13:2389:x1876325038174720:12345-192.168.203.43@tcp:103:ldlm_bl.0 Request processed in 116us (379us total) trans 0 rc 0/0 00000100:00100000:2.0:1789403469.271116:0:17211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 3 00000100:00100000:2.0:1789403469.271136:0:17211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 4 00000100:00100000:2.0:1789403469.271142:0:17211:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a274f9cc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:70eabb3e-21f5-4353-a0a0-bbe22517a3d6+12:2389:x1876325038174848:12345-192.168.203.43@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789403469.271152:0:17211:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789403469.271161:0:17211:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90a270185600/0x5fb08b1e5b7621ad lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb128b27 expref: 12 pid: 17218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403469.271170:0:17211:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789403469.271187:0:17211:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a274f9cc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:70eabb3e-21f5-4353-a0a0-bbe22517a3d6+11:2389:x1876325038174848:12345-192.168.203.43@tcp:103:ldlm_bl.0 Request processed in 45us (403us total) trans 0 rc 0/0 00000100:00100000:2.0:1789403469.271193:0:17211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 4 00000100:00100000:2.0:1789403469.276912:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:3.0:1789403469.277044:0:17211:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038174976 00000100:00100000:3.0:1789403469.277058:0:17211:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038174976 00000100:00100000:3.0:1789403469.277128:0:17211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 5 00000100:00100000:3.0:1789403469.277139:0:17211:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a27c921c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:70eabb3e-21f5-4353-a0a0-bbe22517a3d6+11:2388:x1876325038174976:12345-192.168.203.43@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789403469.277159:0:17211:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789403469.277180:0:17211:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90a1425c6e00/0x5fb08b1e5b76226a lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801000000000 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb128bdd expref: 11 pid: 17219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403469.277210:0:17211:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789403469.277274:0:17211:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a27c921c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:70eabb3e-21f5-4353-a0a0-bbe22517a3d6+10:2388:x1876325038174976:12345-192.168.203.43@tcp:103:ldlm_bl.0 Request processed in 136us (371us total) trans 0 rc 0/0 00000100:00100000:3.0:1789403469.277282:0:17211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 5 00000100:00100000:1.0:1789403469.278760:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:3.0:1789403469.278834:0:18732:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038175104 00000100:00100000:3.0:1789403469.278842:0:18732:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038175104 00000100:00100000:3.0:1789403469.278912:0:18732:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 30 00000100:00100000:3.0:1789403469.278922:0:18732:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a141aac700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6e04e948-ba92-4319-8cea-8a865bfd1e14+5:2386:x1876325038175104:12345-192.168.203.43@tcp:9:umount.0 00000020:00000080:3.0:1789403469.278957:0:18732:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x5fb08b1e5b7621c9 00000100:00080000:3.0:1789403469.278966:0:18732:0:(import.c:65:import_set_state_nolock()) ffff90a144559000 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1789403469.279015:0:18732:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 8589934600 00000100:00100000:3.0:1789403469.279136:0:18732:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a141aac700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:6e04e948-ba92-4319-8cea-8a865bfd1e14+2:2386:x1876325038175104:12345-192.168.203.43@tcp:9:umount.0 Request processed in 215us (381us total) trans 0 rc 0/0 00000100:00100000:3.0:1789403469.279144:0:18732:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 30 00000100:00080000:0.0:1789403469.279318:0:17220:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1789403469.279369:0:17213:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789403469.292819:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:3.0:1789403469.292943:0:19353:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038176000 00000100:00100000:3.0:1789403469.292954:0:19353:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038176000 00000100:00100000:3.0:1789403469.293020:0:19353:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 67 00000100:00100000:3.0:1789403469.293031:0:19353:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a2488b7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6e04e948-ba92-4319-8cea-8a865bfd1e14+16:2386:x1876325038176000:12345-192.168.203.43@tcp:39:umount.0 00000020:00000080:3.0:1789403469.293063:0:19353:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x5fb08b1e5b7621c2 00000020:00010000:3.0:1789403469.293079:0:19353:0:(genops.c:1920:obd_stale_export_put()) Put export ffff90a1434d3000: total 0 00000100:00080000:3.0:1789403469.293084:0:19353:0:(import.c:65:import_set_state_nolock()) ffff90a1434d7000 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1789403469.293114:0:19353:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934627 00000100:00100000:3.0:1789403469.293267:0:19353:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a2488b7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:6e04e948-ba92-4319-8cea-8a865bfd1e14+15:2386:x1876325038176000:12345-192.168.203.43@tcp:39:umount.0 Request processed in 237us (457us total) trans 8589934628 rc 0/0 00000100:00100000:3.0:1789403469.293275:0:19353:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 67 00000020:00010000:0.0:1789403469.293421:0:17978:0:(genops.c:1906:obd_stale_export_get()) Get export ffff90a1434d3000: total 0 00010000:00010000:0.0:1789403469.293469:0:17978:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff90a1434d3000, canceled 0 locks, left on hash table 8. 00010000:00010000:0.0:1789403469.293546:0:17978:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff90a1434a8c00) 00010000:00010000:0.0:1789403469.293550:0:17978:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1789403469.293558:0:17978:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c7800/0x5fb08b1e5b7623e4 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb128c4d expref: 14 pid: 17224 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403469.293578:0:17978:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff90a1434a8c00) 00010000:00010000:0.0:1789403469.293580:0:17978:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1789403469.293584:0:17978:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a248af1400/0x5fb08b1e5b7624cb lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb128c9a expref: 13 pid: 19353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403469.293596:0:17978:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff90a27c1d4700) 00010000:00010000:0.0:1789403469.293598:0:17978:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789403469.293602:0:17978:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a2821e8800/0x5fb08b1e5b7622a2 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb128beb expref: 12 pid: 17226 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403469.293617:0:17978:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90a1434a8d00) 00010000:00010000:0.0:1789403469.293619:0:17978:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1789403469.293623:0:17978:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c7600/0x5fb08b1e5b7622e1 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb128bf9 expref: 11 pid: 17224 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403469.293634:0:17978:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff90a142512000) 00010000:00010000:0.0:1789403469.293642:0:17978:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1789403469.293646:0:17978:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a144063200/0x5fb08b1e5b762470 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb128c77 expref: 10 pid: 17225 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403469.293663:0:17978:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff90a1434a8c00) 00010000:00010000:0.0:1789403469.293675:0:17978:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1789403469.293680:0:17978:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a144062400/0x5fb08b1e5b762415 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb128c62 expref: 9 pid: 19353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403469.293707:0:17978:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff90a27c1d4a00) 00010000:00010000:0.0:1789403469.293710:0:17978:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1789403469.293714:0:17978:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a2821e9600/0x5fb08b1e5b762286 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb128be4 expref: 8 pid: 17224 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403469.293727:0:17978:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff90a27c1d4000) 00010000:00010000:0.0:1789403469.293730:0:17978:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1789403469.293734:0:17978:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a144062000/0x5fb08b1e5b762366 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb128c23 expref: 7 pid: 19353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403469.293746:0:17978:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff90a1434d3000, canceled 8 locks, left on hash table 0. 00010000:00010000:0.0:1789403469.293759:0:17978:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789403469.293761:0:17978:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789403469.293763:0:17978:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789403469.310056:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:3.0:1789403469.310161:0:17224:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038176128 00000100:00100000:3.0:1789403469.310171:0:17224:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038176128 00000100:00100000:3.0:1789403469.310244:0:17224:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 68 00000100:00100000:3.0:1789403469.310255:0:17224:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a27c921180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6e04e948-ba92-4319-8cea-8a865bfd1e14+5:2386:x1876325038176128:12345-192.168.203.43@tcp:39:umount.0 00000020:00000080:3.0:1789403469.310287:0:17224:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x5fb08b1e5b7621bb 00000100:00080000:3.0:1789403469.310302:0:17224:0:(import.c:65:import_set_state_nolock()) ffff90a143335000 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1789403469.310332:0:17224:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 2, last_transno is 8589934592 00000100:00100000:3.0:1789403469.310566:0:17224:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a27c921180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:6e04e948-ba92-4319-8cea-8a865bfd1e14+3:2386:x1876325038176128:12345-192.168.203.43@tcp:39:umount.0 Request processed in 313us (518us total) trans 8589934593 rc 0/0 00000100:00100000:3.0:1789403469.310574:0:17224:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 68 00010000:00010000:2.0:1789403469.311144:0:17212:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1789403469.311276:0:17220:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1789403470.065950:0:3627:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a144b28a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3627:1876325050824192:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1789403470.066038:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789403470.066180:0:3628:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a27c923800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3628:1876325050824320:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789403470.066232:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789403470.066296:0:3629:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a2488b6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:41b7c44b-9a12-452a-b9e6-b5b285399ec4:3629:1876325050824448:0@lo:400:kworker.0 00000100:00100000:2.0:1789403470.066345:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789403470.066416:0:3629:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a144466a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3629:1876325050824960:0@lo:400:kworker.0 00000100:00100000:2.0:1789403470.066443:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789403470.066462:0:3629:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a14251c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3629:1876325050825472:0@lo:400:kworker.0 00000100:00100000:2.0:1789403470.066495:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789403470.066511:0:3629:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:2.0:1789403470.066533:0:3629:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a2488b4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3629:1876325050824832:0@lo:400:kworker.0 00000100:00100000:2.0:1789403470.066556:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789403470.066583:0:3629:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a250e2a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3629:1876325050825344:0@lo:400:kworker.0 00000100:00100000:2.0:1789403470.066603:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1789403470.066628:0:17213:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789403470.066641:0:20364:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050824192 00000100:00100000:2.0:1789403470.066649:0:20364:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050824192 00000100:00100000:2.0:1789403470.066703:0:20364:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050824320 00000100:00100000:2.0:1789403470.066707:0:20364:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050824320 00000100:00100000:2.0:1789403470.066727:0:20364:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1789403470.066736:0:20364:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a2488b5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3627:x1876325050824192:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1789403470.066765:0:20364:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923513344 avail 3691991040 00000100:00100000:2.0:1789403470.066803:0:20364:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a2488b5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3627:x1876325050824192:12345-0@lo:13:osp-pre-1-1.0 Request processed in 68us (767us total) trans 0 rc 0/0 00000100:00100000:2.0:1789403470.066811:0:20364:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1789403470.066831:0:20364:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1789403470.066837:0:20364:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a27c922a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3628:x1876325050824320:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789403470.066852:0:20364:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3915849728 avail 3684327424 00000100:00100000:2.0:1789403470.066877:0:20364:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a27c922a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3628:x1876325050824320:12345-0@lo:13:osp-pre-0-0.0 Request processed in 41us (648us total) trans 0 rc 0/0 00000100:00100000:2.0:1789403470.066882:0:20364:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1789403470.066899:0:17229:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050824960 00000100:00100000:2.0:1789403470.066902:0:17229:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050824960 00000100:00100000:2.0:1789403470.066926:0:17229:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1789403470.066932:0:17229:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a27c921500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3629:x1876325050824960:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789403470.066968:0:17229:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a27c921500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3629:x1876325050824960:12345-0@lo:400:kworker.0 Request processed in 36us (524us total) trans 0 rc 0/0 00000100:00100000:2.0:1789403470.066983:0:17229:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1789403470.067004:0:17225:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050825472 00000100:00100000:2.0:1789403470.067008:0:17225:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050825472 00000100:00100000:2.0:1789403470.067035:0:17225:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050824832 00000100:00100000:2.0:1789403470.067039:0:17225:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050824832 00000100:00100000:2.0:1789403470.067052:0:17225:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050825344 00000100:00100000:2.0:1789403470.067054:0:17225:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050825344 00000100:00100000:2.0:1789403470.067068:0:17225:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1789403470.067074:0:17225:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a27c923b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3629:x1876325050825472:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789403470.067095:0:3627:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a2488b6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3627:1876325050824704:0@lo:400:kworker.0 00000100:00100000:2.0:1789403470.067110:0:17225:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a27c923b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3629:x1876325050825472:12345-0@lo:400:kworker.0 Request processed in 35us (613us total) trans 0 rc 0/0 00000100:00100000:3.0:1789403470.067115:0:19353:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1789403470.067130:0:19353:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a27c923480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3629:x1876325050824832:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789403470.067136:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789403470.068067:0:17217:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050824448 00000100:00100000:1.0:1789403470.068076:0:17217:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050824448 00000100:00100000:1.0:1789403470.068118:0:17217:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 168 00000100:00100000:1.0:1789403470.068124:0:17217:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a27500cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:41b7c44b-9a12-452a-b9e6-b5b285399ec4+24:3629:x1876325050824448:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789403470.070842:0:17225:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1789403470.070892:0:17225:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1789403470.070894:0:19353:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a27c923480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3629:x1876325050824832:12345-0@lo:400:kworker.0 Request processed in 3766us (4331us total) trans 0 rc 0/0 00000100:00100000:3.0:1789403470.070907:0:19353:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1789403470.070911:0:17225:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a27c922d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3629:x1876325050825344:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789403470.070947:0:18731:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050824704 00000100:00100000:3.0:1789403470.070957:0:18731:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050824704 00000100:00100000:3.0:1789403470.071004:0:18731:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1789403470.071013:0:18731:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a14251ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3627:x1876325050824704:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789403470.071016:0:17225:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a27c922d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3629:x1876325050825344:12345-0@lo:400:kworker.0 Request processed in 115us (4409us total) trans 0 rc 0/0 00000100:00100000:2.0:1789403470.071026:0:17225:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1789403470.071064:0:18731:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a14251ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3627:x1876325050824704:12345-0@lo:400:kworker.0 Request processed in 52us (3929us total) trans 0 rc 0/0 00000100:00100000:2.0:1789403470.071068:0:3628:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a144b28000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3628:1876325050825856:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789403470.071075:0:18731:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1789403470.071110:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789403470.071168:0:3628:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a27c923800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3628:1876325050824320:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789403470.071202:0:20364:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050825856 00000100:00100000:2.0:1789403470.071207:0:20364:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050825856 00000100:00100000:2.0:1789403470.071235:0:20364:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1789403470.071241:0:20364:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a27c920380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3628:x1876325050825856:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789403470.071254:0:20364:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923513344 avail 3691991040 00000100:00100000:2.0:1789403470.071294:0:20364:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a27c920380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3628:x1876325050825856:12345-0@lo:13:osp-pre-1-0.0 Request processed in 53us (185us total) trans 0 rc 0/0 00000100:00100000:3.0:1789403470.071297:0:3629:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a2488b4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3629:1876325050824832:0@lo:400:kworker.0 00000100:00100000:2.0:1789403470.071311:0:20364:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1789403470.071314:0:3629:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a250e2a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3629:1876325050825344:0@lo:400:kworker.0 00000100:00100000:3.0:1789403470.071330:0:3629:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a144466a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3629:1876325050824960:0@lo:400:kworker.0 00000100:00100000:2.0:1789403470.071355:0:3628:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a144b28000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3628:1876325050825856:0@lo:13:osp-pre-1-0.0 00010000:00080000:3.0:1789403470.071365:0:3629:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90a14251c380 x1876325050825472/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789403486 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789403470.071378:0:3629:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a14251c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3629:1876325050825472:0@lo:400:kworker.0 00000100:00080000:2.0:1789403470.071419:0:17220:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789403470.071425:0:17220:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1789403470.071428:0:17220:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1789403470.071431:0:17220:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789403470.071442:0:3626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a2488b7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3626:1876325050824576:0@lo:400:kworker.0 00000100:00100000:3.0:1789403470.071475:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789403470.071496:0:3626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a144466680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3626:1876325050825088:0@lo:400:kworker.0 00000100:00100000:3.0:1789403470.071517:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789403470.071533:0:3626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a14251dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3626:1876325050825600:0@lo:400:kworker.0 00000100:00100000:3.0:1789403470.071553:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789403470.071579:0:17230:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050824576 00000100:00100000:3.0:1789403470.071583:0:17230:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050824576 00000100:00100000:3.0:1789403470.071611:0:17230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1789403470.071617:0:17230:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a144b2a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3626:x1876325050824576:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789403470.071650:0:17230:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a144b2a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3626:x1876325050824576:12345-0@lo:400:kworker.0 Request processed in 34us (175us total) trans 0 rc 0/0 00000100:00100000:3.0:1789403470.071656:0:17230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1789403470.071686:0:18733:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050825088 00000100:00100000:3.0:1789403470.071690:0:18733:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050825088 00000100:00100000:3.0:1789403470.071716:0:18733:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1789403470.071722:0:18733:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a144b29f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3626:x1876325050825088:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789403470.071750:0:18733:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a144b29f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3626:x1876325050825088:12345-0@lo:400:kworker.0 Request processed in 28us (232us total) trans 0 rc 0/0 00000100:00100000:3.0:1789403470.071756:0:18733:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00080000:3.0:1789403470.071773:0:17220:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789403470.071781:0:19353:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050825600 00000100:00100000:3.0:1789403470.071790:0:19353:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050825600 00000100:00100000:3.0:1789403470.071819:0:19353:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:3.0:1789403470.071826:0:19353:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a144b28700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3626:x1876325050825600:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789403470.071855:0:19353:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a144b28700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3626:x1876325050825600:12345-0@lo:400:kworker.0 Request processed in 30us (301us total) trans 0 rc 0/0 00000100:00100000:3.0:1789403470.071860:0:19353:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00080000:3.0:1789403470.071874:0:17220:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789403470.071891:0:3626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a2488b7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3626:1876325050824576:0@lo:400:kworker.0 00000100:00100000:3.0:1789403470.071901:0:3626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a144466680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3626:1876325050825088:0@lo:400:kworker.0 00000100:00100000:3.0:1789403470.071909:0:3626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a14251dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3626:1876325050825600:0@lo:400:kworker.0 00000100:00100000:0.0:1789403470.072083:0:3627:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a2488b6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3627:1876325050824704:0@lo:400:kworker.0 00000100:00100000:0.0:1789403470.072092:0:3627:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a144465880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3627:1876325050825216:0@lo:400:kworker.0 00000100:00100000:0.0:1789403470.072118:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789403470.072144:0:3627:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a14251d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3627:1876325050825728:0@lo:400:kworker.0 00000100:00100000:0.0:1789403470.072165:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789403470.072200:0:3627:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a144b28a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3627:1876325050824192:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1789403470.072227:0:17226:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050825216 00000100:00100000:0.0:1789403470.072231:0:17226:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050825216 00000100:00100000:0.0:1789403470.072255:0:17226:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050825728 00000100:00100000:0.0:1789403470.072257:0:17226:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050825728 00000100:00100000:0.0:1789403470.072281:0:17226:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:0.0:1789403470.072288:0:17226:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a14251ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3627:x1876325050825216:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789403470.072322:0:17226:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a14251ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3627:x1876325050825216:12345-0@lo:400:kworker.0 Request processed in 34us (202us total) trans 0 rc 0/0 00000100:00100000:0.0:1789403470.072328:0:17226:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:0.0:1789403470.072340:0:17226:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:0.0:1789403470.072346:0:17226:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a14251dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3627:x1876325050825728:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789403470.072373:0:17226:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a14251dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3627:x1876325050825728:12345-0@lo:400:kworker.0 Request processed in 27us (206us total) trans 0 rc 0/0 00000100:00100000:0.0:1789403470.072379:0:17226:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00080000:0.0:1789403470.072515:0:17220:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1789403470.072541:0:3627:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a144465880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3627:1876325050825216:0@lo:400:kworker.0 00010000:00080000:0.0:1789403470.072552:0:3627:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90a14251d880 x1876325050825728/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789403486 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789403470.072560:0:3627:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a14251d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3627:1876325050825728:0@lo:400:kworker.0 00000100:00100000:1.0:1789403470.073748:0:17217:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a27500cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:41b7c44b-9a12-452a-b9e6-b5b285399ec4+24:3629:x1876325050824448:12345-0@lo:400:kworker.0 Request processed in 5616us (7396us total) trans 0 rc 0/0 00000100:00100000:1.0:1789403470.073760:0:17217:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 168 00000100:00100000:3.0:1789403470.074755:0:3629:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a2488b6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:41b7c44b-9a12-452a-b9e6-b5b285399ec4:3629:1876325050824448:0@lo:400:kworker.0 00000100:00100000:1.0:1789403470.924806:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:1.0:1789403470.924865:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:3.0:1789403470.924888:0:17219:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038176256 00000100:00100000:3.0:1789403470.924900:0:17219:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038176256 00000100:00100000:1.0:1789403470.924903:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:3.0:1789403470.924956:0:17219:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 169 00000100:00100000:3.0:1789403470.924968:0:17219:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a27500ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:70eabb3e-21f5-4353-a0a0-bbe22517a3d6+10:2389:x1876325038176256:12345-192.168.203.43@tcp:400:kworker.0 00000100:00100000:0.0:1789403470.925074:0:17226:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038176512 00000100:00100000:0.0:1789403470.925080:0:17226:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038176512 00000100:00100000:2.0:1789403470.925122:0:17225:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038176384 00000100:00100000:2.0:1789403470.925127:0:17225:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038176384 00000100:00100000:2.0:1789403470.925172:0:17225:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 79 00000100:00100000:2.0:1789403470.925181:0:17225:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a141aac380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0fd9fbb3-6ee9-4661-b027-6d4be7a889f0+6:2389:x1876325038176384:12345-192.168.203.43@tcp:400:kworker.0 00000100:00100000:3.0:1789403470.925239:0:17219:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a27500ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:70eabb3e-21f5-4353-a0a0-bbe22517a3d6+10:2389:x1876325038176256:12345-192.168.203.43@tcp:400:kworker.0 Request processed in 273us (442us total) trans 0 rc 0/0 00000100:00100000:3.0:1789403470.925248:0:17219:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 169 00000100:00100000:0.0:1789403470.925260:0:17226:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 80 00000100:00100000:0.0:1789403470.925270:0:17226:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a141aaed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0fd9fbb3-6ee9-4661-b027-6d4be7a889f0+5:2389:x1876325038176512:12345-192.168.203.43@tcp:400:kworker.0 00000100:00080000:3.0:1789403470.926445:0:17220:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1789403470.926453:0:17220:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789403470.929978:0:17225:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a141aac380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0fd9fbb3-6ee9-4661-b027-6d4be7a889f0+6:2389:x1876325038176384:12345-192.168.203.43@tcp:400:kworker.0 Request processed in 4786us (5063us total) trans 0 rc 0/0 00000100:00100000:2.0:1789403470.929995:0:17225:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 79 00000100:00100000:0.0:1789403470.933733:0:17226:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a141aaed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0fd9fbb3-6ee9-4661-b027-6d4be7a889f0+5:2389:x1876325038176512:12345-192.168.203.43@tcp:400:kworker.0 Request processed in 8451us (8855us total) trans 0 rc 0/0 00000100:00100000:0.0:1789403470.933748:0:17226:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 80 00010000:00010000:0.0:1789403471.090359:0:17978:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789403471.302716:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:0.0:1789403471.303148:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:0.0:1789403471.308110:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:3.0:1789403471.309026:0:17209:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038176640 00000100:00100000:3.0:1789403471.309037:0:17209:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038176640 00000100:00100000:2.0:1789403471.309134:0:17211:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038176768 00000100:00100000:2.0:1789403471.309140:0:17211:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038176768 00000100:00100000:2.0:1789403471.309200:0:17211:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038176896 00000100:00100000:2.0:1789403471.309203:0:17211:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038176896 00000100:00100000:2.0:1789403471.309224:0:17211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 6 00000100:00100000:2.0:1789403471.309233:0:17211:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a14251c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:70eabb3e-21f5-4353-a0a0-bbe22517a3d6+12:2390:x1876325038176768:12345-192.168.203.43@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789403471.309248:0:17211:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789403471.309267:0:17211:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90a241515e00/0x5fb08b1e5b7621ec lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb128b97 expref: 12 pid: 17217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403471.309285:0:17211:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789403471.309336:0:17211:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a14251c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:70eabb3e-21f5-4353-a0a0-bbe22517a3d6+11:2390:x1876325038176768:12345-192.168.203.43@tcp:103:ldlm_bl.0 Request processed in 103us (6187us total) trans 0 rc 0/0 00000100:00100000:2.0:1789403471.309342:0:17211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 6 00000100:00100000:3.0:1789403471.313544:0:17209:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 7 00000100:00100000:3.0:1789403471.313572:0:17209:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a14418df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:70eabb3e-21f5-4353-a0a0-bbe22517a3d6+10:2389:x1876325038176896:12345-192.168.203.43@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789403471.313593:0:17209:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789403471.313627:0:17209:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90a241514000/0x5fb08b1e5b76222b lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb128bd6 expref: 10 pid: 17218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403471.313647:0:17209:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789403471.313697:0:17211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 8 00000100:00100000:2.0:1789403471.313708:0:17211:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a14251d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:70eabb3e-21f5-4353-a0a0-bbe22517a3d6+9:2390:x1876325038176640:12345-192.168.203.43@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1789403471.313710:0:17209:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a14418df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:70eabb3e-21f5-4353-a0a0-bbe22517a3d6+9:2389:x1876325038176896:12345-192.168.203.43@tcp:103:ldlm_bl.0 Request processed in 154us (5608us total) trans 0 rc 0/0 00000100:00100000:3.0:1789403471.313717:0:17209:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 7 00010000:00010000:2.0:1789403471.313717:0:17211:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789403471.313727:0:17211:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90a270184800/0x5fb08b1e5b7621e5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x44801000000000 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb128b66 expref: 9 pid: 17218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403471.313736:0:17211:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789403471.313755:0:17211:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a14251d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:70eabb3e-21f5-4353-a0a0-bbe22517a3d6+7:2390:x1876325038176640:12345-192.168.203.43@tcp:103:ldlm_bl.0 Request processed in 51us (11047us total) trans 0 rc 0/0 00000100:00100000:2.0:1789403471.313761:0:17211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 8 00000100:00100000:1.0:1789403471.325942:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:3.0:1789403471.326842:0:17224:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038177152 00000100:00100000:3.0:1789403471.326854:0:17224:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038177152 00000100:00100000:3.0:1789403471.326927:0:17224:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 69 00000100:00100000:3.0:1789403471.326937:0:17224:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a141aae680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0fd9fbb3-6ee9-4661-b027-6d4be7a889f0+6:2386:x1876325038177152:12345-192.168.203.43@tcp:39:umount.0 00000020:00000080:3.0:1789403471.326978:0:17224:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x5fb08b1e5b7621fa 00000020:00010000:3.0:1789403471.327560:0:17224:0:(genops.c:1920:obd_stale_export_put()) Put export ffff90a1432ea000: total 0 00000100:00080000:3.0:1789403471.327565:0:17224:0:(import.c:65:import_set_state_nolock()) ffff90a1432eb000 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1789403471.327813:0:17224:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934628 00000100:00100000:3.0:1789403471.327970:0:17224:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a141aae680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0fd9fbb3-6ee9-4661-b027-6d4be7a889f0+5:2386:x1876325038177152:12345-192.168.203.43@tcp:39:umount.0 Request processed in 1032us (2034us total) trans 8589934629 rc 0/0 00000100:00100000:3.0:1789403471.327978:0:17224:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 69 00000020:00010000:2.0:1789403471.332055:0:17212:0:(genops.c:1906:obd_stale_export_get()) Get export ffff90a1432ea000: total 0 00010000:00010000:2.0:1789403471.332065:0:17212:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789403471.332125:0:17212:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff90a1432ea000, canceled 0 locks, left on hash table 1. 00010000:00010000:2.0:1789403471.332160:0:17212:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90a1434a8d00) 00010000:00010000:2.0:1789403471.332164:0:17212:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789403471.332175:0:17212:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a270184a00/0x5fb08b1e5b7622ef lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb128c00 expref: 4 pid: 19353 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403471.332199:0:17212:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff90a1432ea000, canceled 1 locks, left on hash table 0. 00010000:00010000:2.0:1789403471.332211:0:17212:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789403471.332212:0:17212:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789403471.332214:0:17212:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789403471.340677:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:0.0:1789403471.340820:0:17225:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038177280 00000100:00100000:0.0:1789403471.340830:0:17225:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038177280 00000100:00100000:0.0:1789403471.340884:0:17225:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 70 00000100:00100000:0.0:1789403471.340894:0:17225:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a27c923800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0fd9fbb3-6ee9-4661-b027-6d4be7a889f0+5:2386:x1876325038177280:12345-192.168.203.43@tcp:39:umount.0 00000020:00000080:0.0:1789403471.340930:0:17225:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x5fb08b1e5b762201 00000100:00080000:0.0:1789403471.340939:0:17225:0:(import.c:65:import_set_state_nolock()) ffff90a1432ed000 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1789403471.340967:0:17225:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 2, last_transno is 8589934593 00000100:00100000:0.0:1789403471.341101:0:17225:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a27c923800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0fd9fbb3-6ee9-4661-b027-6d4be7a889f0+3:2386:x1876325038177280:12345-192.168.203.43@tcp:39:umount.0 Request processed in 207us (432us total) trans 8589934594 rc 0/0 00000100:00100000:0.0:1789403471.341108:0:17225:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 70 00010000:00010000:3.0:1789403471.341278:0:17213:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789403471.398893:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:1.0:1789403471.399328:0:17217:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038177536 00000100:00100000:1.0:1789403471.399342:0:17217:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038177536 00000100:00100000:1.0:1789403471.399482:0:17217:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 170 00000100:00100000:1.0:1789403471.399494:0:17217:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a27500fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:70eabb3e-21f5-4353-a0a0-bbe22517a3d6+7:2386:x1876325038177536:12345-192.168.203.43@tcp:251:umount.0 00000020:00000080:1.0:1789403471.399560:0:17217:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x5fb08b1e5b762198 00000020:00010000:1.0:1789403471.399571:0:17217:0:(genops.c:1920:obd_stale_export_put()) Put export ffff90a14455f000: total 0 00000100:00080000:1.0:1789403471.399578:0:17217:0:(import.c:65:import_set_state_nolock()) ffff90a14455c800 : changing import state from FULL to CLOSED 00000100:00100000:1.0:1789403471.399667:0:17217:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a27500fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:70eabb3e-21f5-4353-a0a0-bbe22517a3d6+3:2386:x1876325038177536:12345-192.168.203.43@tcp:251:umount.0 Request processed in 175us (788us total) trans 0 rc 0/0 00000100:00100000:1.0:1789403471.399676:0:17217:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 170 00000020:00010000:0.0:1789403471.399863:0:17978:0:(genops.c:1906:obd_stale_export_get()) Get export ffff90a14455f000: total 0 00010000:00010000:0.0:1789403471.399939:0:17978:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff90a14455f000, canceled 0 locks, left on hash table 1. 00010000:00010000:0.0:1789403471.399981:0:17978:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90a281b04a00/0x5fb08b1e5b76219f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801000000000 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb128aef expref: 2 pid: 17219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403471.400020:0:17978:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff90a14455f000, canceled 1 locks, left on hash table 0. 00000020:00000080:0.0:1789403471.400033:0:17978:0:(genops.c:885:class_export_put()) final put ffff90a14455f000/70eabb3e-21f5-4353-a0a0-bbe22517a3d6 00010000:00010000:0.0:1789403471.400054:0:17978:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789403471.400056:0:17978:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789403471.400058:0:17978:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1789403471.400113:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff90a14455f000/70eabb3e-21f5-4353-a0a0-bbe22517a3d6 for MGS 00000020:00000080:3.0:1789403471.400159:0:37:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff90a14455c800 for MGS 00010000:00010000:3.0:1789403472.115244:0:17212:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1789403472.118149:0:19545:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 0fd9fbb3-6ee9-4661-b027-6d4be7a889f0 00000020:00000080:3.0:1789403472.118157:0:19545:0:(genops.c:885:class_export_put()) final put ffff90a14455b000/0fd9fbb3-6ee9-4661-b027-6d4be7a889f0 00000001:00100000:3.0:1789403472.118186:0:19545:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 6e04e948-ba92-4319-8cea-8a865bfd1e14 00000020:00000080:3.0:1789403472.118188:0:19545:0:(genops.c:885:class_export_put()) final put ffff90a144559800/6e04e948-ba92-4319-8cea-8a865bfd1e14 00000020:00000080:2.0:1789403472.118262:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff90a14455b000/0fd9fbb3-6ee9-4661-b027-6d4be7a889f0 for lustre-OST0001 00000020:00000080:2.0:1789403472.118314:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff90a144559800/6e04e948-ba92-4319-8cea-8a865bfd1e14 for lustre-OST0001 00000020:00000080:2.0:1789403472.118330:0:37:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff90a144558800 for lustre-OST0001 00000020:00000080:2.0:1789403472.118335:0:37:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff90a14455a000 for lustre-OST0001 00000001:00100000:0.0:1789403472.121495:0:18727:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 6e04e948-ba92-4319-8cea-8a865bfd1e14 00000020:00000080:0.0:1789403472.121504:0:18727:0:(genops.c:885:class_export_put()) final put ffff90a144558000/6e04e948-ba92-4319-8cea-8a865bfd1e14 00000001:00100000:0.0:1789403472.121524:0:18727:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 0fd9fbb3-6ee9-4661-b027-6d4be7a889f0 00000020:00000080:0.0:1789403472.121526:0:18727:0:(genops.c:885:class_export_put()) final put ffff90a143337800/0fd9fbb3-6ee9-4661-b027-6d4be7a889f0 00000020:00000080:0.0:1789403472.121539:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff90a144558000/6e04e948-ba92-4319-8cea-8a865bfd1e14 for lustre-OST0000 00000020:00000080:0.0:1789403472.121580:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff90a143337800/0fd9fbb3-6ee9-4661-b027-6d4be7a889f0 for lustre-OST0000 00000020:00000080:0.0:1789403472.121596:0:36:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff90a144559000 for lustre-OST0000 00000020:00000080:0.0:1789403472.121599:0:36:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff90a143337000 for lustre-OST0000 00000100:00100000:0.0:1789403472.631253:0:3629:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a1443e7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3629:1876325050825984:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1789403472.631325:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789403472.643322:0:18735:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050825984 00000100:00100000:0.0:1789403472.643338:0:18735:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050825984 00000100:00100000:0.0:1789403472.643459:0:20364:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1789403472.643473:0:20364:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a1443e7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3629:x1876325050825984:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1789403472.643515:0:20364:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3915849728 avail 3684327424 00000100:00100000:0.0:1789403472.643597:0:20364:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a1443e7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3629:x1876325050825984:12345-0@lo:13:osp-pre-0-1.0 Request processed in 128us (12271us total) trans 0 rc 0/0 00000100:00100000:0.0:1789403472.643605:0:20364:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1789403472.643675:0:3629:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a1443e7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3629:1876325050825984:0@lo:13:osp-pre-0-1.0 00000100:00080000:2.0:1789403472.645251:0:17220:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789403473.137671:0:3627:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1789403473.137704:0:3627:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a1443e7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3627:1876325050826112:0@lo:41:osp-pre-1-0.0 00010000:00010000:0.0:1789403473.137735:0:17213:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789403473.137779:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789403473.137854:0:19382:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050826112 00000100:00100000:2.0:1789403473.137861:0:19382:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050826112 00000100:00100000:0.0:1789403473.137868:0:3627:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a27c920e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3627:1876325050826240:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1789403473.137915:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789403473.137919:0:19382:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1789403473.137930:0:19382:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a27c921880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3627:x1876325050826112:12345-0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1789403473.137959:0:17229:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050826240 00000004:00000024:2.0:1789403473.137964:0:19382:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:0.0:1789403473.137964:0:17229:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050826240 00000100:00100000:2.0:1789403473.138013:0:19382:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a27c921880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3627:x1876325050826112:12345-0@lo:41:osp-pre-1-0.0 Request processed in 85us (234us total) trans 0 rc 0/0 00000100:00100000:2.0:1789403473.138020:0:19382:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1789403473.138039:0:19382:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1789403473.138045:0:19382:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a1443e5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3627:x1876325050826240:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1789403473.138060:0:19382:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446293504 avail 1300054016 00000100:00100000:2.0:1789403473.138088:0:19382:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a1443e5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3627:x1876325050826240:12345-0@lo:41:osp-pre-0-1.0 Request processed in 44us (174us total) trans 0 rc 0/0 00000100:00100000:2.0:1789403473.138094:0:19382:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1789403473.138171:0:3627:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a27c920e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3627:1876325050826240:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1789403473.138185:0:3627:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a1443e7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3627:1876325050826112:0@lo:41:osp-pre-1-0.0 00000020:01000004:3.0:1789403473.277130:0:20795:0:(tgt_mount.c:2191:server_umount_begin()) umount -f 00000020:01000004:1.0:1789403473.302360:0:20795:0:(tgt_mount.c:2061:server_put_super()) server put_super lustre-MDT0000 00010000:00010000:1.0:1789403473.302470:0:20795:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.143@tcp lock: ffff90a2821e9800/0x5fb08b1e5b761d5b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb08b1e5b761d62 expref: -99 pid: 17203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403473.302485:0:20795:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.143@tcp lock: ffff90a2821e9800/0x5fb08b1e5b761d5b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x5fb08b1e5b761d62 expref: -99 pid: 17203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403473.302502:0:20795:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.143@tcp lock: ffff90a2821e9800/0x5fb08b1e5b761d5b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000400000000 nid: local remote: 0x5fb08b1e5b761d62 expref: -99 pid: 17203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403473.302521:0:20795:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.143@tcp lock: ffff90a2821e9800/0x5fb08b1e5b761d5b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000400000000 nid: local remote: 0x5fb08b1e5b761d62 expref: -99 pid: 17203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403473.302540:0:20795:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:1.0:1789403473.302545:0:20795:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:1.0:1789403473.302571:0:20795:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1789403473.302575:0:20795:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 3 00000100:00080000:1.0:1789403473.302580:0:20795:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00080000:1.0:1789403473.302602:0:20795:0:(import.c:65:import_set_state_nolock()) ffff90a141b02000 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00000100:00100000:1.0:1789403473.302630:0:3625:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a141aaca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3625:1876325050826368:0@lo:39:umount.0 00000100:00100000:1.0:1789403473.302703:0:3625:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1789403473.303710:0:17978:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789403473.303733:0:17978:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.143@tcp lock: ffff90a2821e9800/0x5fb08b1e5b761d5b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000400000000 nid: local remote: 0x5fb08b1e5b761d62 expref: -99 pid: 17203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403473.303742:0:17978:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a2821e9800 already unused, calling callback (ffffffffc120dc20) 10000000:00010000:3.0:1789403473.303746:0:17978:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.143@tcp lock: ffff90a2821e9800/0x5fb08b1e5b761d5b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000400000000 nid: local remote: 0x5fb08b1e5b761d62 expref: -99 pid: 17203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403473.303756:0:17978:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.143@tcp lock: ffff90a2821e9800/0x5fb08b1e5b761d5b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1008400000000 nid: local remote: 0x5fb08b1e5b761d62 expref: -99 pid: 17203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789403473.303762:0:17978:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.143@tcp lock: ffff90a2821e9800/0x5fb08b1e5b761d5b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1009400000000 nid: local remote: 0x5fb08b1e5b761d62 expref: -99 pid: 17203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789403473.303767:0:17978:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1789403473.303770:0:17978:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:3.0:1789403473.303773:0:17978:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:3.0:1789403473.303801:0:17978:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.143@tcp lock: ffff90a2821e9800/0x5fb08b1e5b761d5b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0x5fb08b1e5b761d62 expref: -99 pid: 17203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403473.303807:0:17978:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789403473.303836:0:17978:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.143@tcp lock: ffff90a2821e9800/0x5fb08b1e5b761d5b lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0x5fb08b1e5b761d62 expref: -99 pid: 17203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403473.303842:0:17978:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.143@tcp lock: ffff90a2821e9800/0x5fb08b1e5b761d5b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0x5fb08b1e5b761d62 expref: -99 pid: 17203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403473.303853:0:17978:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789403473.303855:0:17978:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789403473.303856:0:17978:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789403473.304034:0:3628:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a144b2b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:41b7c44b-9a12-452a-b9e6-b5b285399ec4:3628:1876325050826496:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789403473.304086:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789403473.304133:0:17209:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050826496 00000100:00100000:3.0:1789403473.304140:0:17209:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050826496 00000100:00100000:3.0:1789403473.304199:0:17209:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1789403473.304207:0:17209:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a141aaf480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:41b7c44b-9a12-452a-b9e6-b5b285399ec4+24:3628:x1876325050826496:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789403473.304218:0:17209:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789403473.304230:0:17209:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90a259947200/0x5fb08b1e5b761d62 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x5fb08b1e5b761d5b expref: 24 pid: 17218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403473.304310:0:17209:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789403473.304350:0:17209:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a141aaf480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:41b7c44b-9a12-452a-b9e6-b5b285399ec4+23:3628:x1876325050826496:12345-0@lo:103:ldlm_bl.0 Request processed in 144us (264us total) trans 0 rc 0/0 00000100:00100000:3.0:1789403473.304358:0:17209:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1789403473.304430:0:3628:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a144b2b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:41b7c44b-9a12-452a-b9e6-b5b285399ec4:3628:1876325050826496:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789403473.304501:0:19353:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050826368 00000100:00100000:2.0:1789403473.304506:0:19353:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050826368 00000100:00100000:2.0:1789403473.304544:0:19353:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1789403473.304552:0:19353:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a141aad500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3625:x1876325050826368:12345-0@lo:39:umount.0 00000020:00000080:2.0:1789403473.304575:0:19353:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x5fb08b1e5b761d8c 00000100:00080000:2.0:1789403473.304584:0:19353:0:(import.c:65:import_set_state_nolock()) ffff90a281b10000 : changing import state from FULL to CLOSED 00000100:00100000:2.0:1789403473.304668:0:19353:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a141aad500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+1:3625:x1876325050826368:12345-0@lo:39:umount.0 Request processed in 117us (1964us total) trans 0 rc 0/0 00000100:00100000:2.0:1789403473.304675:0:19353:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000020:00000080:2.0:1789403473.304682:0:19353:0:(genops.c:885:class_export_put()) final put ffff90a281b14000/lustre-MDT0000-lwp-MDT0000_UUID 00000020:00000080:2.0:1789403473.304713:0:17331:0:(genops.c:844:class_export_destroy()) destroying export ffff90a281b14000/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000 00000100:00080000:3.0:1789403473.304750:0:3625:0:(import.c:65:import_set_state_nolock()) ffff90a141b02000 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000020:00000080:2.0:1789403473.304754:0:17331:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff90a281b10000 for lustre-MDT0000 00000100:00100000:3.0:1789403473.304759:0:3625:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a141aaca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3625:1876325050826368:0@lo:39:umount.0 00010000:00010000:1.0:1789403473.304796:0:17212:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1789403473.304806:0:20795:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1789403473.304809:0:20795:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 4 00000100:00100000:1.0:1789403473.304813:0:20795:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:1.0:1789403473.305800:0:20795:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.143@tcp lock: ffff90a281b04c00/0x5fb08b1e5b761cac lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb08b1e5b761cb3 expref: -99 pid: 17203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403473.305815:0:20795:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.143@tcp lock: ffff90a281b04c00/0x5fb08b1e5b761cac lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x5fb08b1e5b761cb3 expref: -99 pid: 17203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403473.305822:0:20795:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.143@tcp lock: ffff90a281b04c00/0x5fb08b1e5b761cac lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000400000000 nid: local remote: 0x5fb08b1e5b761cb3 expref: -99 pid: 17203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403473.305843:0:20795:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.143@tcp lock: ffff90a281b04c00/0x5fb08b1e5b761cac lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000400000000 nid: local remote: 0x5fb08b1e5b761cb3 expref: -99 pid: 17203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403473.305867:0:20795:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789403473.305875:0:20795:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.143@tcp lock: ffff90a259946c00/0x5fb08b1e5b761ff4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb08b1e5b761ffb expref: -99 pid: 17221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403473.305881:0:20795:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.143@tcp lock: ffff90a259946c00/0x5fb08b1e5b761ff4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x5fb08b1e5b761ffb expref: -99 pid: 17221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403473.305887:0:20795:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.143@tcp lock: ffff90a259946c00/0x5fb08b1e5b761ff4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x5fb08b1e5b761ffb expref: -99 pid: 17221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403473.305890:0:17213:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789403473.305893:0:20795:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.143@tcp lock: ffff90a259946c00/0x5fb08b1e5b761ff4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x5fb08b1e5b761ffb expref: -99 pid: 17221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403473.305897:0:17213:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.143@tcp lock: ffff90a281b04c00/0x5fb08b1e5b761cac lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000400000000 nid: local remote: 0x5fb08b1e5b761cb3 expref: -99 pid: 17203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403473.305903:0:17213:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a281b04c00 already unused, calling callback (ffffffffc120dc20) 10000000:00010000:3.0:1789403473.305907:0:17213:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.143@tcp lock: ffff90a281b04c00/0x5fb08b1e5b761cac lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000400000000 nid: local remote: 0x5fb08b1e5b761cb3 expref: -99 pid: 17203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403473.305909:0:20795:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789403473.305916:0:17213:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.143@tcp lock: ffff90a281b04c00/0x5fb08b1e5b761cac lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1008400000000 nid: local remote: 0x5fb08b1e5b761cb3 expref: -99 pid: 17203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403473.305916:0:20795:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.143@tcp lock: ffff90a241514400/0x5fb08b1e5b76225c lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb08b1e5b762263 expref: -99 pid: 17221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403473.305923:0:20795:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.143@tcp lock: ffff90a241514400/0x5fb08b1e5b76225c lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x5fb08b1e5b762263 expref: -99 pid: 17221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789403473.305924:0:17213:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.143@tcp lock: ffff90a281b04c00/0x5fb08b1e5b761cac lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1009400000000 nid: local remote: 0x5fb08b1e5b761cb3 expref: -99 pid: 17203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789403473.305930:0:17213:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1789403473.305932:0:17213:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-MDT0000: stopping, won't requeue 00010000:00010000:3.0:1789403473.305956:0:17213:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.143@tcp lock: ffff90a281b04c00/0x5fb08b1e5b761cac lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0x5fb08b1e5b761cb3 expref: -99 pid: 17203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403473.305969:0:17213:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789403473.305988:0:17213:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.143@tcp lock: ffff90a281b04c00/0x5fb08b1e5b761cac lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0x5fb08b1e5b761cb3 expref: -99 pid: 17203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403473.305994:0:17213:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.143@tcp lock: ffff90a281b04c00/0x5fb08b1e5b761cac lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0x5fb08b1e5b761cb3 expref: -99 pid: 17203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403473.306005:0:17213:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789403473.306008:0:17213:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.143@tcp lock: ffff90a259946c00/0x5fb08b1e5b761ff4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x5fb08b1e5b761ffb expref: -99 pid: 17221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403473.306013:0:17213:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a259946c00 already unused, calling callback (ffffffffc120dc20) 10000000:00010000:3.0:1789403473.306016:0:17213:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.143@tcp lock: ffff90a259946c00/0x5fb08b1e5b761ff4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x5fb08b1e5b761ffb expref: -99 pid: 17221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403473.306022:0:17213:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.143@tcp lock: ffff90a259946c00/0x5fb08b1e5b761ff4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x5fb08b1e5b761ffb expref: -99 pid: 17221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789403473.306027:0:17213:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.143@tcp lock: ffff90a259946c00/0x5fb08b1e5b761ff4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x5fb08b1e5b761ffb expref: -99 pid: 17221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789403473.306032:0:17213:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 10000000:01000000:3.0:1789403473.306034:0:17213:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-mdtir: stopping, won't requeue 10000000:01000000:3.0:1789403473.306037:0:17213:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-mdtir 00010000:00010000:3.0:1789403473.306051:0:17213:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.143@tcp lock: ffff90a259946c00/0x5fb08b1e5b761ff4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x5fb08b1e5b761ffb expref: -99 pid: 17221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403473.306056:0:17213:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789403473.306072:0:17213:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.143@tcp lock: ffff90a259946c00/0x5fb08b1e5b761ff4 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x5fb08b1e5b761ffb expref: -99 pid: 17221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403473.306089:0:17213:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.143@tcp lock: ffff90a259946c00/0x5fb08b1e5b761ff4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x5fb08b1e5b761ffb expref: -99 pid: 17221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403473.306098:0:17213:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789403473.306099:0:17213:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789403473.306101:0:17213:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789403473.306109:0:3628:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789403473.306123:0:3628:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a144b29c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:41b7c44b-9a12-452a-b9e6-b5b285399ec4:3628:1876325050826624:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789403473.306168:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789403473.306210:0:3626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a144b29180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:41b7c44b-9a12-452a-b9e6-b5b285399ec4:3626:1876325050826752:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789403473.306233:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789403473.306271:0:17979:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050826624 00000100:00100000:3.0:1789403473.306277:0:17979:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050826624 00000100:00100000:3.0:1789403473.306308:0:17979:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050826752 00000100:00100000:3.0:1789403473.306311:0:17979:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050826752 00000100:00100000:3.0:1789403473.306330:0:17979:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1789403473.306336:0:17979:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a144b2b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:41b7c44b-9a12-452a-b9e6-b5b285399ec4+24:3628:x1876325050826624:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789403473.306346:0:17979:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789403473.306357:0:17979:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90a1425c7c00/0x5fb08b1e5b761cb3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x5fb08b1e5b761cac expref: 24 pid: 17219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403473.306366:0:17979:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789403473.306409:0:17979:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a144b2b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:41b7c44b-9a12-452a-b9e6-b5b285399ec4+23:3628:x1876325050826624:12345-0@lo:103:ldlm_bl.0 Request processed in 72us (241us total) trans 0 rc 0/0 00000100:00100000:3.0:1789403473.306415:0:17979:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1789403473.306430:0:17979:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1789403473.306435:0:17979:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a274f9c850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:41b7c44b-9a12-452a-b9e6-b5b285399ec4+22:3626:x1876325050826752:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789403473.306448:0:17979:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789403473.306456:0:17979:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90a2821e8400/0x5fb08b1e5b761ffb lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x5fb08b1e5b761ff4 expref: 22 pid: 17218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403473.306464:0:17979:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789403473.306488:0:17979:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a274f9c850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:41b7c44b-9a12-452a-b9e6-b5b285399ec4+21:3626:x1876325050826752:12345-0@lo:103:ldlm_bl.0 Request processed in 53us (254us total) trans 0 rc 0/0 00000100:00100000:3.0:1789403473.306494:0:17979:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1789403473.306551:0:3626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a144b29180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:41b7c44b-9a12-452a-b9e6-b5b285399ec4:3626:1876325050826752:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789403473.306569:0:3628:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a144b29c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:41b7c44b-9a12-452a-b9e6-b5b285399ec4:3628:1876325050826624:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789403473.308084:0:20795:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.143@tcp lock: ffff90a241514400/0x5fb08b1e5b76225c lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x5fb08b1e5b762263 expref: -99 pid: 17221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403473.308092:0:20795:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.143@tcp lock: ffff90a241514400/0x5fb08b1e5b76225c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x5fb08b1e5b762263 expref: -99 pid: 17221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403473.308134:0:20795:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789403473.308144:0:20795:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.143@tcp lock: ffff90a2821e9000/0x5fb08b1e5b761c9e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb08b1e5b761ca5 expref: -99 pid: 17203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403473.308151:0:20795:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.143@tcp lock: ffff90a2821e9000/0x5fb08b1e5b761c9e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x5fb08b1e5b761ca5 expref: -99 pid: 17203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403473.308157:0:20795:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.143@tcp lock: ffff90a2821e9000/0x5fb08b1e5b761c9e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x5fb08b1e5b761ca5 expref: -99 pid: 17203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403473.308163:0:20795:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.143@tcp lock: ffff90a2821e9000/0x5fb08b1e5b761c9e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x5fb08b1e5b761ca5 expref: -99 pid: 17203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403473.308176:0:20795:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 10000000:01000000:1.0:1789403473.308234:0:20795:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-MDT0000 10000000:01000000:1.0:1789403473.308238:0:20795:0:(mgc_request.c:547:config_log_end()) end config log lustre-MDT0000 (0) 00000020:01000004:1.0:1789403473.308270:0:20795:0:(tgt_mount.c:2111:server_put_super()) stopping lustre-MDT0000 00000020:01000000:1.0:1789403473.308275:0:20795:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000 (flags='F') 00000020:00000080:1.0:1789403473.308280:0:20795:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1789403473.308286:0:20795:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000: forcing exports to disconnect: 4/13 00000020:00080000:1.0:1789403473.308292:0:20795:0:(genops.c:1818:print_export_data()) lustre-MDT0000: ACTIVE ffff90a1425ad800 lustre-MDT0000-lwp-OST0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1789403473.308298:0:20795:0:(genops.c:1818:print_export_data()) lustre-MDT0000: ACTIVE ffff90a143330000 lustre-MDT0000-lwp-OST0000_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1789403473.308302:0:20795:0:(genops.c:1818:print_export_data()) lustre-MDT0000: ACTIVE ffff90a281a0e000 lustre-MDT0000-lwp-MDT0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1789403473.308307:0:20795:0:(genops.c:1818:print_export_data()) lustre-MDT0000: ACTIVE ffff90a141a3e000 lustre-MDT0001-mdtlov_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1789403473.308314:0:20795:0:(genops.c:1818:print_export_data()) lustre-MDT0000: UNLINKED ffff90a1432ea000 0fd9fbb3-6ee9-4661-b027-6d4be7a889f0 192.168.203.43@tcp 2 (0 2 0) 1 0 0 0: 0000000000000000 8589934599 stale:0 00000020:00080000:1.0:1789403473.308319:0:20795:0:(genops.c:1818:print_export_data()) lustre-MDT0000: UNLINKED ffff90a1434d3000 6e04e948-ba92-4319-8cea-8a865bfd1e14 192.168.203.43@tcp 5 (0 5 0) 1 0 0 0: 0000000000000000 8589934624 stale:0 00000020:00080000:1.0:1789403473.308331:0:20795:0:(genops.c:1552:class_disconnect_exports()) OBD device 5 (ffff90a1425d0000) has exports, disconnecting them 00000020:00080000:1.0:1789403473.308335:0:20795:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff90a1425ad800), last request at 1789403470 00000020:00000080:1.0:1789403473.308342:0:20795:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x5fb08b1e5b761fc3 00000100:00080000:1.0:1789403473.308495:0:20795:0:(import.c:65:import_set_state_nolock()) ffff90a1425ac800 : changing import state from FULL to CLOSED 00010000:00010000:3.0:1789403473.312234:0:17212:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789403473.312234:0:17978:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1789403473.312249:0:17978:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.143@tcp lock: ffff90a241514400/0x5fb08b1e5b76225c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x5fb08b1e5b762263 expref: -99 pid: 17221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403473.312251:0:17212:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.143@tcp lock: ffff90a2821e9000/0x5fb08b1e5b761c9e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x5fb08b1e5b761ca5 expref: -99 pid: 17203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403473.312262:0:17212:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a2821e9000 already unused, calling callback (ffffffffc120dc20) 00010000:00010000:2.0:1789403473.312262:0:17978:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a241514400 already unused, calling callback (ffffffffc120dc20) 10000000:00010000:3.0:1789403473.312267:0:17212:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.143@tcp lock: ffff90a2821e9000/0x5fb08b1e5b761c9e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x5fb08b1e5b761ca5 expref: -99 pid: 17203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789403473.312267:0:17978:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.143@tcp lock: ffff90a241514400/0x5fb08b1e5b76225c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x5fb08b1e5b762263 expref: -99 pid: 17221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403473.312279:0:17212:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.143@tcp lock: ffff90a2821e9000/0x5fb08b1e5b761c9e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x5fb08b1e5b761ca5 expref: -99 pid: 17203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789403473.312286:0:17212:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.143@tcp lock: ffff90a2821e9000/0x5fb08b1e5b761c9e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x5fb08b1e5b761ca5 expref: -99 pid: 17203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789403473.312292:0:17212:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 10000000:01000000:3.0:1789403473.312295:0:17212:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-barrier: stopping, won't requeue 10000000:01000000:3.0:1789403473.312298:0:17212:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-barrier 00010000:00010000:3.0:1789403473.312342:0:17212:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.143@tcp lock: ffff90a2821e9000/0x5fb08b1e5b761c9e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x5fb08b1e5b761ca5 expref: -99 pid: 17203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403473.312362:0:17212:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789403473.312412:0:17212:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.143@tcp lock: ffff90a2821e9000/0x5fb08b1e5b761c9e lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x5fb08b1e5b761ca5 expref: -99 pid: 17203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403473.312420:0:17212:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.143@tcp lock: ffff90a2821e9000/0x5fb08b1e5b761c9e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x5fb08b1e5b761ca5 expref: -99 pid: 17203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403473.312434:0:17212:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789403473.312435:0:17212:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789403473.312437:0:17212:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789403473.312448:0:17213:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789403473.312453:0:3627:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a144b29c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:41b7c44b-9a12-452a-b9e6-b5b285399ec4:3627:1876325050826880:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789403473.312527:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789403473.312567:0:17979:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050826880 00000100:00100000:3.0:1789403473.312575:0:17979:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050826880 00000100:00100000:3.0:1789403473.312621:0:17979:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1789403473.312629:0:17979:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a1443e7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:41b7c44b-9a12-452a-b9e6-b5b285399ec4+21:3627:x1876325050826880:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789403473.312649:0:17979:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789403473.312664:0:17979:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90a1425c7000/0x5fb08b1e5b761ca5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x5fb08b1e5b761c9e expref: 21 pid: 17217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403473.312675:0:17979:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789403473.312715:0:17979:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a1443e7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:41b7c44b-9a12-452a-b9e6-b5b285399ec4+20:3627:x1876325050826880:12345-0@lo:103:ldlm_bl.0 Request processed in 88us (189us total) trans 0 rc 0/0 00000100:00100000:3.0:1789403473.312722:0:17979:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1789403473.313062:0:3627:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a144b29c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:41b7c44b-9a12-452a-b9e6-b5b285399ec4:3627:1876325050826880:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789403473.313240:0:17978:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.143@tcp lock: ffff90a241514400/0x5fb08b1e5b76225c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0x5fb08b1e5b762263 expref: -99 pid: 17221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789403473.313249:0:17978:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.143@tcp lock: ffff90a241514400/0x5fb08b1e5b76225c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0x5fb08b1e5b762263 expref: -99 pid: 17221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789403473.313255:0:17978:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:2.0:1789403473.313258:0:17978:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:2.0:1789403473.313260:0:17978:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:2.0:1789403473.313349:0:17978:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.143@tcp lock: ffff90a241514400/0x5fb08b1e5b76225c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x5fb08b1e5b762263 expref: -99 pid: 17221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403473.313356:0:17978:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789403473.313381:0:17978:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.143@tcp lock: ffff90a241514400/0x5fb08b1e5b76225c lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x5fb08b1e5b762263 expref: -99 pid: 17221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403473.313404:0:17978:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.143@tcp lock: ffff90a241514400/0x5fb08b1e5b76225c lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x5fb08b1e5b762263 expref: -99 pid: 17221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403473.313418:0:17978:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789403473.313420:0:17978:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789403473.313431:0:17978:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789403473.313499:0:3628:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a27c922680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:41b7c44b-9a12-452a-b9e6-b5b285399ec4:3628:1876325050827008:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789403473.313533:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789403473.313718:0:17211:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050827008 00000100:00100000:2.0:1789403473.313724:0:17211:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050827008 00000100:00100000:2.0:1789403473.313763:0:17211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1789403473.313770:0:17211:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a144b29180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:41b7c44b-9a12-452a-b9e6-b5b285399ec4+20:3628:x1876325050827008:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789403473.313781:0:17211:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789403473.313791:0:17211:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90a281b04000/0x5fb08b1e5b762263 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x5fb08b1e5b76225c expref: 20 pid: 17218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403473.313801:0:17211:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789403473.313840:0:17211:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a144b29180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:41b7c44b-9a12-452a-b9e6-b5b285399ec4+19:3628:x1876325050827008:12345-0@lo:103:ldlm_bl.0 Request processed in 71us (306us total) trans 0 rc 0/0 00000100:00100000:2.0:1789403473.313847:0:17211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1789403473.314036:0:3628:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a27c922680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:41b7c44b-9a12-452a-b9e6-b5b285399ec4:3628:1876325050827008:0@lo:103:ldlm_bl.0 00000020:00080000:1.0:1789403473.314129:0:20795:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff90a1425ad800): rc 0 00000020:00000080:1.0:1789403473.314133:0:20795:0:(genops.c:885:class_export_put()) final put ffff90a1425ad800/lustre-MDT0000-lwp-OST0001_UUID 00000020:00080000:1.0:1789403473.314153:0:20795:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff90a143330000), last request at 1789403470 00000020:00000080:1.0:1789403473.314159:0:20795:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x5fb08b1e5b761f29 00000100:00080000:1.0:1789403473.314168:0:20795:0:(import.c:65:import_set_state_nolock()) ffff90a1442c2800 : changing import state from FULL to CLOSED 00000020:00000080:3.0:1789403473.314169:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff90a1425ad800/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000 00000020:00000080:3.0:1789403473.314211:0:37:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff90a1425ac800 for lustre-MDT0000 00010000:00010000:2.0:1789403473.314233:0:17212:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789403473.314301:0:17213:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:0.0:1789403473.314558:0:20795:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff90a143330000): rc 0 00000020:00000080:0.0:1789403473.314562:0:20795:0:(genops.c:885:class_export_put()) final put ffff90a143330000/lustre-MDT0000-lwp-OST0000_UUID 00000020:00000080:3.0:1789403473.314604:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff90a143330000/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000 00000020:00080000:0.0:1789403473.314604:0:20795:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff90a281a0e000), last request at 1789403406 00000020:00000080:0.0:1789403473.314608:0:20795:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x5fb08b1e5b761e7a 00000100:00080000:0.0:1789403473.314612:0:20795:0:(import.c:65:import_set_state_nolock()) ffff90a281a0a000 : changing import state from FULL to CLOSED 00000020:00000080:3.0:1789403473.314646:0:37:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff90a1442c2800 for lustre-MDT0000 00000020:00080000:0.0:1789403473.314688:0:20795:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff90a281a0e000): rc 0 00000020:00000080:0.0:1789403473.314691:0:20795:0:(genops.c:885:class_export_put()) final put ffff90a281a0e000/lustre-MDT0000-lwp-MDT0001_UUID 00000020:00080000:0.0:1789403473.314703:0:20795:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff90a141a3e000), last request at 1789403406 00000020:00000080:0.0:1789403473.314707:0:20795:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x5fb08b1e5b761e1f 00000100:00080000:0.0:1789403473.314711:0:20795:0:(import.c:65:import_set_state_nolock()) ffff90a141a3c800 : changing import state from FULL to CLOSED 00000020:00000080:3.0:1789403473.314716:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff90a281a0e000/lustre-MDT0000-lwp-MDT0001_UUID for lustre-MDT0000 00000020:00000080:3.0:1789403473.314746:0:37:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff90a281a0a000 for lustre-MDT0000 00010000:00010000:1.0:1789403473.314773:0:17978:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00000004:0.0:1789403473.314828:0:20795:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934629 00000020:00080000:0.0:1789403473.314906:0:20795:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff90a141a3e000): rc 0 00000004:00000080:0.0:1789403473.314913:0:20795:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=400866e7 len=0 karg=ffffbb21c56ebae0 00000100:00080000:0.0:1789403473.314996:0:20795:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:0.0:1789403473.315000:0:20795:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 3 00000100:00080000:0.0:1789403473.318746:0:20795:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID 00000100:00080000:0.0:1789403473.318784:0:20795:0:(import.c:65:import_set_state_nolock()) ffff90a1436b4000 lustre-MDT0001_UUID: changing import state from FULL to CONNECTING 00000100:00100000:3.0:1789403473.318903:0:3625:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a1443e4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3625:1876325050827136:0@lo:39:umount.0 00000100:00100000:3.0:1789403473.319009:0:3625:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1789403473.319476:0:17212:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789403473.319610:0:19382:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050827136 00000100:00100000:0.0:1789403473.319618:0:19382:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050827136 00000100:00100000:0.0:1789403473.319674:0:19382:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1789403473.319682:0:19382:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a144b2b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3625:x1876325050827136:12345-0@lo:39:umount.0 00000020:00000080:0.0:1789403473.319709:0:19382:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x5fb08b1e5b761ea4 00000100:00080000:0.0:1789403473.319717:0:19382:0:(import.c:65:import_set_state_nolock()) ffff90a2702b7800 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1789403473.319743:0:19382:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 2, last_transno is 8589934594 00000100:00100000:0.0:1789403473.319850:0:19382:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a144b2b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+3:3625:x1876325050827136:12345-0@lo:39:umount.0 Request processed in 169us (841us total) trans 8589934595 rc 0/0 00000100:00100000:0.0:1789403473.319857:0:19382:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00010000:00010000:3.0:1789403473.320131:0:17213:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1789403473.320161:0:3625:0:(import.c:65:import_set_state_nolock()) ffff90a1436b4000 lustre-MDT0001_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:3.0:1789403473.320167:0:3625:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a1443e4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3625:1876325050827136:0@lo:39:umount.0 00000100:00080000:0.0:1789403473.320620:0:20795:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:0.0:1789403473.320625:0:20795:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934598 gen 3 00000004:00080000:0.0:1789403473.320680:0:20795:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:0.0:1789403473.320754:0:20795:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000100:00080000:0.0:1789403473.320773:0:20795:0:(import.c:65:import_set_state_nolock()) ffff90a1436b1000 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 00000100:00080000:0.0:1789403473.320790:0:20795:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:0.0:1789403473.320793:0:20795:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934594 gen 3 00000004:00080000:0.0:1789403473.320807:0:20795:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:0.0:1789403473.320872:0:20795:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000100:00080000:0.0:1789403473.320898:0:20795:0:(import.c:65:import_set_state_nolock()) ffff90a26d2d2000 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00000020:00080000:0.0:1789403473.320949:0:20795:0:(genops.c:1557:class_disconnect_exports()) OBD device 5 (ffff90a1425d0000) has no exports 00000100:00100000:2.0:1789403473.322587:0:3625:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a1443e5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3625:1876325050827264:0@lo:9:umount.0 00000100:00100000:2.0:1789403473.322673:0:3625:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789403473.322707:0:3625:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a144bec700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3625:1876325050827392:0@lo:9:umount.0 00000100:00100000:2.0:1789403473.322739:0:3625:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789403473.322775:0:18731:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050827264 00000100:00100000:3.0:1789403473.322783:0:18731:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050827264 00000100:00100000:3.0:1789403473.322850:0:18731:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050827392 00000100:00100000:3.0:1789403473.322854:0:18731:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050827392 00000100:00100000:1.0:1789403473.322861:0:19833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1789403473.322872:0:19833:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a27c920a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3625:x1876325050827264:12345-0@lo:9:umount.0 00000100:00100000:3.0:1789403473.322875:0:18731:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1789403473.322882:0:18731:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a27c920000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3625:x1876325050827392:12345-0@lo:9:umount.0 00000020:00000080:3.0:1789403473.322903:0:18731:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x5fb08b1e5b762009 00000100:00080000:3.0:1789403473.322912:0:18731:0:(import.c:65:import_set_state_nolock()) ffff90a142429800 : changing import state from FULL to CLOSED 00000020:00000080:1.0:1789403473.322915:0:19833:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x5fb08b1e5b762002 00000100:00080000:1.0:1789403473.322920:0:19833:0:(import.c:65:import_set_state_nolock()) ffff90a14242d800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1789403473.322951:0:18731:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 8589934594 00000001:00000004:1.0:1789403473.323077:0:19833:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 8589934600 00000100:00100000:3.0:1789403473.323079:0:18731:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a27c920000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+2:3625:x1876325050827392:12345-0@lo:9:umount.0 Request processed in 197us (338us total) trans 0 rc 0/0 00000100:00100000:3.0:1789403473.323086:0:18731:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00080000:3.0:1789403473.323127:0:3625:0:(import.c:65:import_set_state_nolock()) ffff90a26d2d2000 lustre-OST0001_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:3.0:1789403473.323138:0:3625:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:3.0:1789403473.323140:0:3625:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1789403473.323143:0:3625:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a144bec700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3625:1876325050827392:0@lo:9:umount.0 00000100:00100000:1.0:1789403473.323156:0:19833:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a27c920a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+2:3625:x1876325050827264:12345-0@lo:9:umount.0 Request processed in 287us (484us total) trans 0 rc 0/0 00000100:00080000:3.0:1789403473.323159:0:3625:0:(import.c:65:import_set_state_nolock()) ffff90a1436b1000 lustre-OST0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:1.0:1789403473.323162:0:19833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000004:00080000:3.0:1789403473.323182:0:3625:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:3.0:1789403473.323184:0:3625:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1789403473.323187:0:3625:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a1443e5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3625:1876325050827264:0@lo:9:umount.0 00000100:00080000:2.0:1789403473.323253:0:17220:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789403473.323257:0:17220:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1789403473.325885:0:17978:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789403473.327039:0:17212:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:3.0:1789403473.329314:0:20795:0:(genops.c:1557:class_disconnect_exports()) OBD device 5 (ffff90a1425d0000) has no exports 00000020:00000080:3.0:1789403473.399742:0:20795:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x5fb08b1e5b761cf9 00000020:00000080:3.0:1789403473.399758:0:20795:0:(genops.c:885:class_export_put()) final put ffff90a27002e000/lustre-QMT0000_UUID 00000020:01000000:3.0:1789403473.399823:0:20795:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-QMT0000 (flags='') 00000020:00000080:0.0:1789403473.402471:0:20795:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1789403473.402487:0:20795:0:(obd_config.c:956:class_cleanup()) lustre-QMT0000: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1789403473.402492:0:20795:0:(genops.c:1557:class_disconnect_exports()) OBD device 7 (ffff90a14264cd40) has no exports 00000020:00000080:0.0:1789403473.403672:0:20795:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x5fb08b1e5b761cf2 00000020:00000080:0.0:1789403473.403684:0:20795:0:(genops.c:885:class_export_put()) final put ffff90a270025800/lustre-MDT0000-osd_UUID 00000020:00000080:2.0:1789403473.404488:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff90a27002e000/lustre-QMT0000_UUID for lustre-QMT0000 00000020:00000080:0.0:1789403473.411530:0:20795:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1789403473.411547:0:20795:0:(obd_config.c:883:class_detach()) detach on obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:0.0:1789403473.411578:0:20795:0:(genops.c:885:class_export_put()) final put ffff90a270024800/lustre-QMT0000_UUID 00000020:00000080:0.0:1789403473.411583:0:20795:0:(genops.c:844:class_export_destroy()) destroying export ffff90a270024800/lustre-QMT0000_UUID for lustre-QMT0000 00000020:01000000:0.0:1789403473.411596:0:20795:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-QMT0000 (lustre-QMT0000_UUID) 00000020:00000080:2.0:1789403473.412047:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff90a270025800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:00010000:3.0:1789403474.162055:0:17213:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789403475.185755:0:17212:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789403475.185915:0:3629:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a27c922300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:41b7c44b-9a12-452a-b9e6-b5b285399ec4:3629:1876325050827520:0@lo:400:kworker.0 00000100:00100000:2.0:1789403475.186007:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789403475.186046:0:3629:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a27c921c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3629:1876325050828032:0@lo:400:kworker.0 00000100:00100000:2.0:1789403475.186075:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789403475.186079:0:3627:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a27c920700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3627:1876325050827776:0@lo:400:kworker.0 00000100:00100000:0.0:1789403475.186120:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789403475.186126:0:3629:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a281912d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3629:1876325050828544:0@lo:400:kworker.0 00000100:00100000:0.0:1789403475.186157:0:3627:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a1442b4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3627:1876325050828288:0@lo:400:kworker.0 00000100:00100000:2.0:1789403475.186163:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789403475.186193:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789403475.186209:0:3629:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:2.0:1789403475.186216:0:3629:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a27c922680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3629:1876325050827904:0@lo:400:kworker.0 00000100:00100000:0.0:1789403475.186230:0:3627:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:0.0:1789403475.186240:0:3627:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a27c921f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3627:1876325050827648:0@lo:400:kworker.0 00000100:00100000:2.0:1789403475.186248:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789403475.186368:0:3626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a144b28a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3626:1876325050828672:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1789403475.187254:0:17225:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050828032 00000100:00100000:1.0:1789403475.187264:0:17225:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050828032 00000100:00100000:1.0:1789403475.187305:0:17225:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050828544 00000100:00100000:1.0:1789403475.187308:0:17225:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050828544 00000100:00100000:1.0:1789403475.187345:0:17225:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050828288 00000100:00100000:1.0:1789403475.187348:0:17225:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050828288 00000100:00100000:1.0:1789403475.187369:0:17225:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:1.0:1789403475.187379:0:17225:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a281911180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3629:x1876325050828544:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789403475.187931:0:3629:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a142501c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3629:1876325050828416:0@lo:400:kworker.0 00000100:00100000:2.0:1789403475.187997:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789403475.188030:0:17226:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050828416 00000100:00100000:2.0:1789403475.188035:0:17226:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050828416 00000100:00100000:2.0:1789403475.188058:0:17226:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:2.0:1789403475.188066:0:17226:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a144bedc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3627:x1876325050828288:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789403475.188103:0:17226:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a144bedc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3627:x1876325050828288:12345-0@lo:400:kworker.0 Request processed in 38us (1909us total) trans 0 rc 0/0 00000100:00100000:2.0:1789403475.188110:0:17226:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:2.0:1789403475.188147:0:17226:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1789403475.188152:0:17226:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a281911f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3629:x1876325050828032:12345-0@lo:400:kworker.0 00000020:00080000:2.0:1789403475.188158:0:17226:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:2.0:1789403475.188190:0:17226:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a281911f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3629:x1876325050828032:12345-0@lo:400:kworker.0 Request processed in 37us (2115us total) trans 0 rc -107/-107 00000100:00100000:2.0:1789403475.188197:0:17226:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1789403475.188208:0:17226:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1789403475.188212:0:17226:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a27a64ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3629:x1876325050828416:12345-0@lo:400:kworker.0 00000020:00080000:2.0:1789403475.188216:0:17226:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:2.0:1789403475.188239:0:17226:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a27a64ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3629:x1876325050828416:12345-0@lo:400:kworker.0 Request processed in 26us (243us total) trans 0 rc -107/-107 00000100:00100000:2.0:1789403475.188245:0:17226:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00080000:2.0:1789403475.188285:0:3629:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:2.0:1789403475.188297:0:3629:0:(import.c:65:import_set_state_nolock()) ffff90a1434d4000 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:2.0:1789403475.188303:0:3629:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00100000:3.0:1789403475.188306:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789403475.188347:0:17219:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050827520 00000100:00100000:3.0:1789403475.188352:0:17219:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050827520 00000100:00100000:3.0:1789403475.188383:0:17219:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 171 00000100:00100000:3.0:1789403475.188405:0:17219:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a27500e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:41b7c44b-9a12-452a-b9e6-b5b285399ec4+19:3629:x1876325050827520:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789403475.188440:0:17219:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a27500e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:41b7c44b-9a12-452a-b9e6-b5b285399ec4+19:3629:x1876325050827520:12345-0@lo:400:kworker.0 Request processed in 50us (2433us total) trans 0 rc 0/0 00000100:00100000:3.0:1789403475.188446:0:17219:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 171 00000100:00100000:3.0:1789403475.188476:0:18732:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050827776 00000100:00100000:3.0:1789403475.188479:0:18732:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050827776 00000100:00100000:3.0:1789403475.188508:0:18732:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050827904 00000100:00100000:3.0:1789403475.188511:0:18732:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050827904 00000100:00100000:3.0:1789403475.189300:0:18732:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1789403475.189312:0:18732:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a144bef100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3627:x1876325050827776:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789403475.189358:0:18732:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a144bef100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3627:x1876325050827776:12345-0@lo:400:kworker.0 Request processed in 50us (3239us total) trans 0 rc 0/0 00000100:00100000:3.0:1789403475.189364:0:18732:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1789403475.189379:0:18732:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1789403475.189418:0:18732:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a246f3d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3629:x1876325050827904:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789403475.189450:0:18732:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a246f3d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3629:x1876325050827904:12345-0@lo:400:kworker.0 Request processed in 35us (3206us total) trans 0 rc 0/0 00000100:00100000:3.0:1789403475.189455:0:18732:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1789403475.190040:0:18734:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050828672 00000100:00100000:3.0:1789403475.190048:0:18734:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050828672 00000100:00100000:3.0:1789403475.190081:0:18734:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1789403475.190088:0:18734:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a144b28000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3626:x1876325050828672:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1789403475.190108:0:18734:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923513344 avail 3691991040 00000100:00100000:3.0:1789403475.190220:0:18734:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a144b28000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3626:x1876325050828672:12345-0@lo:13:osp-pre-1-1.0 Request processed in 132us (1917us total) trans 0 rc 0/0 00000100:00100000:3.0:1789403475.190227:0:18734:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1789403475.190365:0:3626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a144b28a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3626:1876325050828672:0@lo:13:osp-pre-1-1.0 00000100:00080000:3.0:1789403475.190445:0:17220:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789403475.190450:0:17220:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1789403475.190453:0:17220:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000001:00100000:3.0:1789403475.192197:0:17957:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00080000:3.0:1789403475.192209:0:17957:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 8589934595 is committed 00000020:00000080:3.0:1789403475.192213:0:17957:0:(genops.c:885:class_export_put()) final put ffff90a281a0d800/lustre-MDT0000-mdtlov_UUID 00000001:00100000:3.0:1789403475.192229:0:17957:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of 0fd9fbb3-6ee9-4661-b027-6d4be7a889f0 00000001:00080000:3.0:1789403475.192233:0:17957:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 8589934594 is committed 00000020:00000080:3.0:1789403475.192235:0:17957:0:(genops.c:885:class_export_put()) final put ffff90a1432ee800/0fd9fbb3-6ee9-4661-b027-6d4be7a889f0 00000001:00100000:3.0:1789403475.192239:0:17957:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of 6e04e948-ba92-4319-8cea-8a865bfd1e14 00000001:00080000:3.0:1789403475.192243:0:17957:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 8589934593 is committed 00000020:00000080:3.0:1789403475.192245:0:17957:0:(genops.c:885:class_export_put()) final put ffff90a143331800/6e04e948-ba92-4319-8cea-8a865bfd1e14 00000020:00000080:3.0:1789403475.192264:0:17331:0:(genops.c:844:class_export_destroy()) destroying export ffff90a281a0d800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001 00000020:00000080:3.0:1789403475.192312:0:17331:0:(genops.c:844:class_export_destroy()) destroying export ffff90a1432ee800/0fd9fbb3-6ee9-4661-b027-6d4be7a889f0 for lustre-MDT0001 00000020:00000080:3.0:1789403475.192343:0:17331:0:(genops.c:844:class_export_destroy()) destroying export ffff90a143331800/6e04e948-ba92-4319-8cea-8a865bfd1e14 for lustre-MDT0001 00000020:00000080:3.0:1789403475.192363:0:17331:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff90a2702b7800 for lustre-MDT0001 00000020:00000080:3.0:1789403475.192368:0:17331:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff90a1432ed000 for lustre-MDT0001 00000020:00000080:3.0:1789403475.192370:0:17331:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff90a143335000 for lustre-MDT0001 00000001:00100000:3.0:1789403475.193251:0:17204:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000020:00000080:3.0:1789403475.193257:0:17204:0:(genops.c:885:class_export_put()) final put ffff90a141a3e000/lustre-MDT0001-mdtlov_UUID 00000001:00100000:3.0:1789403475.193269:0:17204:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 0fd9fbb3-6ee9-4661-b027-6d4be7a889f0 00000001:00080000:3.0:1789403475.193275:0:17204:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934629 is committed 00000020:00000080:3.0:1789403475.193278:0:17204:0:(genops.c:885:class_export_put()) final put ffff90a1432ea000/0fd9fbb3-6ee9-4661-b027-6d4be7a889f0 00000001:00100000:3.0:1789403475.193283:0:17204:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 6e04e948-ba92-4319-8cea-8a865bfd1e14 00000001:00080000:3.0:1789403475.193287:0:17204:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934628 is committed 00000020:00000080:3.0:1789403475.193292:0:17204:0:(genops.c:885:class_export_put()) final put ffff90a1434d3000/6e04e948-ba92-4319-8cea-8a865bfd1e14 00000020:00000080:3.0:1789403475.193302:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff90a141a3e000/lustre-MDT0001-mdtlov_UUID for lustre-MDT0000 00000020:00000080:3.0:1789403475.193347:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff90a1432ea000/0fd9fbb3-6ee9-4661-b027-6d4be7a889f0 for lustre-MDT0000 00000020:00000080:3.0:1789403475.193372:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff90a1434d3000/6e04e948-ba92-4319-8cea-8a865bfd1e14 for lustre-MDT0000 00000020:00000080:3.0:1789403475.193414:0:37:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff90a141a3c800 for lustre-MDT0000 00000020:00000080:3.0:1789403475.193420:0:37:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff90a1432eb000 for lustre-MDT0000 00000020:00000080:3.0:1789403475.193424:0:37:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff90a1434d7000 for lustre-MDT0000 00000100:00100000:0.0:1789403475.193775:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789403475.193813:0:3627:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a27c920e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3627:1876325050828160:0@lo:400:kworker.0 00000100:00100000:0.0:1789403475.193845:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789403475.194005:0:3627:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a27c920700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3627:1876325050827776:0@lo:400:kworker.0 00010000:00080000:0.0:1789403475.194022:0:3627:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90a1442b4000 x1876325050828288/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789403491 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789403475.194032:0:3627:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a1442b4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3627:1876325050828288:0@lo:400:kworker.0 00000100:00100000:1.0:1789403475.194562:0:17225:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a281911180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3629:x1876325050828544:12345-0@lo:400:kworker.0 Request processed in 7182us (8398us total) trans 0 rc 0/0 00000100:00100000:1.0:1789403475.194599:0:17225:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:1.0:1789403475.194636:0:17225:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050828160 00000100:00100000:1.0:1789403475.194642:0:17225:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050828160 00000100:00100000:1.0:1789403475.194673:0:17225:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1789403475.194679:0:17225:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a144bef800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3627:x1876325050828160:12345-0@lo:400:kworker.0 00000020:00080000:1.0:1789403475.194686:0:17225:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:1.0:1789403475.194720:0:17225:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a144bef800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3627:x1876325050828160:12345-0@lo:400:kworker.0 Request processed in 41us (875us total) trans 0 rc -107/-107 00000100:00100000:1.0:1789403475.194726:0:17225:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1789403475.194814:0:17229:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050827648 00000100:00100000:3.0:1789403475.194818:0:17229:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050827648 00000100:00100000:3.0:1789403475.194847:0:17229:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1789403475.194851:0:17229:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a144bed180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3627:x1876325050827648:12345-0@lo:400:kworker.0 00000100:00080000:0.0:1789403475.194931:0:3627:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0000 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:0.0:1789403475.194936:0:3627:0:(import.c:65:import_set_state_nolock()) ffff90a143333800 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:0.0:1789403475.194943:0:3627:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0000: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000020:00080000:3.0:1789403475.194948:0:17229:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00080000:0.0:1789403475.194950:0:3627:0:(import.c:65:import_set_state_nolock()) ffff90a143333800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1789403475.194956:0:3627:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 467 00000100:00100000:3.0:1789403475.194976:0:17229:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a144bed180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3627:x1876325050827648:12345-0@lo:400:kworker.0 Request processed in 123us (1205us total) trans 0 rc -107/-107 00000100:00080000:0.0:1789403475.194979:0:3627:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff90a143333800 using connection 192.168.203.143@tcp/0@lo 00000100:00100000:3.0:1789403475.194984:0:17229:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1789403475.195009:0:3627:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff90a144beea00 x1876325050828800/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1789403475.195054:0:3627:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a27c920e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3627:1876325050828160:0@lo:400:kworker.0 00000100:00080000:0.0:1789403475.195077:0:3627:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-osp-MDT0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:0.0:1789403475.195080:0:3627:0:(import.c:65:import_set_state_nolock()) ffff90a26d2d7800 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:0.0:1789403475.195084:0:3627:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:0.0:1789403475.195088:0:3627:0:(import.c:65:import_set_state_nolock()) ffff90a26d2d7800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00100000:3.0:1789403475.195112:0:3625:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a144beea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3625:1876325050828800:0@lo:38:ptlrpcd_00_01.0 00000100:00100000:3.0:1789403475.195141:0:3625:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789403475.195174:0:17224:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050828800 00000100:00100000:3.0:1789403475.195179:0:17224:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050828800 00000100:00100000:3.0:1789403475.195197:0:17224:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1789403475.195203:0:17224:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a144b28a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3625:x1876325050828800:12345-0@lo:38:ptlrpcd_00_01.0 00010000:02000000:3.0:1789403475.195217:0:17224:0:(ldlm_lib.c:1212:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00080000:0.0:1789403475.195256:0:3627:0:(import.c:545:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 452 00000100:00080000:0.0:1789403475.195315:0:3627:0:(import.c:666:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff90a26d2d7800 using connection 192.168.203.143@tcp/0@lo 00000100:00100000:0.0:1789403475.195331:0:3627:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff90a144bed500 x1876325050828928/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1789403475.195349:0:3627:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a27c921f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3627:1876325050827648:0@lo:400:kworker.0 00000100:00100000:0.0:1789403475.195370:0:3625:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a144bed500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3625:1876325050828928:0@lo:38:ptlrpcd_00_01.0 00000100:00100000:0.0:1789403475.195559:0:3625:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789403475.195997:0:17230:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050828928 00000100:00100000:1.0:1789403475.196004:0:17230:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050828928 00000100:00100000:1.0:1789403475.196041:0:17230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1789403475.196048:0:17230:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a144befb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3625:x1876325050828928:12345-0@lo:38:ptlrpcd_00_01.0 00010000:02000000:1.0:1789403475.196059:0:17230:0:(ldlm_lib.c:1212:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:1.0:1789403475.196233:0:17230:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a144befb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3625:x1876325050828928:12345-0@lo:38:ptlrpcd_00_01.0 Request processed in 184us (673us total) trans 0 rc -19/-19 00000100:00100000:1.0:1789403475.196251:0:17230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00080000:0.0:1789403475.196530:0:3625:0:(import.c:65:import_set_state_nolock()) ffff90a26d2d7800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1789403475.196537:0:3625:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1789403475.196540:0:3625:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a144bed500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3625:1876325050828928:0@lo:38:ptlrpcd_00_01.0 00000100:00100000:3.0:1789403475.202914:0:17224:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a144b28a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3625:x1876325050828800:12345-0@lo:38:ptlrpcd_00_01.0 Request processed in 7704us (7765us total) trans 0 rc -19/-19 00000100:00100000:3.0:1789403475.202928:0:17224:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00080000:0.0:1789403475.203106:0:3625:0:(import.c:65:import_set_state_nolock()) ffff90a143333800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1789403475.203113:0:3625:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1789403475.203117:0:3625:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a144beea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3625:1876325050828800:0@lo:38:ptlrpcd_00_01.0 00000100:00080000:2.0:1789403475.214248:0:3629:0:(import.c:65:import_set_state_nolock()) ffff90a1434d4000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1789403475.214259:0:3629:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 480 00000100:00080000:2.0:1789403475.214275:0:3629:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff90a1434d4000 using connection 192.168.203.143@tcp/0@lo 00000100:00100000:2.0:1789403475.214316:0:3629:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff90a27a64d500 x1876325050829056/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1789403475.214348:0:3629:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a142501c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3629:1876325050828416:0@lo:400:kworker.0 00000100:00100000:2.0:1789403475.214380:0:3629:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a27c922300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:41b7c44b-9a12-452a-b9e6-b5b285399ec4:3629:1876325050827520:0@lo:400:kworker.0 00000100:00100000:0.0:1789403475.214487:0:3625:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a27a64d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3625:1876325050829056:0@lo:38:ptlrpcd_00_03.0 00000100:00080000:2.0:1789403475.214500:0:3629:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-MDT0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:2.0:1789403475.214505:0:3629:0:(import.c:65:import_set_state_nolock()) ffff90a26d294000 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:2.0:1789403475.214508:0:3629:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:2.0:1789403475.214512:0:3629:0:(import.c:65:import_set_state_nolock()) ffff90a26d294000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00100000:0.0:1789403475.214837:0:3625:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1789403475.214863:0:3629:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 452 00000100:00080000:2.0:1789403475.214871:0:3629:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff90a26d294000 using connection 192.168.203.143@tcp/0@lo 00000100:00100000:2.0:1789403475.214888:0:3629:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff90a27a64fb80 x1876325050829184/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1789403475.214916:0:3625:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a27a64fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3625:1876325050829184:0@lo:38:ptlrpcd_00_03.0 00000100:00100000:0.0:1789403475.214955:0:3625:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789403475.215065:0:19353:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050829056 00000100:00100000:3.0:1789403475.215073:0:19353:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050829056 00000100:00100000:2.0:1789403475.215074:0:3629:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a27c921c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3629:1876325050828032:0@lo:400:kworker.0 00010000:00080000:2.0:1789403475.215094:0:3629:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90a281912d80 x1876325050828544/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789403491 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789403475.215106:0:3629:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a281912d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3629:1876325050828544:0@lo:400:kworker.0 00000100:00100000:2.0:1789403475.215138:0:3629:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a27c922680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3629:1876325050827904:0@lo:400:kworker.0 00000100:00100000:3.0:1789403475.215143:0:19353:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050829184 00000100:00100000:3.0:1789403475.215147:0:19353:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050829184 00000100:00100000:0.0:1789403475.215192:0:17225:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1789403475.215202:0:17226:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:0.0:1789403475.215203:0:17225:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a144beea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3625:x1876325050829056:12345-0@lo:38:ptlrpcd_00_03.0 00000100:00100000:3.0:1789403475.215211:0:19353:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 4 min 3 max 116 00000100:00100000:1.0:1789403475.215215:0:17226:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a144bed500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3625:x1876325050829184:12345-0@lo:38:ptlrpcd_00_03.0 00000100:00100000:3.0:1789403475.215222:0:19353:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt00_004' 00010000:02000000:0.0:1789403475.215222:0:17225:0:(ldlm_lib.c:1212:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00010000:02000000:1.0:1789403475.215230:0:17226:0:(ldlm_lib.c:1212:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:0.0:1789403475.215279:0:17225:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a144beea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3625:x1876325050829056:12345-0@lo:38:ptlrpcd_00_03.0 Request processed in 77us (440us total) trans 0 rc -19/-19 00000100:00100000:1.0:1789403475.215281:0:17226:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a144bed500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3625:x1876325050829184:12345-0@lo:38:ptlrpcd_00_03.0 Request processed in 67us (323us total) trans 0 rc -19/-19 00000100:00100000:0.0:1789403475.215292:0:17225:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1789403475.215301:0:17226:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00080000:3.0:1789403475.215329:0:3625:0:(import.c:65:import_set_state_nolock()) ffff90a26d294000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1789403475.215464:0:3625:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1789403475.215468:0:3625:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a27a64fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3625:1876325050829184:0@lo:38:ptlrpcd_00_03.0 00000100:00080000:3.0:1789403475.215480:0:3625:0:(import.c:65:import_set_state_nolock()) ffff90a1434d4000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1789403475.215482:0:3625:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1789403475.215485:0:3625:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a27a64d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3625:1876325050829056:0@lo:38:ptlrpcd_00_03.0 00000020:01000000:2.0:1789403475.441659:0:20795:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff90a1431874e0 - data ffff90a26dbf16c0/ffff90a277e55000 00000020:01000000:2.0:1789403475.441799:0:20795:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff90a141a2d3c0 - data ffff90a141cdb0d8/ffff90a276a5d800 00000001:00000004:2.0:1789403475.447776:0:20795:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934629 00000100:00080000:0.0:1789403475.498234:0:20795:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:0.0:1789403475.498242:0:20795:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 4 00000100:00100000:0.0:1789403475.498256:0:20795:0:(client.c:3164:ptlrpc_free_committed()) @@@ free request with old gen req@ffff90a1443e4380 x1876325050827136/t8589934595(8589934595) o39->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/224 e 0 to 0 dl 1789403483 ref 1 fl Complete:RNQU/204/0 rc 0/0 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789403475.498282:0:20795:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00080000:0.0:1789403475.505668:0:20795:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:0.0:1789403475.505676:0:20795:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934598 gen 4 00000004:00080000:0.0:1789403475.505723:0:20795:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1789403475.505725:0:20795:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:3.0:1789403475.513547:0:17248:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:3.0:1789403475.513557:0:17248:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xa:0x0] index 2 count 1 00000040:00080000:3.0:1789403475.513572:0:17248:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x2:0x0] index 2 count 2 00000100:00080000:0.0:1789403475.517916:0:20795:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:0.0:1789403475.517924:0:20795:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934594 gen 4 00000004:00080000:0.0:1789403475.517943:0:20795:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1789403475.517946:0:20795:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:1.0:1789403475.518257:0:17250:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:1.0:1789403475.518262:0:17250:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xc:0x0] index 1 count 1 00000040:00080000:1.0:1789403475.518272:0:17250:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x5:0x0] index 2 count 2 00000020:00000080:1.0:1789403475.520036:0:20795:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x5fb08b1e5b761cc1 00000020:00000080:1.0:1789403475.520057:0:20795:0:(genops.c:885:class_export_put()) final put ffff90a14371c800/lustre-MDT0000-osd_UUID 00000020:00000080:3.0:1789403475.520342:0:17331:0:(genops.c:844:class_export_destroy()) destroying export ffff90a14371c800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:1.0:1789403475.521522:0:20795:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x5fb08b1e5b761cd6 00000020:00000080:1.0:1789403475.521534:0:20795:0:(genops.c:885:class_export_put()) final put ffff90a27a74a000/lustre-MDT0000-mdtlov_UUID 00000020:01000000:1.0:1789403475.521545:0:20795:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-mdtlov (flags='') 00000020:00000080:1.0:1789403475.521549:0:20795:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1789403475.521556:0:20795:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-mdtlov: forcing exports to disconnect: 0/2 00000020:00080000:1.0:1789403475.521560:0:20795:0:(genops.c:1557:class_disconnect_exports()) OBD device 4 (ffff90a1425d4d40) has no exports 00000020:00000080:3.0:1789403475.521645:0:17331:0:(genops.c:844:class_export_destroy()) destroying export ffff90a27a74a000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000004:01000000:1.0:1789403475.521804:0:20795:0:(lod_lov.c:59:lod_putref()) destroying 2 ltd desc 00000020:00000080:1.0:1789403475.521812:0:20795:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x5fb08b1e5b761d38 00000020:00000080:1.0:1789403475.521817:0:20795:0:(genops.c:885:class_export_put()) final put ffff90a1436b2800/lustre-MDT0000-mdtlov_UUID 00000020:01000000:1.0:1789403475.521831:0:20795:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osc-MDT0000 (flags='') 00000020:00000080:1.0:1789403475.521835:0:20795:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1789403475.521839:0:20795:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:1.0:1789403475.521841:0:20795:0:(genops.c:1557:class_disconnect_exports()) OBD device 10 (ffff90a14264b380) has no exports 00000020:00000080:1.0:1789403475.521847:0:20795:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x5fb08b1e5b761d31 00000020:00000080:1.0:1789403475.521850:0:20795:0:(genops.c:885:class_export_put()) final put ffff90a270026000/lustre-MDT0000-osd_UUID 00000020:00000080:3.0:1789403475.521965:0:17331:0:(genops.c:844:class_export_destroy()) destroying export ffff90a1436b2800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:00000080:3.0:1789403475.521971:0:17331:0:(genops.c:844:class_export_destroy()) destroying export ffff90a270026000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:01000000:1.0:1789403475.522443:0:20795:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0001-osc-MDT0000: client import never connected 00000100:00080000:1.0:1789403475.522447:0:20795:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:1.0:1789403475.522451:0:20795:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934594 gen 5 00000004:00080000:1.0:1789403475.522457:0:20795:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1789403475.522459:0:20795:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1789403475.522494:0:20795:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1789403475.522500:0:20795:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1789403475.522505:0:20795:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x5fb08b1e5b761d23 00000020:00000080:1.0:1789403475.522510:0:20795:0:(genops.c:885:class_export_put()) final put ffff90a1436b6000/lustre-MDT0000-mdtlov_UUID 00000020:01000000:1.0:1789403475.522513:0:20795:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osc-MDT0000 (flags='') 00000020:00000080:1.0:1789403475.522517:0:20795:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1789403475.522519:0:20795:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:1.0:1789403475.522521:0:20795:0:(genops.c:1557:class_disconnect_exports()) OBD device 9 (ffff90a245c999c0) has no exports 00000020:00000080:1.0:1789403475.522525:0:20795:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x5fb08b1e5b761d1c 00000020:00000080:1.0:1789403475.522527:0:20795:0:(genops.c:885:class_export_put()) final put ffff90a1436b2000/lustre-MDT0000-osd_UUID 00000020:00000080:3.0:1789403475.522683:0:17331:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff90a26d2d2000 for lustre-OST0001-osc-MDT0000 00000020:00000080:3.0:1789403475.522689:0:17331:0:(genops.c:885:class_export_put()) final put ffff90a1436b1800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1789403475.522691:0:17331:0:(genops.c:844:class_export_destroy()) destroying export ffff90a1436b1800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:01000000:3.0:1789403475.522695:0:17331:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1789403475.522766:0:17331:0:(genops.c:844:class_export_destroy()) destroying export ffff90a1436b6000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:00000080:3.0:1789403475.522771:0:17331:0:(genops.c:844:class_export_destroy()) destroying export ffff90a1436b2000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:01000000:1.0:1789403475.523384:0:20795:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0000-osc-MDT0000: client import never connected 00000100:00080000:1.0:1789403475.523416:0:20795:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:1.0:1789403475.523419:0:20795:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934598 gen 5 00000004:00080000:1.0:1789403475.523424:0:20795:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1789403475.523425:0:20795:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1789403475.523456:0:20795:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1789403475.523462:0:20795:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000004:01000000:1.0:1789403475.523473:0:20795:0:(lod_lov.c:59:lod_putref()) destroying 1 ltd desc 00000020:00000080:1.0:1789403475.523477:0:20795:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x5fb08b1e5b761d0e 00000020:00000080:3.0:1789403475.523991:0:17331:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff90a1436b1000 for lustre-OST0000-osc-MDT0000 00000020:00000080:3.0:1789403475.524000:0:17331:0:(genops.c:885:class_export_put()) final put ffff90a1436b3800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1789403475.524002:0:17331:0:(genops.c:844:class_export_destroy()) destroying export ffff90a1436b3800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:01000000:3.0:1789403475.524007:0:17331:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1789403475.526244:0:20795:0:(genops.c:885:class_export_put()) final put ffff90a1436b0800/lustre-MDT0000-mdtlov_UUID 00000020:01000000:1.0:1789403475.526274:0:20795:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-osp-MDT0000 (flags='') 00000020:00000080:1.0:1789403475.526282:0:20795:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1789403475.526291:0:20795:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-osp-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:1.0:1789403475.526296:0:20795:0:(genops.c:1557:class_disconnect_exports()) OBD device 8 (ffff90a245c9cd40) has no exports 00000020:00000080:1.0:1789403475.526303:0:20795:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x5fb08b1e5b761d07 00000020:00000080:1.0:1789403475.526310:0:20795:0:(genops.c:885:class_export_put()) final put ffff90a1436b3000/lustre-MDT0000-osd_UUID 00000020:00000080:3.0:1789403475.526678:0:17331:0:(genops.c:844:class_export_destroy()) destroying export ffff90a1436b0800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001-osp-MDT0000 00000020:00000080:3.0:1789403475.526686:0:17331:0:(genops.c:844:class_export_destroy()) destroying export ffff90a1436b3000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:01000000:0.0:1789403475.528503:0:20795:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0001-osp-MDT0000: client import never connected 00000100:00080000:0.0:1789403475.528511:0:20795:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:0.0:1789403475.528514:0:20795:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 5 00000100:00100000:0.0:1789403475.528521:0:20795:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1789403475.528565:0:20795:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1789403475.528574:0:20795:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-osp-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1789403475.528599:0:20795:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1789403475.528602:0:20795:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1789403475.528607:0:20795:0:(genops.c:885:class_export_put()) final put ffff90a14371b800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1789403475.528631:0:20795:0:(genops.c:844:class_export_destroy()) destroying export ffff90a14371b800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:01000000:0.0:1789403475.528643:0:20795:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-mdtlov (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1789403475.528763:0:20795:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x5fb08b1e5b761cdd 00000020:00000080:0.0:1789403475.528770:0:20795:0:(genops.c:885:class_export_put()) final put ffff90a27a749800/lustre-MDD0000_UUID 00000020:01000000:0.0:1789403475.528775:0:20795:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDD0000 (flags='') 00000020:00000080:0.0:1789403475.528779:0:20795:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1789403475.528783:0:20795:0:(obd_config.c:956:class_cleanup()) lustre-MDD0000: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1789403475.528787:0:20795:0:(genops.c:1557:class_disconnect_exports()) OBD device 6 (ffff90a1425d19c0) has no exports 00000020:00000080:0.0:1789403475.528805:0:20795:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1789403475.528808:0:20795:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000020:00000080:0.0:1789403475.528812:0:20795:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x5fb08b1e5b761ce4 00000020:00000080:0.0:1789403475.528816:0:20795:0:(genops.c:885:class_export_put()) final put ffff90a27a749000/lustre-MDT0000-osd_UUID 00000020:01000004:0.0:1789403475.528823:0:20795:0:(tgt_mount.c:187:server_put_mount()) put mount ffff90a14452d000 from lustre-MDT0000, refs=3 00000020:01000004:0.0:1789403475.528827:0:20795:0:(obd_mount.c:710:lustre_put_lsi()) put ffff90a14452d000 3 00000020:01000004:0.0:1789403475.528829:0:20795:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff90a14452d000 from lustre-MDT0000 00000020:00000080:0.0:1789403475.528848:0:20795:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1789403475.528851:0:20795:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:00000080:0.0:1789403475.528854:0:20795:0:(genops.c:885:class_export_put()) final put ffff90a14371a800/lustre-MDT0000_UUID 00000020:00000080:0.0:1789403475.528856:0:20795:0:(genops.c:844:class_export_destroy()) destroying export ffff90a14371a800/lustre-MDT0000_UUID for lustre-MDT0000 00000020:01000000:0.0:1789403475.528863:0:20795:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000 (lustre-MDT0000_UUID) 00000020:01000004:0.0:1789403475.528891:0:20795:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 3 references. 00000020:01000004:0.0:1789403475.528895:0:20795:0:(tgt_mount.c:255:server_stop_mgs()) Stop MGS service MGS 00000020:01000000:0.0:1789403475.528898:0:20795:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGS (flags='F') 00000020:00000080:0.0:1789403475.528901:0:20795:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1789403475.528904:0:20795:0:(obd_config.c:956:class_cleanup()) MGS: forcing exports to disconnect: 1/3 00000020:00080000:0.0:1789403475.528910:0:20795:0:(genops.c:1818:print_export_data()) MGS: ACTIVE ffff90a1442c4000 41b7c44b-9a12-452a-b9e6-b5b285399ec4 0@lo 18 (0 0 13) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1789403475.528916:0:20795:0:(genops.c:1552:class_disconnect_exports()) OBD device 1 (ffff90a1426499c0) has exports, disconnecting them 00000020:00080000:0.0:1789403475.528919:0:20795:0:(genops.c:1527:class_disconnect_export_list()) MGS: disconnecting export at 0@lo (ffff90a1442c4000), last request at 1789403393 00000020:00000080:0.0:1789403475.528934:0:20795:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x5fb08b1e5b761c89 00000020:00010000:0.0:1789403475.528939:0:20795:0:(genops.c:1920:obd_stale_export_put()) Put export ffff90a1442c4000: total 2 00000100:00080000:0.0:1789403475.528943:0:20795:0:(import.c:65:import_set_state_nolock()) ffff90a1442c0800 : changing import state from FULL to CLOSED 00000020:00080000:0.0:1789403475.528965:0:20795:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff90a1442c4000): rc 0 00000020:00080000:0.0:1789403475.528975:0:20795:0:(genops.c:1557:class_disconnect_exports()) OBD device 1 (ffff90a1426499c0) has no exports 00000100:00100000:0.0:1789403475.529037:0:17217:0:(service.c:3188:ptlrpc_main()) ll_mgs_0000: service thread [ffff90a242be1800:17217] 0 exiting: rc = 1 00000020:00010000:3.0:1789403475.529491:0:17978:0:(genops.c:1906:obd_stale_export_get()) Get export ffff90a1442c4000: total 2 00010000:00010000:3.0:1789403475.529535:0:17978:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff90a1442c4000, canceled 0 locks, left on hash table 13. 00010000:00010000:3.0:1789403475.529568:0:17978:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90a241514e00/0x5fb08b1e5b762239 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x5fb08b1e5b762232 expref: 14 pid: 17218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403475.529588:0:17978:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90a2821e9c00/0x5fb08b1e5b761fae lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x5fb08b1e5b761fa7 expref: 13 pid: 17217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403475.529600:0:17978:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90a281b05c00/0x5fb08b1e5b761fed lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x5fb08b1e5b761fe6 expref: 12 pid: 17217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403475.529614:0:17978:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90a241515600/0x5fb08b1e5b762247 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x5fb08b1e5b762240 expref: 11 pid: 17218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403475.529639:0:17978:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90a1425c7a00/0x5fb08b1e5b761eea lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x5fb08b1e5b761ee3 expref: 10 pid: 17217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403475.529664:0:17978:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90a241515400/0x5fb08b1e5b762255 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x5fb08b1e5b76224e expref: 9 pid: 17218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403475.529677:0:17978:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90a281b04200/0x5fb08b1e5b761db6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x5fb08b1e5b761daf expref: 8 pid: 17218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403475.529689:0:17978:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90a281b04400/0x5fb08b1e5b761f84 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x5fb08b1e5b761f7d expref: 7 pid: 17217 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403475.529699:0:17978:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90a281b05000/0x5fb08b1e5b761da8 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x5fb08b1e5b761da1 expref: 6 pid: 17218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403475.529711:0:17978:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90a2821e9e00/0x5fb08b1e5b761dc4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x5fb08b1e5b761dbd expref: 5 pid: 17218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403475.529721:0:17978:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90a259947600/0x5fb08b1e5b761c97 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x5fb08b1e5b761c90 expref: 4 pid: 17218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403475.529731:0:17978:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90a1425c6400/0x5fb08b1e5b761f14 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x5fb08b1e5b761f0d expref: 3 pid: 17218 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403475.529807:0:17978:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90a281b05800/0x5fb08b1e5b761e65 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x5fb08b1e5b761e5e expref: 2 pid: 17219 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403475.529820:0:17978:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff90a1442c4000, canceled 13 locks, left on hash table 0. 00000020:00000080:3.0:1789403475.529834:0:17978:0:(genops.c:885:class_export_put()) final put ffff90a1442c4000/41b7c44b-9a12-452a-b9e6-b5b285399ec4 00010000:00010000:3.0:1789403475.529840:0:17978:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789403475.529842:0:17978:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789403475.529844:0:17978:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789403475.529877:0:17219:0:(service.c:3188:ptlrpc_main()) ll_mgs_0002: service thread [ffff90a281a26a00:17219] 2 exiting: rc = 0 00000100:00100000:3.0:1789403475.529945:0:17218:0:(service.c:3188:ptlrpc_main()) ll_mgs_0001: service thread [ffff90a242be1c00:17218] 1 exiting: rc = 0 00000020:00000080:3.0:1789403475.529978:0:17331:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff90a1436b4000 for lustre-MDT0001-osp-MDT0000 00000020:00000080:3.0:1789403475.529984:0:17331:0:(genops.c:885:class_export_put()) final put ffff90a143719000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1789403475.529986:0:17331:0:(genops.c:844:class_export_destroy()) destroying export ffff90a143719000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001-osp-MDT0000 00000020:01000000:3.0:1789403475.529990:0:17331:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-osp-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1789403475.530032:0:17331:0:(genops.c:844:class_export_destroy()) destroying export ffff90a27a749800/lustre-MDD0000_UUID for lustre-MDD0000 00000020:00000080:3.0:1789403475.530036:0:17331:0:(genops.c:885:class_export_put()) final put ffff90a27a74b000/lustre-MDD0000_UUID 00000020:00000080:3.0:1789403475.530038:0:17331:0:(genops.c:844:class_export_destroy()) destroying export ffff90a27a74b000/lustre-MDD0000_UUID for lustre-MDD0000 00000020:01000000:3.0:1789403475.530042:0:17331:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDD0000 (lustre-MDD0000_UUID) 00000020:00000080:3.0:1789403475.530064:0:17331:0:(genops.c:844:class_export_destroy()) destroying export ffff90a27a749000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:3.0:1789403475.530068:0:17331:0:(genops.c:844:class_export_destroy()) destroying export ffff90a1442c4000/41b7c44b-9a12-452a-b9e6-b5b285399ec4 for MGS 00000020:00000080:3.0:1789403475.530092:0:17331:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff90a1442c0800 for MGS 00000100:00100000:0.0:1789403475.530485:0:20795:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403475.530496:0:20795:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403475.530502:0:20795:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403475.530508:0:20795:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403475.530514:0:20795:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403475.530520:0:20795:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403475.530525:0:20795:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403475.530531:0:20795:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403475.530537:0:20795:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403475.530543:0:20795:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403475.530550:0:20795:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403475.530556:0:20795:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403475.530563:0:20795:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403475.530569:0:20795:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403475.530575:0:20795:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403475.530581:0:20795:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403475.530586:0:20795:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403475.530592:0:20795:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403475.530597:0:20795:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403475.530602:0:20795:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403475.530607:0:20795:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403475.530611:0:20795:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403475.530617:0:20795:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403475.530633:0:20795:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403475.530639:0:20795:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403475.530644:0:20795:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403475.530650:0:20795:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403475.530656:0:20795:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403475.530661:0:20795:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403475.530668:0:20795:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403475.530673:0:20795:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403475.530679:0:20795:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403475.530684:0:20795:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403475.530700:0:20795:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403475.530705:0:20795:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403475.530711:0:20795:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403475.530717:0:20795:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403475.530722:0:20795:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403475.530728:0:20795:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403475.530733:0:20795:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403475.530749:0:20795:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403475.530756:0:20795:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403475.530761:0:20795:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403475.530766:0:20795:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403475.530772:0:20795:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403475.530777:0:20795:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403475.530782:0:20795:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403475.530787:0:20795:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403475.530792:0:20795:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403475.530798:0:20795:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403475.530803:0:20795:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403475.530809:0:20795:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403475.530815:0:20795:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403475.530820:0:20795:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403475.530826:0:20795:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403475.530832:0:20795:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403475.530838:0:20795:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403475.530843:0:20795:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403475.530849:0:20795:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403475.530854:0:20795:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403475.530860:0:20795:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403475.530865:0:20795:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403475.530871:0:20795:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403475.530876:0:20795:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:01000000:0.0:1789403475.533908:0:20795:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff90a27c207cc0 - data ffff90a258243e58/ffff90a27cac6400 00000020:01000000:0.0:1789403475.534170:0:20795:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff90a1427542a0 - data ffff90a26d846a20/ffff90a274d46400 00000020:00000080:0.0:1789403475.534656:0:20795:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x5fb08b1e5b761c6d 00000020:00000080:0.0:1789403475.534678:0:20795:0:(genops.c:885:class_export_put()) final put ffff90a2599a2000/lustre-MDT0000-osd_UUID 00000020:01000004:0.0:1789403475.534695:0:20795:0:(tgt_mount.c:187:server_put_mount()) put mount ffff90a14452d000 from MGS, refs=2 00000020:01000004:0.0:1789403475.534698:0:20795:0:(obd_mount.c:710:lustre_put_lsi()) put ffff90a14452d000 2 00000020:01000004:0.0:1789403475.534701:0:20795:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff90a14452d000 from MGS 00000020:00000080:0.0:1789403475.534730:0:20795:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1789403475.534738:0:20795:0:(obd_config.c:883:class_detach()) detach on obd MGS (uuid MGS) 00000020:00000080:0.0:1789403475.534747:0:20795:0:(genops.c:885:class_export_put()) final put ffff90a2599a5000/MGS 00000020:00000080:0.0:1789403475.534749:0:20795:0:(genops.c:844:class_export_destroy()) destroying export ffff90a2599a5000/MGS for MGS 00000020:01000000:0.0:1789403475.534755:0:20795:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGS (MGS) 00000020:01000000:0.0:1789403475.534818:0:20795:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-MDT0000 (flags='F') 00000020:00000080:0.0:1789403475.534822:0:20795:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1789403475.534827:0:20795:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-MDT0000: forcing exports to disconnect: 1/3 00000020:00080000:0.0:1789403475.534834:0:20795:0:(genops.c:1818:print_export_data()) lustre-MDT0000-lwp-MDT0000: ACTIVE ffff90a141b03800 lustre-MDT0000-lwp-MDT0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1789403475.534839:0:20795:0:(genops.c:1552:class_disconnect_exports()) OBD device 11 (ffff90a27dbd3380) has exports, disconnecting them 00000020:00080000:0.0:1789403475.534845:0:20795:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0000-lwp-MDT0000: disconnecting export at 0@lo (ffff90a141b03800), last request at 1789403393 00000020:00000080:0.0:1789403475.534849:0:20795:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x5fb08b1e5b761d70 00000020:00080000:0.0:1789403475.534859:0:20795:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff90a141b03800): rc 0 00000020:00000080:0.0:1789403475.534863:0:20795:0:(genops.c:885:class_export_put()) final put ffff90a141b03800/lustre-MDT0000-lwp-MDT0000 00000020:00000080:3.0:1789403475.535724:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff90a2599a2000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:3.0:1789403475.535743:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff90a141b03800/lustre-MDT0000-lwp-MDT0000 for lustre-MDT0000-lwp-MDT0000 00010000:01000000:0.0:1789403475.579893:0:20795:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-MDT0000: client import never connected 00000100:00080000:0.0:1789403475.579904:0:20795:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1789403475.579908:0:20795:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 5 00000100:00100000:0.0:1789403475.579917:0:20795:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1789403475.581628:0:20795:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1789403475.581642:0:20795:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000020:01000004:0.0:1789403475.581650:0:20795:0:(obd_mount.c:710:lustre_put_lsi()) put ffff90a14452d000 1 00000020:00000080:0.0:1789403475.581657:0:20795:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x5fb08b1e5b761c5f 00000020:00000080:0.0:1789403475.581666:0:20795:0:(genops.c:885:class_export_put()) final put ffff90a2599a0800/lustre-MDT0000-osd_UUID 00000020:00000080:3.0:1789403475.581868:0:37:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff90a141b02000 for lustre-MDT0000-lwp-MDT0000 00000020:00000080:3.0:1789403475.581876:0:37:0:(genops.c:885:class_export_put()) final put ffff90a141b03000/lustre-MDT0000-lwp-MDT0000_UUID 00000020:00000080:3.0:1789403475.581879:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff90a141b03000/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000-lwp-MDT0000 00000020:01000000:3.0:1789403475.581890:0:37:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-MDT0000 (lustre-MDT0000-lwp-MDT0000_UUID) 00000020:01000000:0.0:1789403475.582385:0:20795:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-osd (flags='') 00000020:00000080:0.0:1789403475.582415:0:20795:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1789403475.582421:0:20795:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-osd: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1789403475.582425:0:20795:0:(genops.c:1557:class_disconnect_exports()) OBD device 0 (ffff90a245c9b380) has no exports 00000020:00000080:3.0:1789403475.583044:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff90a2599a0800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:1.0:1789403475.679614:0:20795:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1789403475.679636:0:20795:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00000020:00000080:1.0:1789403475.679641:0:20795:0:(genops.c:885:class_export_put()) final put ffff90a14452e000/lustre-MDT0000-osd_UUID 00000020:00000080:1.0:1789403475.679646:0:20795:0:(genops.c:844:class_export_destroy()) destroying export ffff90a14452e000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:1.0:1789403475.679656:0:20795:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-osd (lustre-MDT0000-osd_UUID) 00000020:01000004:1.0:1789403475.679778:0:20795:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff90a144528800 00000020:02000400:1.0:1789403475.679837:0:20795:0:(tgt_mount.c:2180:server_put_super()) server umount lustre-MDT0000 complete 00010000:00010000:1.0:1789403476.209922:0:17213:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789403477.240304:0:17212:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789403477.751041:0:3627:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a141aafb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3627:1876325050829312:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1789403477.751111:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789403477.752044:0:18735:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050829312 00000100:00100000:1.0:1789403477.752053:0:18735:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050829312 00000100:00100000:1.0:1789403477.752118:0:18735:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1789403477.752128:0:18735:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a144bef480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3627:x1876325050829312:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1789403477.752158:0:18735:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3915849728 avail 3684327424 00000100:00080000:3.0:1789403477.752261:0:17220:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789403477.754442:0:18735:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a144bef480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3627:x1876325050829312:12345-0@lo:13:osp-pre-0-1.0 Request processed in 2308us (3323us total) trans 0 rc 0/0 00000100:00100000:1.0:1789403477.754457:0:18735:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1789403477.758037:0:3627:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a141aafb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3627:1876325050829312:0@lo:13:osp-pre-0-1.0 00010000:00010000:1.0:1789403478.257826:0:17978:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1789403478.265485:0:17976:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000001:00100000:2.0:1789403478.774367:0:19545:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1789403478.774376:0:19545:0:(genops.c:885:class_export_put()) final put ffff90a14242a000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1789403478.774613:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff90a14242a000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001 00000020:00000080:0.0:1789403478.774668:0:37:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff90a142429800 for lustre-OST0001 00000001:00100000:3.0:1789403478.774725:0:18727:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1789403478.774729:0:18727:0:(genops.c:885:class_export_put()) final put ffff90a14242a800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1789403478.774843:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff90a14242a800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000 00000020:00000080:2.0:1789403478.774865:0:36:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff90a14242d800 for lustre-OST0000 00010000:00010000:1.0:1789403479.291464:0:17213:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1789403479.305087:0:20997:0:(tgt_mount.c:2191:server_umount_begin()) umount -f 00000020:01000004:2.0:1789403479.316558:0:20997:0:(tgt_mount.c:2061:server_put_super()) server put_super lustre-MDT0001 00010000:00010000:2.0:1789403479.316628:0:20997:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.143@tcp lock: ffff90a281b05200/0x5fb08b1e5b761e5e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb08b1e5b761e65 expref: -99 pid: 17956 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403479.316643:0:20997:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.143@tcp lock: ffff90a281b05200/0x5fb08b1e5b761e5e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x5fb08b1e5b761e65 expref: -99 pid: 17956 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403479.316651:0:20997:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.143@tcp lock: ffff90a281b05200/0x5fb08b1e5b761e5e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0x5fb08b1e5b761e65 expref: -99 pid: 17956 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403479.316658:0:20997:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.143@tcp lock: ffff90a281b05200/0x5fb08b1e5b761e5e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0x5fb08b1e5b761e65 expref: -99 pid: 17956 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403479.316676:0:20997:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:2.0:1789403479.316681:0:20997:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:2.0:1789403479.316700:0:20997:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1789403479.316705:0:20997:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 3 00000100:00080000:2.0:1789403479.316710:0:20997:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID 00000100:00080000:2.0:1789403479.316717:0:20997:0:(import.c:65:import_set_state_nolock()) ffff90a26d294000 lustre-MDT0000_UUID: changing import state from DISCONN to CLOSED 00000100:00080000:2.0:1789403479.316721:0:20997:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1789403479.316723:0:20997:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 4 00000100:00100000:2.0:1789403479.316741:0:20997:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:0.0:1789403479.317449:0:17212:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789403479.317457:0:17212:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.143@tcp lock: ffff90a281b05200/0x5fb08b1e5b761e5e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0x5fb08b1e5b761e65 expref: -99 pid: 17956 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403479.317467:0:17212:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a281b05200 already unused, calling callback (ffffffffc120dc20) 10000000:00010000:0.0:1789403479.317471:0:17212:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.143@tcp lock: ffff90a281b05200/0x5fb08b1e5b761e5e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0x5fb08b1e5b761e65 expref: -99 pid: 17956 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403479.317481:0:17212:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.143@tcp lock: ffff90a281b05200/0x5fb08b1e5b761e5e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1008400000000 nid: local remote: 0x5fb08b1e5b761e65 expref: -99 pid: 17956 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789403479.317488:0:17212:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.143@tcp lock: ffff90a281b05200/0x5fb08b1e5b761e5e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1009400000000 nid: local remote: 0x5fb08b1e5b761e65 expref: -99 pid: 17956 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789403479.317494:0:17212:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1789403479.317497:0:17212:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:0.0:1789403479.317500:0:17212:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:0.0:1789403479.317540:0:17212:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.143@tcp lock: ffff90a281b05200/0x5fb08b1e5b761e5e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x5fb08b1e5b761e65 expref: -99 pid: 17956 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403479.317548:0:17212:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789403479.317584:0:17212:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.143@tcp lock: ffff90a281b05200/0x5fb08b1e5b761e5e lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x5fb08b1e5b761e65 expref: -99 pid: 17956 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403479.317615:0:17212:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.143@tcp lock: ffff90a281b05200/0x5fb08b1e5b761e5e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x5fb08b1e5b761e65 expref: -99 pid: 17956 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403479.317628:0:17212:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789403479.317630:0:17212:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789403479.317632:0:17212:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789403479.317655:0:3628:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a144beed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:41b7c44b-9a12-452a-b9e6-b5b285399ec4:3628:1876325050829440:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789403479.317719:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789403479.317784:0:17979:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050829440 00000100:00100000:3.0:1789403479.317791:0:17979:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050829440 00000100:00100000:3.0:1789403479.317856:0:17979:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1789403479.317864:0:17979:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a144b2a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0+-99:3628:x1876325050829440:12345-0@lo:103:ldlm_bl.0 00010000:00020000:3.0:1789403479.317871:0:17979:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1789403479 with bad export cookie 6895163992003976329 00010000:00010000:2.0:1789403479.321192:0:20997:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.143@tcp lock: ffff90a1425c6000/0x5fb08b1e5b761dbd lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb08b1e5b761dc4 expref: -99 pid: 17956 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403479.321211:0:20997:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.143@tcp lock: ffff90a1425c6000/0x5fb08b1e5b761dbd lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x5fb08b1e5b761dc4 expref: -99 pid: 17956 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403479.321219:0:20997:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.143@tcp lock: ffff90a1425c6000/0x5fb08b1e5b761dbd lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000400000000 nid: local remote: 0x5fb08b1e5b761dc4 expref: -99 pid: 17956 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403479.321226:0:20997:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.143@tcp lock: ffff90a1425c6000/0x5fb08b1e5b761dbd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000400000000 nid: local remote: 0x5fb08b1e5b761dc4 expref: -99 pid: 17956 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403479.321335:0:20997:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789403479.321344:0:20997:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.143@tcp lock: ffff90a259946200/0x5fb08b1e5b761fe6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb08b1e5b761fed expref: -99 pid: 17221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403479.321352:0:20997:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.143@tcp lock: ffff90a259946200/0x5fb08b1e5b761fe6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x5fb08b1e5b761fed expref: -99 pid: 17221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403479.321357:0:20997:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.143@tcp lock: ffff90a259946200/0x5fb08b1e5b761fe6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x5fb08b1e5b761fed expref: -99 pid: 17221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403479.321363:0:20997:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.143@tcp lock: ffff90a259946200/0x5fb08b1e5b761fe6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x5fb08b1e5b761fed expref: -99 pid: 17221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403479.324123:0:17978:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1789403479.324138:0:17978:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.143@tcp lock: ffff90a1425c6000/0x5fb08b1e5b761dbd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0x5fb08b1e5b761dc4 expref: -99 pid: 17956 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403479.324149:0:17978:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a1425c6000 already unused, calling callback (ffffffffc120dc20) 10000000:00010000:1.0:1789403479.324154:0:17978:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.143@tcp lock: ffff90a1425c6000/0x5fb08b1e5b761dbd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0x5fb08b1e5b761dc4 expref: -99 pid: 17956 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403479.324163:0:17978:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.143@tcp lock: ffff90a1425c6000/0x5fb08b1e5b761dbd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1008400000000 nid: local remote: 0x5fb08b1e5b761dc4 expref: -99 pid: 17956 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789403479.324171:0:17978:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.143@tcp lock: ffff90a1425c6000/0x5fb08b1e5b761dbd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1009400000000 nid: local remote: 0x5fb08b1e5b761dc4 expref: -99 pid: 17956 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789403479.324177:0:17978:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1789403479.324180:0:17978:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-MDT0001: stopping, won't requeue 00010000:00010000:1.0:1789403479.324224:0:17978:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.143@tcp lock: ffff90a1425c6000/0x5fb08b1e5b761dbd lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x5fb08b1e5b761dc4 expref: -99 pid: 17956 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403479.324231:0:17978:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789403479.324279:0:17978:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.143@tcp lock: ffff90a1425c6000/0x5fb08b1e5b761dbd lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x5fb08b1e5b761dc4 expref: -99 pid: 17956 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403479.324288:0:17978:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.143@tcp lock: ffff90a1425c6000/0x5fb08b1e5b761dbd lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x5fb08b1e5b761dc4 expref: -99 pid: 17956 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403479.324306:0:17978:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789403479.324310:0:17978:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.143@tcp lock: ffff90a259946200/0x5fb08b1e5b761fe6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x5fb08b1e5b761fed expref: -99 pid: 17221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403479.324329:0:17978:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a259946200 already unused, calling callback (ffffffffc120dc20) 10000000:00010000:1.0:1789403479.324332:0:17978:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.143@tcp lock: ffff90a259946200/0x5fb08b1e5b761fe6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x5fb08b1e5b761fed expref: -99 pid: 17221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403479.324340:0:17978:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.143@tcp lock: ffff90a259946200/0x5fb08b1e5b761fe6 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x5fb08b1e5b761fed expref: -99 pid: 17221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789403479.324347:0:17978:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.143@tcp lock: ffff90a259946200/0x5fb08b1e5b761fe6 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x5fb08b1e5b761fed expref: -99 pid: 17221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789403479.324352:0:17978:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 10000000:01000000:1.0:1789403479.324354:0:17978:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-mdtir: stopping, won't requeue 00010000:00010000:1.0:1789403479.324366:0:17978:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.143@tcp lock: ffff90a259946200/0x5fb08b1e5b761fe6 lrc: 3/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x5fb08b1e5b761fed expref: -99 pid: 17221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403479.324372:0:17978:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789403479.324405:0:17978:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.143@tcp lock: ffff90a259946200/0x5fb08b1e5b761fe6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x5fb08b1e5b761fed expref: -99 pid: 17221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403479.324413:0:17978:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789403479.324415:0:17978:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789403479.324417:0:17978:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789403479.324428:0:3627:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1789403479.324439:0:3627:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a141aaf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:41b7c44b-9a12-452a-b9e6-b5b285399ec4:3627:1876325050829696:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789403479.324439:0:3629:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a141aad180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:41b7c44b-9a12-452a-b9e6-b5b285399ec4:3629:1876325050829568:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789403479.324497:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789403479.324525:0:17211:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050829568 00000100:00100000:1.0:1789403479.324532:0:17211:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050829568 00000100:00100000:0.0:1789403479.324562:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789403479.324565:0:17211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1789403479.324573:0:17211:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a144bec380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0+-99:3629:x1876325050829568:12345-0@lo:103:ldlm_bl.0 00010000:00020000:1.0:1789403479.324579:0:17211:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1789403479 with bad export cookie 6895163992003976329 00000100:00100000:0.0:1789403479.324583:0:17209:0:(service.c:3467:ptlrpc_start_thread()) ldlm_canceld[0] started 4 min 3 max 56 00000100:00100000:0.0:1789403479.324602:0:17209:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cn00_004' 00000100:00100000:1.0:1789403479.324640:0:17211:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a144bec380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0+-99:3629:x1876325050829568:12345-0@lo:103:ldlm_bl.0 Request processed in 66us (143us total) trans 0 rc -107/-107 00000100:00100000:1.0:1789403479.324647:0:17211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1789403479.324662:0:17211:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050829696 00000100:00100000:1.0:1789403479.324665:0:17211:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050829696 00000100:00100000:1.0:1789403479.324674:0:17211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1789403479.324678:0:17211:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a144bed880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0+-99:3627:x1876325050829696:12345-0@lo:103:ldlm_bl.0 00010000:00020000:1.0:1789403479.324682:0:17211:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1789403479 with bad export cookie 6895163992003976329 00000100:00100000:1.0:1789403479.324709:0:17211:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a144bed880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0+-99:3627:x1876325050829696:12345-0@lo:103:ldlm_bl.0 Request processed in 29us (146us total) trans 0 rc -107/-107 00000100:00100000:1.0:1789403479.324714:0:17211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00080000:1.0:1789403479.324741:0:3627:0:(recover.c:205:ptlrpc_request_handle_notconn()) import MGC192.168.203.143@tcp of MGS@0@lo abruptly disconnected: reconnecting 00000100:00080000:1.0:1789403479.324746:0:3627:0:(import.c:65:import_set_state_nolock()) ffff90a2599a1000 MGS: changing import state from FULL to DISCONN 00000100:02020000:1.0:1789403479.324749:0:3627:0:(import.c:186:ptlrpc_set_import_discon()) MGC192.168.203.143@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail 00000100:00080000:0.0:1789403479.324843:0:3629:0:(recover.c:205:ptlrpc_request_handle_notconn()) import MGC192.168.203.143@tcp of MGS@0@lo abruptly disconnected: reconnecting 00010000:00010000:2.0:1789403479.326646:0:20997:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1789403479.326660:0:20997:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.143@tcp lock: ffff90a259946200/0x5fb08b1e5b761fe6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x5fb08b1e5b761fed expref: -99 pid: 17221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789403479.326683:0:20997:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-mdtir 00010000:00010000:2.0:1789403479.326791:0:20997:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.143@tcp lock: ffff90a241514c00/0x5fb08b1e5b76224e lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb08b1e5b762255 expref: -99 pid: 17221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403479.326805:0:20997:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.143@tcp lock: ffff90a241514c00/0x5fb08b1e5b76224e lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x5fb08b1e5b762255 expref: -99 pid: 17221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403479.326902:0:20997:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.143@tcp lock: ffff90a241514c00/0x5fb08b1e5b76224e lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x5fb08b1e5b762255 expref: -99 pid: 17221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403479.326911:0:20997:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.143@tcp lock: ffff90a241514c00/0x5fb08b1e5b76224e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x5fb08b1e5b762255 expref: -99 pid: 17221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403479.326928:0:20997:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789403479.326933:0:20997:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.143@tcp lock: ffff90a1425c6600/0x5fb08b1e5b761daf lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb08b1e5b761db6 expref: -99 pid: 17956 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403479.326939:0:20997:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.143@tcp lock: ffff90a1425c6600/0x5fb08b1e5b761daf lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x5fb08b1e5b761db6 expref: -99 pid: 17956 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403479.326945:0:20997:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.143@tcp lock: ffff90a1425c6600/0x5fb08b1e5b761daf lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x5fb08b1e5b761db6 expref: -99 pid: 17956 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403479.326951:0:20997:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.143@tcp lock: ffff90a1425c6600/0x5fb08b1e5b761daf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x5fb08b1e5b761db6 expref: -99 pid: 17956 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403479.326963:0:20997:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 10000000:01000000:2.0:1789403479.326966:0:20997:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-MDT0001 10000000:01000000:2.0:1789403479.326969:0:20997:0:(mgc_request.c:547:config_log_end()) end config log lustre-MDT0001 (0) 00000020:01000004:2.0:1789403479.327008:0:20997:0:(tgt_mount.c:2111:server_put_super()) stopping lustre-MDT0001 00000020:01000000:2.0:1789403479.327011:0:20997:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001 (flags='F') 00000020:00000080:2.0:1789403479.327017:0:20997:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000100:00100000:3.0:1789403479.327024:0:17979:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a144b2a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0+-99:3628:x1876325050829440:12345-0@lo:103:ldlm_bl.0 Request processed in 9155us (9299us total) trans 0 rc -107/-107 00000020:00000080:2.0:1789403479.327029:0:20997:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001: forcing exports to disconnect: 2/5 00000020:00080000:2.0:1789403479.327036:0:20997:0:(genops.c:1818:print_export_data()) lustre-MDT0001: ACTIVE ffff90a1425a8000 lustre-MDT0001-lwp-OST0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000100:00100000:3.0:1789403479.327038:0:17979:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000020:00080000:2.0:1789403479.327046:0:20997:0:(genops.c:1818:print_export_data()) lustre-MDT0001: ACTIVE ffff90a1425a8800 lustre-MDT0001-lwp-OST0000_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1789403479.327051:0:20997:0:(genops.c:1552:class_disconnect_exports()) OBD device 14 (ffff90a27e008000) has exports, disconnecting them 00000020:00080000:2.0:1789403479.327056:0:20997:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0001: disconnecting export at 0@lo (ffff90a1425a8000), last request at 1789403475 00000020:00000080:2.0:1789403479.327062:0:20997:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x5fb08b1e5b761fd8 00000100:00080000:2.0:1789403479.327080:0:20997:0:(import.c:65:import_set_state_nolock()) ffff90a1425ad000 : changing import state from FULL to CLOSED 00000100:00080000:3.0:1789403479.327084:0:3628:0:(recover.c:205:ptlrpc_request_handle_notconn()) import MGC192.168.203.143@tcp of MGS@0@lo abruptly disconnected: reconnecting 00000020:00080000:2.0:1789403479.327120:0:20997:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff90a1425a8000): rc 0 00000020:00000080:2.0:1789403479.327123:0:20997:0:(genops.c:885:class_export_put()) final put ffff90a1425a8000/lustre-MDT0001-lwp-OST0001_UUID 00000020:00080000:2.0:1789403479.327132:0:20997:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0001: disconnecting export at 0@lo (ffff90a1425a8800), last request at 1789403475 00000020:00000080:2.0:1789403479.327135:0:20997:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x5fb08b1e5b761f3e 00000100:00080000:2.0:1789403479.327141:0:20997:0:(import.c:65:import_set_state_nolock()) ffff90a1425ab800 : changing import state from FULL to CLOSED 00000020:00080000:2.0:1789403479.327146:0:20997:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff90a1425a8800): rc 0 00000020:00000080:2.0:1789403479.327148:0:20997:0:(genops.c:885:class_export_put()) final put ffff90a1425a8800/lustre-MDT0001-lwp-OST0000_UUID 00000004:00000080:2.0:1789403479.327154:0:20997:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0001: cmd=400866e7 len=0 karg=ffffbb21c1c4bae0 00000100:00080000:2.0:1789403479.327616:0:20997:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1789403479.327620:0:20997:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 0 gen 3 00000100:00080000:2.0:1789403479.329933:0:20997:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID 00000100:00080000:2.0:1789403479.329943:0:20997:0:(import.c:65:import_set_state_nolock()) ffff90a26d2d7800 lustre-MDT0000_UUID: changing import state from DISCONN to CLOSED 00000100:00080000:2.0:1789403479.330118:0:20997:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:2.0:1789403479.330123:0:20997:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 8589934593 gen 3 00000004:00080000:2.0:1789403479.330137:0:20997:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:2.0:1789403479.330197:0:20997:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID 00000100:00080000:2.0:1789403479.330221:0:20997:0:(import.c:65:import_set_state_nolock()) ffff90a26d2d3000 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 00000100:00080000:2.0:1789403479.330238:0:20997:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:2.0:1789403479.330240:0:20997:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 8589934593 gen 3 00000004:00080000:2.0:1789403479.330247:0:20997:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:2.0:1789403479.330307:0:20997:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID 00000100:00080000:2.0:1789403479.330326:0:20997:0:(import.c:65:import_set_state_nolock()) ffff90a141b05800 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00000020:00080000:2.0:1789403479.330361:0:20997:0:(genops.c:1557:class_disconnect_exports()) OBD device 14 (ffff90a27e008000) has no exports 00000100:00100000:2.0:1789403479.331445:0:3625:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a27a64f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3625:1876325050829824:0@lo:9:umount.0 00000100:00100000:2.0:1789403479.331515:0:3625:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789403479.331552:0:3625:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a27a64ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3625:1876325050829952:0@lo:9:umount.0 00000100:00100000:2.0:1789403479.331572:0:3625:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1789403479.340414:0:3627:0:(import.c:192:ptlrpc_set_import_discon()) import MGS@0@lo for MGC192.168.203.143@tcp not replayable, auto-deactivating 00000100:00080000:1.0:1789403479.340420:0:3627:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:1.0:1789403479.340430:0:3627:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff90a144beed80 x1876325050829440/t0(0) o103->MGC192.168.203.143@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1789403495 ref 1 fl Rpc:RQU/200/0 rc 0/-107 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789403479.340444:0:3627:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff90a141aad180 x1876325050829568/t0(0) o103->MGC192.168.203.143@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1789403495 ref 1 fl Rpc:RQU/200/0 rc 0/-107 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789403479.340453:0:3627:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff90a141aaf100 x1876325050829696/t0(0) o103->MGC192.168.203.143@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1789403495 ref 1 fl Rpc:RQU/200/0 rc 0/-107 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 10000000:01000000:1.0:1789403479.340462:0:3627:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:1.0:1789403479.340465:0:3627:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:1.0:1789403479.340466:0:3627:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:2.0:1789403479.341477:0:18732:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050829824 00000100:00100000:2.0:1789403479.341490:0:18732:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050829824 00000100:00100000:2.0:1789403479.341561:0:18732:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050829952 00000100:00100000:2.0:1789403479.341565:0:18732:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050829952 00000100:00100000:2.0:1789403479.341589:0:18732:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1789403479.341608:0:18732:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a27a64c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3625:x1876325050829824:12345-0@lo:9:umount.0 00000020:00000080:2.0:1789403479.341637:0:18732:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x5fb08b1e5b761f68 00000100:00080000:2.0:1789403479.341646:0:18732:0:(import.c:65:import_set_state_nolock()) ffff90a27a748000 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1789403479.341681:0:18732:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 8589934600 00000100:00100000:2.0:1789403479.341942:0:18732:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a27a64c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+2:3625:x1876325050829824:12345-0@lo:9:umount.0 Request processed in 335us (10426us total) trans 0 rc 0/0 00000100:00100000:2.0:1789403479.341949:0:18732:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1789403479.341966:0:18732:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1789403479.341972:0:18732:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a27a64d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3625:x1876325050829952:12345-0@lo:9:umount.0 00000020:00000080:2.0:1789403479.341984:0:18732:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x5fb08b1e5b762010 00000100:00080000:2.0:1789403479.341990:0:18732:0:(import.c:65:import_set_state_nolock()) ffff90a14242e800 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1789403479.342005:0:18732:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 8589934594 00000100:00100000:2.0:1789403479.342080:0:18732:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a27a64d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+2:3625:x1876325050829952:12345-0@lo:9:umount.0 Request processed in 107us (10505us total) trans 0 rc 0/0 00000100:00100000:2.0:1789403479.342086:0:18732:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00080000:2.0:1789403479.342128:0:3625:0:(import.c:65:import_set_state_nolock()) ffff90a26d2d3000 lustre-OST0000_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:2.0:1789403479.342147:0:3625:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:2.0:1789403479.342149:0:3625:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1789403479.342153:0:3625:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a27a64f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3625:1876325050829824:0@lo:9:umount.0 00000100:00080000:2.0:1789403479.342167:0:3625:0:(import.c:65:import_set_state_nolock()) ffff90a141b05800 lustre-OST0001_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:2.0:1789403479.342177:0:3625:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:2.0:1789403479.342179:0:3625:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1789403479.342181:0:3625:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a27a64ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3625:1876325050829952:0@lo:9:umount.0 00000100:00080000:0.0:1789403479.343068:0:3629:0:(import.c:214:ptlrpc_set_import_discon()) mgc: import ffff90a2599a1000 already not connected (conn 1, was 1): DISCONN 00000100:00100000:0.0:1789403479.343085:0:3629:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a141aad180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:41b7c44b-9a12-452a-b9e6-b5b285399ec4:3629:1876325050829568:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789403479.343108:0:17212:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1789403479.343117:0:17212:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.143@tcp lock: ffff90a241514c00/0x5fb08b1e5b76224e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x5fb08b1e5b762255 expref: -99 pid: 17221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403479.343126:0:17212:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a241514c00 already unused, calling callback (ffffffffc120dc20) 10000000:00010000:0.0:1789403479.343130:0:17212:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.143@tcp lock: ffff90a241514c00/0x5fb08b1e5b76224e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x5fb08b1e5b762255 expref: -99 pid: 17221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403479.343139:0:17212:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.143@tcp lock: ffff90a241514c00/0x5fb08b1e5b76224e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x5fb08b1e5b762255 expref: -99 pid: 17221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789403479.343145:0:17212:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.143@tcp lock: ffff90a241514c00/0x5fb08b1e5b76224e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x5fb08b1e5b762255 expref: -99 pid: 17221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789403479.343167:0:17212:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:0.0:1789403479.343170:0:17212:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:0.0:1789403479.343173:0:17212:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:0.0:1789403479.343186:0:17212:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff90a2599a1000 00010000:00010000:0.0:1789403479.343191:0:17212:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.143@tcp lock: ffff90a241514c00/0x5fb08b1e5b76224e lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x5fb08b1e5b762255 expref: -99 pid: 17221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403479.343198:0:17212:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.143@tcp lock: ffff90a241514c00/0x5fb08b1e5b76224e lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x5fb08b1e5b762255 expref: -99 pid: 17221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403479.343213:0:17212:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789403479.343217:0:17212:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.143@tcp lock: ffff90a1425c6600/0x5fb08b1e5b761daf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x5fb08b1e5b761db6 expref: -99 pid: 17956 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403479.343223:0:17212:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a1425c6600 already unused, calling callback (ffffffffc120dc20) 10000000:00010000:0.0:1789403479.343226:0:17212:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.143@tcp lock: ffff90a1425c6600/0x5fb08b1e5b761daf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x5fb08b1e5b761db6 expref: -99 pid: 17956 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403479.343232:0:17212:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.143@tcp lock: ffff90a1425c6600/0x5fb08b1e5b761daf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x5fb08b1e5b761db6 expref: -99 pid: 17956 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789403479.343238:0:17212:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.143@tcp lock: ffff90a1425c6600/0x5fb08b1e5b761daf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x5fb08b1e5b761db6 expref: -99 pid: 17956 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789403479.343243:0:17212:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 10000000:01000000:0.0:1789403479.343245:0:17212:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-barrier: stopping, won't requeue 10000000:01000000:0.0:1789403479.343247:0:17212:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-barrier 00010000:00010000:0.0:1789403479.343251:0:17212:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff90a2599a1000 00010000:00010000:0.0:1789403479.343254:0:17212:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.143@tcp lock: ffff90a1425c6600/0x5fb08b1e5b761daf lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0x5fb08b1e5b761db6 expref: -99 pid: 17956 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403479.343266:0:17212:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.143@tcp lock: ffff90a1425c6600/0x5fb08b1e5b761daf lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0x5fb08b1e5b761db6 expref: -99 pid: 17956 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403479.343278:0:17212:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789403479.343280:0:17212:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789403479.343282:0:17212:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1789403479.343294:0:17331:0:(genops.c:844:class_export_destroy()) destroying export ffff90a1425a8000/lustre-MDT0001-lwp-OST0001_UUID for lustre-MDT0001 00000100:00080000:2.0:1789403479.343476:0:17220:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789403479.343481:0:17220:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000020:00000080:0.0:1789403479.343584:0:17331:0:(genops.c:844:class_export_destroy()) destroying export ffff90a1425a8800/lustre-MDT0001-lwp-OST0000_UUID for lustre-MDT0001 00000020:00000080:0.0:1789403479.343622:0:17331:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff90a1425ad000 for lustre-MDT0001 00000020:00000080:0.0:1789403479.343626:0:17331:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff90a1425ab800 for lustre-MDT0001 00010000:00010000:0.0:1789403479.343662:0:17213:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789403479.343666:0:17978:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1789403479.347433:0:3628:0:(import.c:214:ptlrpc_set_import_discon()) mgc: import ffff90a2599a1000 already not connected (conn 1, was 1): DISCONN 00000100:00100000:3.0:1789403479.347472:0:3628:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a144beed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:41b7c44b-9a12-452a-b9e6-b5b285399ec4:3628:1876325050829440:0@lo:103:ldlm_bl.0 00000100:00080000:1.0:1789403479.348912:0:3627:0:(import.c:65:import_set_state_nolock()) ffff90a2599a1000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1789403479.348923:0:3627:0:(import.c:545:import_select_connection()) MGC192.168.203.143@tcp: connect to NID 0@lo last attempt 439 00000100:00080000:1.0:1789403479.348940:0:3627:0:(import.c:666:import_select_connection()) MGC192.168.203.143@tcp: import ffff90a2599a1000 using connection 192.168.203.143@tcp/0@lo 00000100:00100000:1.0:1789403479.348996:0:3627:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff90a141aad180 x1876325050830080/t0(0) o250->MGC192.168.203.143@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1789403479.349059:0:3625:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a141aad180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:41b7c44b-9a12-452a-b9e6-b5b285399ec4:3625:1876325050830080:0@lo:250:ptlrpcd_00_01.0 00000400:00000100:2.0:1789403479.349105:0:3625:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1876325050830080 offset 0 length 520: 4 00000100:00100000:1.0:1789403479.349170:0:3627:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a141aaf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:41b7c44b-9a12-452a-b9e6-b5b285399ec4:3627:1876325050829696:0@lo:103:ldlm_bl.0 00000020:00080000:3.0:1789403479.357146:0:20997:0:(genops.c:1557:class_disconnect_exports()) OBD device 14 (ffff90a27e008000) has no exports 00000020:01000000:2.0:1789403479.409277:0:20997:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff90a2512a3600 - data ffff90a26d9b61b0/ffff90a1430ed400 00000020:01000000:2.0:1789403479.409648:0:20997:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff90a245dbbba0 - data ffff90a26d992bd0/ffff90a27c8ce400 00000001:00000004:2.0:1789403479.421257:0:20997:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 2, last_transno is 8589934595 00000100:00080000:2.0:1789403479.469052:0:20997:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1789403479.469061:0:20997:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 0 gen 4 00000100:00100000:2.0:1789403479.469069:0:20997:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00080000:2.0:1789403479.471343:0:20997:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:2.0:1789403479.471352:0:20997:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 8589934593 gen 4 00000004:00080000:2.0:1789403479.472428:0:20997:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1789403479.472433:0:20997:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:0.0:1789403479.478722:0:17965:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:0.0:1789403479.478729:0:17965:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 1 count 1 00000040:00080000:0.0:1789403479.478747:0:17965:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x2:0x0] index 2 count 2 00000100:00080000:2.0:1789403479.479282:0:20997:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:2.0:1789403479.479287:0:20997:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 8589934593 gen 4 00000004:00080000:2.0:1789403479.479306:0:20997:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1789403479.479309:0:20997:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:1.0:1789403479.479772:0:17967:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:1.0:1789403479.479775:0:17967:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xa:0x0] index 1 count 1 00000040:00080000:1.0:1789403479.479785:0:17967:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x5:0x0] index 2 count 2 00000020:00000080:2.0:1789403479.480717:0:20997:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x5fb08b1e5b761dd2 00000020:00000080:2.0:1789403479.480728:0:20997:0:(genops.c:885:class_export_put()) final put ffff90a26d290000/lustre-MDT0001-osd_UUID 00000020:00000080:2.0:1789403479.481427:0:20997:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x5fb08b1e5b761de7 00000020:00000080:2.0:1789403479.481434:0:20997:0:(genops.c:885:class_export_put()) final put ffff90a1427a2800/lustre-MDT0001-mdtlov_UUID 00000020:00000080:0.0:1789403479.482158:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff90a26d290000/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:01000000:2.0:1789403479.482267:0:20997:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-mdtlov (flags='') 00000020:00000080:2.0:1789403479.482275:0:20997:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1789403479.482283:0:20997:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-mdtlov: forcing exports to disconnect: 0/2 00000020:00080000:2.0:1789403479.482288:0:20997:0:(genops.c:1557:class_disconnect_exports()) OBD device 13 (ffff90a1425d3380) has no exports 00000004:01000000:2.0:1789403479.484652:0:20997:0:(lod_lov.c:59:lod_putref()) destroying 2 ltd desc 00000020:00000080:2.0:1789403479.484668:0:20997:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x5fb08b1e5b761e3b 00000020:00000080:2.0:1789403479.484676:0:20997:0:(genops.c:885:class_export_put()) final put ffff90a14368d000/lustre-MDT0001-mdtlov_UUID 00000020:00000080:1.0:1789403479.485200:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff90a1427a2800/lustre-MDT0001-mdtlov_UUID for lustre-MDT0001-mdtlov 00000020:01000000:2.0:1789403479.485281:0:20997:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osc-MDT0001 (flags='') 00000020:00000080:2.0:1789403479.485297:0:20997:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1789403479.485308:0:20997:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osc-MDT0001: forcing exports to disconnect: 0/3 00000020:00080000:2.0:1789403479.485312:0:20997:0:(genops.c:1557:class_disconnect_exports()) OBD device 18 (ffff90a27dbd19c0) has no exports 00000020:00000080:2.0:1789403479.485319:0:20997:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x5fb08b1e5b761e34 00000020:00000080:2.0:1789403479.485324:0:20997:0:(genops.c:885:class_export_put()) final put ffff90a1442c5800/lustre-MDT0001-osd_UUID 00010000:01000000:2.0:1789403479.491037:0:20997:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0001-osc-MDT0001: client import never connected 00000100:00080000:2.0:1789403479.491045:0:20997:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:2.0:1789403479.491049:0:20997:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 8589934593 gen 5 00000004:00080000:2.0:1789403479.491056:0:20997:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1789403479.491058:0:20997:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1789403479.491098:0:20997:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1789403479.491108:0:20997:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:2.0:1789403479.491116:0:20997:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x5fb08b1e5b761e26 00000020:00000080:2.0:1789403479.491126:0:20997:0:(genops.c:885:class_export_put()) final put ffff90a27dbda800/lustre-MDT0001-mdtlov_UUID 00000020:01000000:2.0:1789403479.491131:0:20997:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osc-MDT0001 (flags='') 00000020:00000080:2.0:1789403479.491139:0:20997:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1789403479.491144:0:20997:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osc-MDT0001: forcing exports to disconnect: 0/3 00000020:00080000:2.0:1789403479.491147:0:20997:0:(genops.c:1557:class_disconnect_exports()) OBD device 17 (ffff90a281873380) has no exports 00000020:00000080:2.0:1789403479.491152:0:20997:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x5fb08b1e5b761e18 00000020:00000080:2.0:1789403479.491155:0:20997:0:(genops.c:885:class_export_put()) final put ffff90a27dbd9000/lustre-MDT0001-osd_UUID 00010000:01000000:2.0:1789403479.491485:0:20997:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0000-osc-MDT0001: client import never connected 00000100:00080000:2.0:1789403479.491488:0:20997:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:2.0:1789403479.491491:0:20997:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 8589934593 gen 5 00000004:00080000:2.0:1789403479.491494:0:20997:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1789403479.491506:0:20997:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1789403479.491528:0:20997:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1789403479.491533:0:20997:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000004:01000000:2.0:1789403479.491545:0:20997:0:(lod_lov.c:59:lod_putref()) destroying 1 ltd desc 00000020:00000080:2.0:1789403479.491551:0:20997:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x5fb08b1e5b761e0a 00000020:00000080:2.0:1789403479.491555:0:20997:0:(genops.c:885:class_export_put()) final put ffff90a27dbdd800/lustre-MDT0001-mdtlov_UUID 00000020:01000000:2.0:1789403479.491559:0:20997:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-osp-MDT0001 (flags='F') 00000020:00000080:2.0:1789403479.491563:0:20997:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1789403479.491567:0:20997:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-osp-MDT0001: forcing exports to disconnect: 0/3 00000020:00080000:2.0:1789403479.491569:0:20997:0:(genops.c:1557:class_disconnect_exports()) OBD device 16 (ffff90a27dbd0000) has no exports 00000020:00000080:2.0:1789403479.491573:0:20997:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x5fb08b1e5b761e03 00000020:00000080:2.0:1789403479.491576:0:20997:0:(genops.c:885:class_export_put()) final put ffff90a26d2d7000/lustre-MDT0001-osd_UUID 00000020:00000080:1.0:1789403479.492775:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff90a14368d000/lustre-MDT0001-mdtlov_UUID for lustre-OST0001-osc-MDT0001 00000020:00000080:1.0:1789403479.492790:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff90a1442c5800/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:1.0:1789403479.492796:0:37:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff90a141b05800 for lustre-OST0001-osc-MDT0001 00000020:00000080:1.0:1789403479.494158:0:37:0:(genops.c:885:class_export_put()) final put ffff90a27dbda000/lustre-MDT0001-mdtlov_UUID 00000020:00000080:1.0:1789403479.494163:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff90a27dbda000/lustre-MDT0001-mdtlov_UUID for lustre-OST0001-osc-MDT0001 00000020:01000000:1.0:1789403479.494170:0:37:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osc-MDT0001 (lustre-MDT0001-mdtlov_UUID) 00000020:00000080:1.0:1789403479.494266:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff90a27dbda800/lustre-MDT0001-mdtlov_UUID for lustre-OST0000-osc-MDT0001 00000020:00000080:1.0:1789403479.494272:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff90a27dbd9000/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:1.0:1789403479.494277:0:37:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff90a26d2d3000 for lustre-OST0000-osc-MDT0001 00000020:00000080:1.0:1789403479.494280:0:37:0:(genops.c:885:class_export_put()) final put ffff90a27dbde000/lustre-MDT0001-mdtlov_UUID 00000020:00000080:1.0:1789403479.494282:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff90a27dbde000/lustre-MDT0001-mdtlov_UUID for lustre-OST0000-osc-MDT0001 00000020:01000000:1.0:1789403479.494285:0:37:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osc-MDT0001 (lustre-MDT0001-mdtlov_UUID) 00000020:00000080:1.0:1789403479.494324:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff90a27dbdd800/lustre-MDT0001-mdtlov_UUID for lustre-MDT0000-osp-MDT0001 00000020:00000080:1.0:1789403479.494329:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff90a26d2d7000/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00010000:01000000:0.0:1789403479.495587:0:20997:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-osp-MDT0001: client import never connected 00000100:00080000:0.0:1789403479.495604:0:20997:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1789403479.495608:0:20997:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 0 gen 5 00000100:00100000:0.0:1789403479.495615:0:20997:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1789403479.495663:0:20997:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1789403479.495674:0:20997:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-osp-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:1.0:1789403479.495680:0:17331:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff90a26d2d7800 for lustre-MDT0000-osp-MDT0001 00000020:00000080:1.0:1789403479.495689:0:17331:0:(genops.c:885:class_export_put()) final put ffff90a26d2d4800/lustre-MDT0001-mdtlov_UUID 00000020:00000080:1.0:1789403479.495691:0:17331:0:(genops.c:844:class_export_destroy()) destroying export ffff90a26d2d4800/lustre-MDT0001-mdtlov_UUID for lustre-MDT0000-osp-MDT0001 00000020:01000000:1.0:1789403479.495696:0:17331:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-osp-MDT0001 (lustre-MDT0001-mdtlov_UUID) 00000020:00000080:0.0:1789403479.495713:0:20997:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1789403479.495717:0:20997:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-mdtlov (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:0.0:1789403479.495721:0:20997:0:(genops.c:885:class_export_put()) final put ffff90a27c36c800/lustre-MDT0001-mdtlov_UUID 00000020:00000080:0.0:1789403479.495722:0:20997:0:(genops.c:844:class_export_destroy()) destroying export ffff90a27c36c800/lustre-MDT0001-mdtlov_UUID for lustre-MDT0001-mdtlov 00000020:01000000:0.0:1789403479.495728:0:20997:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-mdtlov (lustre-MDT0001-mdtlov_UUID) 00000020:00000080:0.0:1789403479.496464:0:20997:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x5fb08b1e5b761dee 00000020:00000080:0.0:1789403479.496481:0:20997:0:(genops.c:885:class_export_put()) final put ffff90a1427a5800/lustre-MDD0001_UUID 00000020:01000000:0.0:1789403479.496504:0:20997:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDD0001 (flags='') 00000020:00000080:0.0:1789403479.496508:0:20997:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1789403479.496514:0:20997:0:(obd_config.c:956:class_cleanup()) lustre-MDD0001: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1789403479.496517:0:20997:0:(genops.c:1557:class_disconnect_exports()) OBD device 15 (ffff90a27e0099c0) has no exports 00000020:00000080:0.0:1789403479.496538:0:20997:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1789403479.496541:0:20997:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDD0001 (uuid lustre-MDD0001_UUID) 00000020:00000080:0.0:1789403479.496545:0:20997:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x5fb08b1e5b761df5 00000020:00000080:0.0:1789403479.496548:0:20997:0:(genops.c:885:class_export_put()) final put ffff90a1427a7000/lustre-MDT0001-osd_UUID 00000020:01000004:0.0:1789403479.496555:0:20997:0:(tgt_mount.c:187:server_put_mount()) put mount ffff90a281b17800 from lustre-MDT0001, refs=2 00000020:01000004:0.0:1789403479.496557:0:20997:0:(obd_mount.c:710:lustre_put_lsi()) put ffff90a281b17800 2 00000020:01000004:0.0:1789403479.496561:0:20997:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff90a281b17800 from lustre-MDT0001 00000020:00000080:0.0:1789403479.496580:0:20997:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1789403479.496583:0:20997:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001 (uuid lustre-MDT0001_UUID) 00000020:00000080:0.0:1789403479.496585:0:20997:0:(genops.c:885:class_export_put()) final put ffff90a26d296800/lustre-MDT0001_UUID 00000020:00000080:0.0:1789403479.496587:0:20997:0:(genops.c:844:class_export_destroy()) destroying export ffff90a26d296800/lustre-MDT0001_UUID for lustre-MDT0001 00000020:01000000:0.0:1789403479.496602:0:20997:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001 (lustre-MDT0001_UUID) 00000020:00000080:1.0:1789403479.496617:0:17331:0:(genops.c:844:class_export_destroy()) destroying export ffff90a1427a5800/lustre-MDD0001_UUID for lustre-MDD0001 00000020:00000080:1.0:1789403479.496626:0:17331:0:(genops.c:885:class_export_put()) final put ffff90a256651800/lustre-MDD0001_UUID 00000020:00000080:1.0:1789403479.496628:0:17331:0:(genops.c:844:class_export_destroy()) destroying export ffff90a256651800/lustre-MDD0001_UUID for lustre-MDD0001 00000020:01000000:1.0:1789403479.496631:0:17331:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDD0001 (lustre-MDD0001_UUID) 00000020:01000004:0.0:1789403479.496634:0:20997:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 2 references. 00000020:01000000:0.0:1789403479.496637:0:20997:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-MDT0001 (flags='F') 00000020:00000080:0.0:1789403479.496640:0:20997:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1789403479.496643:0:20997:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-MDT0001: forcing exports to disconnect: 1/3 00000020:00080000:0.0:1789403479.496650:0:20997:0:(genops.c:1818:print_export_data()) lustre-MDT0000-lwp-MDT0001: ACTIVE ffff90a281a0c800 lustre-MDT0000-lwp-MDT0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1789403479.496655:0:20997:0:(genops.c:1552:class_disconnect_exports()) OBD device 19 (ffff90a281870000) has exports, disconnecting them 00000020:00080000:0.0:1789403479.496659:0:20997:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0000-lwp-MDT0001: disconnecting export at 0@lo (ffff90a281a0c800), last request at 1789403406 00000020:00000080:0.0:1789403479.496662:0:20997:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x5fb08b1e5b761e73 00000020:00080000:0.0:1789403479.496672:0:20997:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff90a281a0c800): rc 0 00000020:00000080:0.0:1789403479.496675:0:20997:0:(genops.c:885:class_export_put()) final put ffff90a281a0c800/lustre-MDT0000-lwp-MDT0001 00000020:00000080:1.0:1789403479.496722:0:17331:0:(genops.c:844:class_export_destroy()) destroying export ffff90a1427a7000/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:1.0:1789403479.496727:0:17331:0:(genops.c:844:class_export_destroy()) destroying export ffff90a281a0c800/lustre-MDT0000-lwp-MDT0001 for lustre-MDT0000-lwp-MDT0001 00010000:01000000:1.0:1789403479.499480:0:20997:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-MDT0001: client import never connected 00000100:00080000:1.0:1789403479.499488:0:20997:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1789403479.499492:0:20997:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 5 00000100:00100000:1.0:1789403479.499499:0:20997:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1789403479.499521:0:37:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff90a26d294000 for lustre-MDT0000-lwp-MDT0001 00000020:00000080:1.0:1789403479.499710:0:20997:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1789403479.499719:0:20997:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-MDT0001 (uuid lustre-MDT0000-lwp-MDT0001_UUID) 00000020:00000080:1.0:1789403479.499724:0:20997:0:(genops.c:885:class_export_put()) final put ffff90a2488f9000/lustre-MDT0000-lwp-MDT0001_UUID 00000020:00000080:1.0:1789403479.499727:0:20997:0:(genops.c:844:class_export_destroy()) destroying export ffff90a2488f9000/lustre-MDT0000-lwp-MDT0001_UUID for lustre-MDT0000-lwp-MDT0001 00000020:01000000:1.0:1789403479.499737:0:20997:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-MDT0001 (lustre-MDT0000-lwp-MDT0001_UUID) 00000020:01000004:1.0:1789403479.499824:0:20997:0:(obd_mount.c:710:lustre_put_lsi()) put ffff90a281b17800 1 00000020:00000080:1.0:1789403479.499830:0:20997:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x5fb08b1e5b761d9a 00000020:00000080:1.0:1789403479.499836:0:20997:0:(genops.c:885:class_export_put()) final put ffff90a26d348000/lustre-MDT0001-osd_UUID 00000020:01000000:1.0:1789403479.499845:0:20997:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-osd (flags='') 00000020:00000080:1.0:1789403479.499852:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff90a26d348000/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:1.0:1789403479.499861:0:20997:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1789403479.499865:0:20997:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-osd: forcing exports to disconnect: 0/1 00000020:00080000:1.0:1789403479.499869:0:20997:0:(genops.c:1557:class_disconnect_exports()) OBD device 12 (ffff90a27dbd4d40) has no exports 00000020:00000080:0.0:1789403479.810869:0:20997:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1789403479.810884:0:20997:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-osd (uuid lustre-MDT0001-osd_UUID) 00000020:00000080:0.0:1789403479.810890:0:20997:0:(genops.c:885:class_export_put()) final put ffff90a281b15000/lustre-MDT0001-osd_UUID 00000020:00000080:0.0:1789403479.810894:0:20997:0:(genops.c:844:class_export_destroy()) destroying export ffff90a281b15000/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:01000000:0.0:1789403479.810917:0:20997:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-osd (lustre-MDT0001-osd_UUID) 00000020:01000004:0.0:1789403479.811623:0:20997:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff90a281b17000 00000020:01000000:0.0:1789403479.811648:0:20997:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MDS (flags='F') 00000020:00000080:0.0:1789403479.811653:0:20997:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1789403479.811658:0:20997:0:(obd_config.c:956:class_cleanup()) MDS: forcing exports to disconnect: 0/1 00000020:00080000:0.0:1789403479.811663:0:20997:0:(genops.c:1557:class_disconnect_exports()) OBD device 3 (ffff90a245c98000) has no exports 00000100:00100000:2.0:1789403479.818642:0:17224:0:(service.c:3188:ptlrpc_main()) mdt00_000: service thread [ffff90a14337c600:17224] 0 exiting: rc = 1 00000100:00100000:2.0:1789403479.820920:0:20797:0:(service.c:3188:ptlrpc_main()) mdt00_004: service thread [ffff90a27cfb1600:20797] 4 exiting: rc = 0 00000100:00100000:0.0:1789403479.824094:0:19353:0:(service.c:3188:ptlrpc_main()) mdt00_003: service thread [ffff90a1421aca00:19353] 3 exiting: rc = 0 00000100:00100000:1.0:1789403479.826115:0:17225:0:(service.c:3188:ptlrpc_main()) mdt00_001: service thread [ffff90a274c96400:17225] 1 exiting: rc = 0 00000100:00100000:3.0:1789403479.826453:0:17226:0:(service.c:3188:ptlrpc_main()) mdt00_002: service thread [ffff90a274c97200:17226] 2 exiting: rc = 0 00000100:00100000:0.0:1789403479.826576:0:20997:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403479.826585:0:20997:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403479.826602:0:20997:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403479.826608:0:20997:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403479.826612:0:20997:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403479.826617:0:20997:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403479.826623:0:20997:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403479.826629:0:20997:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403479.826634:0:20997:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403479.826639:0:20997:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403479.826644:0:20997:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403479.826649:0:20997:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403479.826654:0:20997:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403479.826659:0:20997:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403479.826664:0:20997:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403479.826669:0:20997:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403479.826674:0:20997:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403479.826680:0:20997:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403479.826686:0:20997:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403479.826691:0:20997:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403479.826695:0:20997:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403479.826700:0:20997:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403479.826705:0:20997:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403479.826710:0:20997:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403479.826725:0:20997:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403479.826731:0:20997:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403479.826736:0:20997:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403479.826758:0:20997:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403479.826764:0:20997:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403479.826770:0:20997:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403479.826774:0:20997:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403479.826779:0:20997:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403479.826784:0:20997:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403479.826789:0:20997:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403479.826795:0:20997:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403479.826800:0:20997:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403479.826805:0:20997:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403479.826810:0:20997:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403479.826815:0:20997:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403479.826821:0:20997:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403479.826826:0:20997:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403479.826831:0:20997:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403479.826837:0:20997:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403479.826842:0:20997:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403479.826847:0:20997:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403479.826852:0:20997:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403479.826857:0:20997:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403479.826862:0:20997:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403479.826867:0:20997:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403479.826873:0:20997:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403479.826880:0:20997:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403479.826885:0:20997:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403479.826890:0:20997:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403479.826895:0:20997:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403479.826900:0:20997:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403479.826907:0:20997:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403479.826912:0:20997:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403479.826923:0:20997:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403479.826938:0:20997:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403479.827173:0:20997:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403479.827179:0:20997:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403479.827186:0:20997:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403479.827198:0:20997:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403479.827204:0:20997:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403479.833479:0:17228:0:(service.c:3188:ptlrpc_main()) mdt_rdpg00_001: service thread [ffff90a142767000:17228] 1 exiting: rc = 0 00000100:00100000:2.0:1789403479.836154:0:17227:0:(service.c:3188:ptlrpc_main()) mdt_rdpg00_000: service thread [ffff90a142766200:17227] 0 exiting: rc = 1 00000100:00100000:0.0:1789403479.839694:0:20997:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403479.839705:0:20997:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403479.839723:0:20997:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403479.839729:0:20997:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403479.839734:0:20997:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403479.839739:0:20997:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403479.839744:0:20997:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403479.839749:0:20997:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403479.839753:0:20997:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403479.839758:0:20997:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403479.839764:0:20997:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403479.839770:0:20997:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403479.839774:0:20997:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403479.839778:0:20997:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403479.839783:0:20997:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403479.839789:0:20997:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403479.839794:0:20997:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403479.839799:0:20997:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403479.839804:0:20997:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403479.839810:0:20997:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403479.839814:0:20997:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403479.839819:0:20997:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403479.839825:0:20997:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403479.839830:0:20997:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403479.839835:0:20997:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403479.839840:0:20997:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403479.839844:0:20997:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403479.839849:0:20997:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403479.839853:0:20997:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403479.839858:0:20997:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403479.839862:0:20997:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403479.839866:0:20997:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403479.839891:0:20997:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403479.839895:0:20997:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403479.839900:0:20997:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403479.839905:0:20997:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403479.839910:0:20997:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403479.839914:0:20997:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403479.839919:0:20997:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403479.839925:0:20997:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403479.840046:0:20997:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403479.840055:0:20997:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403479.840060:0:20997:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403479.840066:0:20997:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403479.840071:0:20997:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403479.840076:0:20997:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403479.840081:0:20997:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403479.840086:0:20997:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403479.840091:0:20997:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403479.840096:0:20997:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403479.840100:0:20997:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403479.840106:0:20997:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403479.840111:0:20997:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403479.840116:0:20997:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403479.840121:0:20997:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403479.840126:0:20997:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403479.840132:0:20997:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403479.840138:0:20997:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403479.840144:0:20997:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403479.840149:0:20997:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403479.840155:0:20997:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403479.840159:0:20997:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403479.840164:0:20997:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403479.840170:0:20997:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789403479.849011:0:19382:0:(service.c:3188:ptlrpc_main()) mdt_out00_002: service thread [ffff90a143303600:19382] 2 exiting: rc = 0 00000100:00100000:3.0:1789403479.849232:0:17229:0:(service.c:3188:ptlrpc_main()) mdt_out00_000: service thread [ffff90a261595a00:17229] 0 exiting: rc = 1 00000100:00100000:2.0:1789403479.849551:0:17230:0:(service.c:3188:ptlrpc_main()) mdt_out00_001: service thread [ffff90a261594c00:17230] 1 exiting: rc = 0 00000100:00100000:0.0:1789403479.849730:0:20997:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403479.849739:0:20997:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403479.849745:0:20997:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403479.849764:0:20997:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403479.849778:0:20997:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403479.849784:0:20997:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403479.849790:0:20997:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403479.849796:0:20997:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403479.849802:0:20997:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403479.849808:0:20997:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403479.849813:0:20997:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403479.849819:0:20997:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403479.849825:0:20997:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403479.849830:0:20997:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403479.849836:0:20997:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403479.849842:0:20997:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403479.849860:0:20997:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403479.849866:0:20997:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403479.849872:0:20997:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403479.849877:0:20997:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403479.849883:0:20997:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403479.849888:0:20997:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403479.849896:0:20997:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403479.849903:0:20997:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403479.849909:0:20997:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403479.849915:0:20997:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403479.849921:0:20997:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403479.849927:0:20997:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403479.849955:0:20997:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403479.849963:0:20997:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403479.849969:0:20997:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403479.849976:0:20997:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403479.849981:0:20997:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403479.849986:0:20997:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403479.849993:0:20997:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403479.849999:0:20997:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403479.850004:0:20997:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403479.850010:0:20997:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403479.850024:0:20997:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403479.850030:0:20997:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403479.850049:0:20997:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403479.850056:0:20997:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403479.850061:0:20997:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403479.850067:0:20997:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403479.850073:0:20997:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403479.850079:0:20997:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403479.850084:0:20997:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403479.850090:0:20997:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403479.850096:0:20997:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403479.850102:0:20997:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403479.850107:0:20997:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403479.850113:0:20997:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403479.850130:0:20997:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403479.850136:0:20997:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403479.850141:0:20997:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403479.850148:0:20997:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403479.850154:0:20997:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403479.850159:0:20997:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403479.850165:0:20997:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403479.850171:0:20997:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403479.850176:0:20997:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403479.850182:0:20997:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403479.850188:0:20997:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403479.850194:0:20997:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403479.882260:0:17231:0:(service.c:3188:ptlrpc_main()) mdt_seqs_0000: service thread [ffff90a142767800:17231] 0 exiting: rc = 1 00000100:00100000:0.0:1789403479.882817:0:17232:0:(service.c:3188:ptlrpc_main()) mdt_seqs_0001: service thread [ffff90a26076dc00:17232] 1 exiting: rc = 0 00000100:00100000:2.0:1789403479.883004:0:20997:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789403479.883013:0:20997:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789403479.883018:0:20997:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789403479.883024:0:20997:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789403479.883029:0:20997:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789403479.883034:0:20997:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789403479.883039:0:20997:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789403479.883043:0:20997:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789403479.883048:0:20997:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789403479.883053:0:20997:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789403479.883059:0:20997:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789403479.883064:0:20997:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789403479.883069:0:20997:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789403479.883074:0:20997:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789403479.883078:0:20997:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789403479.883083:0:20997:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789403479.883088:0:20997:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789403479.883093:0:20997:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789403479.883114:0:20997:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789403479.883118:0:20997:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789403479.883123:0:20997:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789403479.883129:0:20997:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789403479.883134:0:20997:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789403479.883139:0:20997:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789403479.883143:0:20997:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789403479.883148:0:20997:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789403479.883152:0:20997:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789403479.883157:0:20997:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789403479.883161:0:20997:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789403479.883166:0:20997:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789403479.883170:0:20997:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789403479.883174:0:20997:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789403479.883178:0:20997:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789403479.883184:0:20997:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789403479.883189:0:20997:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789403479.883193:0:20997:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789403479.883197:0:20997:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789403479.883201:0:20997:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789403479.883206:0:20997:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789403479.883211:0:20997:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789403479.883216:0:20997:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789403479.883221:0:20997:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789403479.883226:0:20997:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789403479.883231:0:20997:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789403479.883236:0:20997:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789403479.883241:0:20997:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789403479.883246:0:20997:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789403479.883250:0:20997:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789403479.883255:0:20997:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789403479.883260:0:20997:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789403479.883265:0:20997:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789403479.883269:0:20997:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789403479.883274:0:20997:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789403479.883285:0:20997:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789403479.883290:0:20997:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789403479.883366:0:20997:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789403479.883374:0:20997:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789403479.883379:0:20997:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789403479.883384:0:20997:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789403479.883637:0:20997:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789403479.883643:0:20997:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789403479.883649:0:20997:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789403479.883653:0:20997:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789403479.883658:0:20997:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403479.884232:0:17234:0:(service.c:3188:ptlrpc_main()) mdt_seqm_0001: service thread [ffff90a1424ab200:17234] 1 exiting: rc = 0 00000100:00100000:3.0:1789403479.885555:0:17233:0:(service.c:3188:ptlrpc_main()) mdt_seqm_0000: service thread [ffff90a1424ab400:17233] 0 exiting: rc = 1 00000100:00100000:2.0:1789403479.885679:0:20997:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789403479.885686:0:20997:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789403479.885691:0:20997:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789403479.885696:0:20997:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789403479.885701:0:20997:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789403479.885707:0:20997:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789403479.885712:0:20997:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789403479.885791:0:20997:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789403479.885798:0:20997:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789403479.885804:0:20997:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789403479.885808:0:20997:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789403479.885814:0:20997:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789403479.885819:0:20997:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789403479.885824:0:20997:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789403479.885829:0:20997:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789403479.885834:0:20997:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789403479.885840:0:20997:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789403479.885845:0:20997:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789403479.885851:0:20997:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789403479.885855:0:20997:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789403479.885860:0:20997:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789403479.885865:0:20997:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789403479.885870:0:20997:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789403479.885875:0:20997:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789403479.885897:0:20997:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789403479.885902:0:20997:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789403479.885907:0:20997:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789403479.885911:0:20997:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789403479.885916:0:20997:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789403479.885921:0:20997:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789403479.885926:0:20997:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789403479.886002:0:20997:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789403479.886009:0:20997:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789403479.886014:0:20997:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789403479.886019:0:20997:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789403479.886024:0:20997:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789403479.886029:0:20997:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789403479.886034:0:20997:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789403479.886039:0:20997:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789403479.886045:0:20997:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789403479.886050:0:20997:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789403479.886055:0:20997:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789403479.886060:0:20997:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789403479.886065:0:20997:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789403479.886070:0:20997:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789403479.886075:0:20997:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789403479.886080:0:20997:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789403479.886086:0:20997:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789403479.886091:0:20997:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789403479.886096:0:20997:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789403479.886101:0:20997:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789403479.886106:0:20997:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789403479.886111:0:20997:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789403479.886116:0:20997:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789403479.886121:0:20997:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789403479.886126:0:20997:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789403479.886131:0:20997:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789403479.886136:0:20997:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789403479.886140:0:20997:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789403479.886153:0:20997:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789403479.886158:0:20997:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789403479.886163:0:20997:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789403479.886168:0:20997:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789403479.886174:0:20997:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789403479.886950:0:17236:0:(service.c:3188:ptlrpc_main()) mdt_fld_0001: service thread [ffff90a1424aba00:17236] 1 exiting: rc = 0 00000100:00100000:3.0:1789403479.887189:0:17235:0:(service.c:3188:ptlrpc_main()) mdt_fld_0000: service thread [ffff90a1424aaa00:17235] 0 exiting: rc = 1 00000100:00100000:2.0:1789403479.887293:0:20997:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789403479.887367:0:20997:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789403479.887372:0:20997:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789403479.887377:0:20997:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789403479.887382:0:20997:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789403479.887623:0:20997:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789403479.887631:0:20997:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789403479.887637:0:20997:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789403479.887641:0:20997:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789403479.887646:0:20997:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789403479.887651:0:20997:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789403479.887656:0:20997:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789403479.887662:0:20997:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789403479.887666:0:20997:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789403479.887671:0:20997:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789403479.887676:0:20997:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789403479.887681:0:20997:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789403479.887686:0:20997:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789403479.887691:0:20997:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789403479.887696:0:20997:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789403479.887701:0:20997:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789403479.887707:0:20997:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789403479.887712:0:20997:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789403479.887863:0:20997:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789403479.887869:0:20997:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789403479.887874:0:20997:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789403479.887878:0:20997:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789403479.887883:0:20997:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789403479.887887:0:20997:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789403479.887891:0:20997:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789403479.887907:0:20997:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789403479.887911:0:20997:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789403479.887916:0:20997:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789403479.887922:0:20997:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789403479.887926:0:20997:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789403479.887940:0:20997:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789403479.887946:0:20997:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789403479.887951:0:20997:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789403479.887956:0:20997:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789403479.887960:0:20997:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789403479.887965:0:20997:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789403479.887970:0:20997:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789403479.887976:0:20997:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789403479.887981:0:20997:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789403479.887985:0:20997:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789403479.887989:0:20997:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789403479.887994:0:20997:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789403479.887999:0:20997:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789403479.888004:0:20997:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789403479.888008:0:20997:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789403479.888013:0:20997:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789403479.888018:0:20997:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789403479.888024:0:20997:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789403479.888029:0:20997:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789403479.888034:0:20997:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789403479.888038:0:20997:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789403479.888042:0:20997:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789403479.888047:0:20997:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789403479.888051:0:20997:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789403479.888056:0:20997:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789403479.888061:0:20997:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789403479.888065:0:20997:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789403479.888070:0:20997:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789403479.888074:0:20997:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789403479.889372:0:17238:0:(service.c:3188:ptlrpc_main()) mdt_io00_001: service thread [ffff90a248252a00:17238] 1 exiting: rc = 0 00000100:00100000:3.0:1789403479.889799:0:17237:0:(service.c:3188:ptlrpc_main()) mdt_io00_000: service thread [ffff90a248253a00:17237] 0 exiting: rc = 1 00000100:00100000:0.0:1789403479.890248:0:17239:0:(service.c:3188:ptlrpc_main()) mdt_io00_002: service thread [ffff90a248253600:17239] 2 exiting: rc = 0 00000100:00100000:2.0:1789403479.890574:0:20997:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789403479.890602:0:20997:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789403479.890608:0:20997:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789403479.890616:0:20997:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789403479.890622:0:20997:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789403479.890627:0:20997:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789403479.890631:0:20997:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789403479.890639:0:20997:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789403479.890644:0:20997:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789403479.890649:0:20997:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789403479.890655:0:20997:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789403479.890679:0:20997:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789403479.890686:0:20997:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789403479.890691:0:20997:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789403479.890696:0:20997:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789403479.890701:0:20997:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789403479.890705:0:20997:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789403479.890710:0:20997:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789403479.890727:0:20997:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789403479.890734:0:20997:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789403479.890739:0:20997:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789403479.890744:0:20997:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789403479.890749:0:20997:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789403479.890754:0:20997:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789403479.890760:0:20997:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789403479.890765:0:20997:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789403479.890771:0:20997:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789403479.890776:0:20997:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789403479.890781:0:20997:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789403479.890787:0:20997:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789403479.890792:0:20997:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789403479.890797:0:20997:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789403479.890802:0:20997:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789403479.890808:0:20997:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789403479.890814:0:20997:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789403479.890835:0:20997:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789403479.890848:0:20997:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789403479.890853:0:20997:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789403479.890859:0:20997:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789403479.890865:0:20997:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789403479.890870:0:20997:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789403479.890875:0:20997:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789403479.890881:0:20997:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789403479.890887:0:20997:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789403479.890892:0:20997:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789403479.890897:0:20997:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789403479.890903:0:20997:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789403479.890907:0:20997:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789403479.890912:0:20997:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789403479.890918:0:20997:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789403479.890923:0:20997:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789403479.890939:0:20997:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789403479.890946:0:20997:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789403479.890951:0:20997:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789403479.890957:0:20997:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789403479.890962:0:20997:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789403479.890968:0:20997:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789403479.890974:0:20997:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789403479.890980:0:20997:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789403479.890985:0:20997:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789403479.890991:0:20997:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789403479.890997:0:20997:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789403479.891003:0:20997:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789403479.891008:0:20997:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:2.0:1789403479.911237:0:20997:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1789403479.911250:0:20997:0:(obd_config.c:883:class_detach()) detach on obd MDS (uuid MDS_uuid) 00000020:00000080:2.0:1789403479.911255:0:20997:0:(genops.c:885:class_export_put()) final put ffff90a144529000/MDS_uuid 00000020:00000080:2.0:1789403479.911259:0:20997:0:(genops.c:844:class_export_destroy()) destroying export ffff90a144529000/MDS_uuid for MDS 00000020:01000000:2.0:1789403479.911267:0:20997:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MDS (MDS_uuid) 00000020:02000400:2.0:1789403479.911845:0:20997:0:(tgt_mount.c:2180:server_put_super()) server umount lustre-MDT0001 complete 00010000:00010000:0.0:1789403480.305814:0:17212:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1789403480.312470:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 41b7c44b-9a12-452a-b9e6-b5b285399ec4->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1789403480.312480:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) 41b7c44b-9a12-452a-b9e6-b5b285399ec4->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1789403480.312490:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1789403480.312494:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1789403480.312497:0:37:0:(import.c:65:import_set_state_nolock()) ffff90a143333800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1789403480.312506:0:37:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 521 00000100:00080000:0.0:1789403480.312512:0:37:0:(import.c:630:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1789403480.312524:0:37:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff90a143333800 using connection 192.168.203.143@tcp/0@lo 00000100:00100000:0.0:1789403480.312558:0:37:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff90a144bed180 x1876325050830208/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1789403480.312614:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1789403480.312617:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1789403480.312619:0:37:0:(import.c:65:import_set_state_nolock()) ffff90a1434d4000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1789403480.312622:0:37:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 521 00000100:00080000:0.0:1789403480.312625:0:37:0:(import.c:630:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1789403480.312629:0:37:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff90a1434d4000 using connection 192.168.203.143@tcp/0@lo 00000100:00100000:0.0:1789403480.312640:0:37:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff90a144bedc00 x1876325050830464/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1789403480.312675:0:3626:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789403480.312689:0:3626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a144befb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3626:1876325050830336:0@lo:400:kworker.0 00000400:00000100:0.0:1789403480.312736:0:3626:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1876325050830336 offset 0 length 224: 4 00000100:00100000:0.0:1789403480.312772:0:3628:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a144bef800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3628:1876325050830592:0@lo:400:kworker.0 00000400:00000100:0.0:1789403480.312789:0:3628:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1876325050830592 offset 0 length 224: 4 00000100:00100000:3.0:1789403480.314173:0:3625:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a144bed180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3625:1876325050830208:0@lo:38:kworker.0 00000400:00000100:3.0:1789403480.314210:0:3625:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1876325050830208 offset 0 length 520: 4 00000100:00100000:3.0:1789403480.314228:0:3625:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a144bedc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3625:1876325050830464:0@lo:38:kworker.0 00000400:00000100:3.0:1789403480.314239:0:3625:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1876325050830464 offset 0 length 520: 4 00010000:00010000:0.0:1789403481.331665:0:17213:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789403482.356122:0:17978:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789403483.378527:0:17212:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:1.0:1789403483.999228:0:21199:0:(tgt_mount.c:2191:server_umount_begin()) umount -f 00000020:01000004:0.0:1789403484.019909:0:21199:0:(tgt_mount.c:2061:server_put_super()) server put_super lustre-OST0000 00010000:00010000:0.0:1789403484.019975:0:21199:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.143@tcp lock: ffff90a2821e8000/0x5fb08b1e5b761f0d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb08b1e5b761f14 expref: -99 pid: 18726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403484.019990:0:21199:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.143@tcp lock: ffff90a2821e8000/0x5fb08b1e5b761f0d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x5fb08b1e5b761f14 expref: -99 pid: 18726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403484.019997:0:21199:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.143@tcp lock: ffff90a2821e8000/0x5fb08b1e5b761f0d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0x5fb08b1e5b761f14 expref: -99 pid: 18726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403484.020005:0:21199:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.143@tcp lock: ffff90a2821e8000/0x5fb08b1e5b761f0d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0x5fb08b1e5b761f14 expref: -99 pid: 18726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403484.020117:0:21199:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:0.0:1789403484.020124:0:21199:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:0.0:1789403484.020147:0:21199:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1789403484.020158:0:21199:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff90a144bed180 x1876325050830208/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 1789403495 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789403484.020179:0:21199:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 3 00000100:00080000:0.0:1789403484.020186:0:21199:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00080000:0.0:1789403484.020192:0:21199:0:(import.c:65:import_set_state_nolock()) ffff90a143333800 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00080000:0.0:1789403484.020197:0:21199:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1789403484.020201:0:21199:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff90a144bed180 x1876325050830208/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 1789403495 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789403484.020208:0:21199:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 4 00000100:00100000:0.0:1789403484.020211:0:21199:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 14s for inflight to error out 00000100:00100000:3.0:1789403484.020289:0:3625:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a144bed180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3625:1876325050830208:0@lo:38:kworker.0 00000100:00080000:0.0:1789403484.021516:0:21199:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:0.0:1789403484.021528:0:21199:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff90a144befb80 x1876325050830336/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789403496 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789403484.021666:0:21199:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 3 00000100:00080000:0.0:1789403484.021683:0:21199:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-lwp-OST0000_UUID->lustre-MDT0001_UUID 00000100:00080000:0.0:1789403484.021707:0:21199:0:(import.c:65:import_set_state_nolock()) ffff90a14368b000 lustre-MDT0001_UUID: changing import state from FULL to CONNECTING 00000100:00100000:3.0:1789403484.021764:0:3625:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a144beea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3625:1876325050830720:0@lo:39:umount.0 00000400:00000100:3.0:1789403484.021810:0:3625:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1876325050830720 offset 0 length 224: 4 00010000:00010000:1.0:1789403484.021937:0:17213:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789403484.021946:0:17213:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.143@tcp lock: ffff90a2821e8000/0x5fb08b1e5b761f0d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0x5fb08b1e5b761f14 expref: -99 pid: 18726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403484.021955:0:17213:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a2821e8000 already unused, calling callback (ffffffffc120dc20) 10000000:00010000:1.0:1789403484.021959:0:17213:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.143@tcp lock: ffff90a2821e8000/0x5fb08b1e5b761f0d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0x5fb08b1e5b761f14 expref: -99 pid: 18726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403484.021969:0:17213:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.143@tcp lock: ffff90a2821e8000/0x5fb08b1e5b761f0d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1008400000000 nid: local remote: 0x5fb08b1e5b761f14 expref: -99 pid: 18726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789403484.021977:0:17213:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.143@tcp lock: ffff90a2821e8000/0x5fb08b1e5b761f0d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1009400000000 nid: local remote: 0x5fb08b1e5b761f14 expref: -99 pid: 18726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789403484.021983:0:17213:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1789403484.021986:0:17213:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:1.0:1789403484.021989:0:17213:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:1.0:1789403484.022003:0:17213:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff90a2599a1000 00010000:00010000:1.0:1789403484.022007:0:17213:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.143@tcp lock: ffff90a2821e8000/0x5fb08b1e5b761f0d lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000000 nid: local remote: 0x5fb08b1e5b761f14 expref: -99 pid: 18726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403484.022014:0:17213:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.143@tcp lock: ffff90a2821e8000/0x5fb08b1e5b761f0d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000000 nid: local remote: 0x5fb08b1e5b761f14 expref: -99 pid: 18726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403484.022025:0:17213:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789403484.022027:0:17213:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789403484.022029:0:17213:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789403484.022152:0:3626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a144befb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3626:1876325050830336:0@lo:400:kworker.0 00000100:00080000:3.0:1789403484.337607:0:17331:0:(pinger.c:229:ptlrpc_pinger_process_import()) 41b7c44b-9a12-452a-b9e6-b5b285399ec4->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1789403484.337618:0:17331:0:(pinger.c:247:ptlrpc_pinger_process_import()) 41b7c44b-9a12-452a-b9e6-b5b285399ec4->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1789403484.337638:0:17331:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1789403484.337641:0:17331:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1789403484.337799:0:3629:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a144b28380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3629:1876325050830848:0@lo:400:kworker.0 00000400:00000100:0.0:1789403484.337854:0:3629:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1876325050830848 offset 0 length 224: 4 00010000:00010000:1.0:1789403484.405815:0:17978:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1789403484.918538:0:18727:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000020:00000080:0.0:1789403484.918547:0:18727:0:(genops.c:885:class_export_put()) final put ffff90a27a748800/lustre-MDT0001-mdtlov_UUID 00000020:00000080:3.0:1789403484.918620:0:17331:0:(genops.c:844:class_export_destroy()) destroying export ffff90a27a748800/lustre-MDT0001-mdtlov_UUID for lustre-OST0000 00000020:00000080:3.0:1789403484.918664:0:17331:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff90a27a748000 for lustre-OST0000 00000001:00100000:2.0:1789403484.919677:0:19545:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000020:00000080:2.0:1789403484.919682:0:19545:0:(genops.c:885:class_export_put()) final put ffff90a14242d000/lustre-MDT0001-mdtlov_UUID 00000020:00000080:1.0:1789403484.919765:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff90a14242d000/lustre-MDT0001-mdtlov_UUID for lustre-OST0001 00000020:00000080:1.0:1789403484.919819:0:37:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff90a14242e800 for lustre-OST0001 00000100:00080000:3.0:1789403485.361511:0:17331:0:(pinger.c:229:ptlrpc_pinger_process_import()) 41b7c44b-9a12-452a-b9e6-b5b285399ec4->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1789403485.361521:0:17331:0:(pinger.c:247:ptlrpc_pinger_process_import()) 41b7c44b-9a12-452a-b9e6-b5b285399ec4->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1789403485.361524:0:17331:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1789403485.361527:0:17331:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1789403485.361685:0:3626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a144b2ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3626:1876325050830976:0@lo:400:kworker.0 00000400:00000100:2.0:1789403485.361742:0:3626:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1876325050830976 offset 0 length 224: 4 00010000:00010000:0.0:1789403485.426203:0:17212:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789403486.450513:0:17213:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789403487.474567:0:17978:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789403488.498962:0:17212:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789403489.137512:0:3625:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789403479/real 1789403479] req@ffff90a141aad180 x1876325050830080/t0(0) o250->MGC192.168.203.143@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1789403489 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'ptlrpcd_00_01.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789403489.137703:0:3625:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff90a141aad180 x1876325050830080/t0(0) o250->MGC192.168.203.143@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1789403489 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'ptlrpcd_00_01.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1789403489.137724:0:3625:0:(import.c:65:import_set_state_nolock()) ffff90a2599a1000 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1789403489.137759:0:3625:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of MGS on 0@lo failed (-110) 00000100:00100000:3.0:1789403489.137769:0:3625:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a141aad180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:41b7c44b-9a12-452a-b9e6-b5b285399ec4:3625:1876325050830080:0@lo:250:ptlrpcd_00_01.0 00000100:00080000:1.0:1789403489.137862:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 41b7c44b-9a12-452a-b9e6-b5b285399ec4->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1789403489.137867:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:1.0:1789403489.137869:0:37:0:(import.c:65:import_set_state_nolock()) ffff90a2599a1000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1789403489.137874:0:37:0:(import.c:545:import_select_connection()) MGC192.168.203.143@tcp: connect to NID 0@lo last attempt 525 00000100:00080000:1.0:1789403489.137878:0:37:0:(import.c:630:import_select_connection()) MGC192.168.203.143@tcp: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1789403489.137888:0:37:0:(import.c:666:import_select_connection()) MGC192.168.203.143@tcp: import ffff90a2599a1000 using connection 192.168.203.143@tcp/0@lo 00000100:00100000:1.0:1789403489.137932:0:37:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff90a141aaf100 x1876325050831104/t0(0) o250->MGC192.168.203.143@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1789403489.137954:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1789403489.137958:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1789403489.138087:0:3626:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789403489.138101:0:3626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a141aafb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3626:1876325050831232:0@lo:400:kworker.0 00000400:00000100:0.0:1789403489.138144:0:3626:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1876325050831232 offset 0 length 224: 4 00000100:00100000:3.0:1789403489.138771:0:3625:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a141aaf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:41b7c44b-9a12-452a-b9e6-b5b285399ec4:3625:1876325050831104:0@lo:250:kworker.0 00000400:00000100:3.0:1789403489.138802:0:3625:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1876325050831104 offset 0 length 520: 4 00010000:00010000:1.0:1789403489.523607:0:17213:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789403490.548130:0:17978:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789403491.569571:0:17212:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789403492.594020:0:17213:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789403493.618168:0:17978:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789403494.259801:0:3625:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789403484/real 1789403484] req@ffff90a144beea00 x1876325050830720/t0(0) o39->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 1 dl 1789403494 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789403494.259831:0:3625:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff90a144beea00 x1876325050830720/t0(0) o39->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 1 dl 1789403494 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1789403494.259850:0:3625:0:(import.c:65:import_set_state_nolock()) ffff90a14368b000 lustre-MDT0001_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:2.0:1789403494.259872:0:3625:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a144beea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3625:1876325050830720:0@lo:39:umount.0 00000100:00080000:0.0:1789403494.260176:0:21199:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:0.0:1789403494.260182:0:21199:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 4 00000100:00100000:0.0:1789403494.260187:0:21199:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:0.0:1789403494.261279:0:21199:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.143@tcp lock: ffff90a259947000/0x5fb08b1e5b761ee3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb08b1e5b761eea expref: -99 pid: 18726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403494.261294:0:21199:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.143@tcp lock: ffff90a259947000/0x5fb08b1e5b761ee3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x5fb08b1e5b761eea expref: -99 pid: 18726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403494.261301:0:21199:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.143@tcp lock: ffff90a259947000/0x5fb08b1e5b761ee3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x5fb08b1e5b761eea expref: -99 pid: 18726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403494.261308:0:21199:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.143@tcp lock: ffff90a259947000/0x5fb08b1e5b761ee3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x5fb08b1e5b761eea expref: -99 pid: 18726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403494.261425:0:21199:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789403494.261447:0:21199:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.143@tcp lock: ffff90a241515000/0x5fb08b1e5b762240 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb08b1e5b762247 expref: -99 pid: 17221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403494.261453:0:21199:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.143@tcp lock: ffff90a241515000/0x5fb08b1e5b762240 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x5fb08b1e5b762247 expref: -99 pid: 17221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403494.261459:0:21199:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.143@tcp lock: ffff90a241515000/0x5fb08b1e5b762240 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x5fb08b1e5b762247 expref: -99 pid: 17221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403494.261464:0:21199:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.143@tcp lock: ffff90a241515000/0x5fb08b1e5b762240 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x5fb08b1e5b762247 expref: -99 pid: 17221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403494.265979:0:21199:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 10000000:01000000:0.0:1789403494.265994:0:21199:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0000 (0) 00000020:01000004:0.0:1789403494.266029:0:21199:0:(tgt_mount.c:2111:server_put_super()) stopping lustre-OST0000 00000020:01000000:0.0:1789403494.266033:0:21199:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000 (flags='F') 00000020:00000080:0.0:1789403494.266043:0:21199:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1789403494.266049:0:21199:0:(obd_config.c:956:class_cleanup()) lustre-OST0000: forcing exports to disconnect: 0/1 00000020:00080000:0.0:1789403494.266054:0:21199:0:(genops.c:1557:class_disconnect_exports()) OBD device 22 (ffff90a2818099c0) has no exports 00000020:00080000:0.0:1789403494.266095:0:21199:0:(genops.c:1557:class_disconnect_exports()) OBD device 22 (ffff90a2818099c0) has no exports 00010000:00010000:1.0:1789403494.266910:0:17213:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1789403494.266920:0:17213:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.143@tcp lock: ffff90a259947000/0x5fb08b1e5b761ee3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x5fb08b1e5b761eea expref: -99 pid: 18726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403494.266931:0:17213:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a259947000 already unused, calling callback (ffffffffc120dc20) 10000000:00010000:1.0:1789403494.266935:0:17213:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.143@tcp lock: ffff90a259947000/0x5fb08b1e5b761ee3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x5fb08b1e5b761eea expref: -99 pid: 18726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403494.266945:0:17213:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.143@tcp lock: ffff90a259947000/0x5fb08b1e5b761ee3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0x5fb08b1e5b761eea expref: -99 pid: 18726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789403494.266953:0:17213:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.143@tcp lock: ffff90a259947000/0x5fb08b1e5b761ee3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0x5fb08b1e5b761eea expref: -99 pid: 18726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789403494.266977:0:17213:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1789403494.266980:0:17213:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0000: stopping, won't requeue 10000000:01000000:1.0:1789403494.266982:0:17213:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0000 00010000:00010000:1.0:1789403494.266998:0:17213:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff90a2599a1000 00010000:00010000:1.0:1789403494.267002:0:17213:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.143@tcp lock: ffff90a259947000/0x5fb08b1e5b761ee3 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000000 nid: local remote: 0x5fb08b1e5b761eea expref: -99 pid: 18726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403494.267008:0:17213:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.143@tcp lock: ffff90a259947000/0x5fb08b1e5b761ee3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000000 nid: local remote: 0x5fb08b1e5b761eea expref: -99 pid: 18726 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403494.267022:0:17213:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789403494.267026:0:17213:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.143@tcp lock: ffff90a241515000/0x5fb08b1e5b762240 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x5fb08b1e5b762247 expref: -99 pid: 17221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403494.267033:0:17213:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a241515000 already unused, calling callback (ffffffffc120dc20) 10000000:00010000:1.0:1789403494.267035:0:17213:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.143@tcp lock: ffff90a241515000/0x5fb08b1e5b762240 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x5fb08b1e5b762247 expref: -99 pid: 17221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403494.267043:0:17213:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.143@tcp lock: ffff90a241515000/0x5fb08b1e5b762240 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x5fb08b1e5b762247 expref: -99 pid: 17221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789403494.267050:0:17213:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.143@tcp lock: ffff90a241515000/0x5fb08b1e5b762240 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x5fb08b1e5b762247 expref: -99 pid: 17221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789403494.267055:0:17213:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:1.0:1789403494.267057:0:17213:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:1.0:1789403494.267059:0:17213:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:1.0:1789403494.267062:0:17213:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff90a2599a1000 00010000:00010000:1.0:1789403494.267065:0:17213:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.143@tcp lock: ffff90a241515000/0x5fb08b1e5b762240 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x5fb08b1e5b762247 expref: -99 pid: 17221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403494.267089:0:17213:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.143@tcp lock: ffff90a241515000/0x5fb08b1e5b762240 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x5fb08b1e5b762247 expref: -99 pid: 17221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403494.267099:0:17213:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789403494.267101:0:17213:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789403494.267103:0:17213:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789403494.267883:0:17212:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:0.0:1789403494.268632:0:21199:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff90a27c207c60 - data ffff90a2583b91b0/ffff90a27cac7800 00000020:01000000:0.0:1789403494.268849:0:21199:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff90a27c1f92a0 - data ffff90a2582f3360/ffff90a1423cc800 00100000:10000000:0.0:1789403494.277515:0:21199:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0000-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:1.0:1789403494.284592:0:21199:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x5fb08b1e5b761ef8 00000020:00000080:1.0:1789403494.284604:0:21199:0:(genops.c:885:class_export_put()) final put ffff90a144161000/lustre-OST0000-osd_UUID 00000020:01000004:1.0:1789403494.284616:0:21199:0:(tgt_mount.c:187:server_put_mount()) put mount ffff90a2702b7000 from lustre-OST0000, refs=2 00000020:01000004:1.0:1789403494.284619:0:21199:0:(obd_mount.c:710:lustre_put_lsi()) put ffff90a2702b7000 2 00000020:01000004:1.0:1789403494.284622:0:21199:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff90a2702b7000 from lustre-OST0000 00000020:00000080:1.0:1789403494.284647:0:21199:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1789403494.284656:0:21199:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:00000080:1.0:1789403494.284659:0:21199:0:(genops.c:885:class_export_put()) final put ffff90a281a0b800/lustre-OST0000_UUID 00000020:00000080:1.0:1789403494.284661:0:21199:0:(genops.c:844:class_export_destroy()) destroying export ffff90a281a0b800/lustre-OST0000_UUID for lustre-OST0000 00000020:01000000:1.0:1789403494.284668:0:21199:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000 (lustre-OST0000_UUID) 00000020:01000004:1.0:1789403494.284715:0:21199:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 1 references. 00000020:01000000:1.0:1789403494.284719:0:21199:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0000 (flags='F') 00000020:00000080:1.0:1789403494.284723:0:21199:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1789403494.284728:0:21199:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-OST0000: forcing exports to disconnect: 1/3 00000020:00080000:1.0:1789403494.284734:0:21199:0:(genops.c:1818:print_export_data()) lustre-MDT0000-lwp-OST0000: ACTIVE ffff90a143334800 lustre-MDT0000-lwp-OST0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1789403494.284911:0:21199:0:(genops.c:1552:class_disconnect_exports()) OBD device 23 (ffff90a281874d40) has exports, disconnecting them 00000020:00080000:1.0:1789403494.284918:0:21199:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0000: disconnecting export at 0@lo (ffff90a143334800), last request at 1789403421 00000020:00000080:1.0:1789403494.284922:0:21199:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x5fb08b1e5b761f22 00000020:00080000:1.0:1789403494.284933:0:21199:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff90a143334800): rc 0 00000020:00000080:1.0:1789403494.284938:0:21199:0:(genops.c:885:class_export_put()) final put ffff90a143334800/lustre-MDT0000-lwp-OST0000 00000020:00000080:2.0:1789403494.286305:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff90a144161000/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:2.0:1789403494.286327:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff90a143334800/lustre-MDT0000-lwp-OST0000 for lustre-MDT0000-lwp-OST0000 00010000:01000000:3.0:1789403494.297514:0:21199:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0000: client import never connected 00000100:00080000:3.0:1789403494.297523:0:21199:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1789403494.297528:0:21199:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 5 00000100:00100000:3.0:1789403494.297536:0:21199:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1789403494.297698:0:21199:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1789403494.297706:0:21199:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000020:01000000:3.0:1789403494.297727:0:21199:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-lwp-OST0000 (flags='F') 00000020:00000080:3.0:1789403494.297732:0:21199:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1789403494.297736:0:21199:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-lwp-OST0000: forcing exports to disconnect: 1/3 00000020:00080000:3.0:1789403494.297742:0:21199:0:(genops.c:1818:print_export_data()) lustre-MDT0001-lwp-OST0000: ACTIVE ffff90a143334000 lustre-MDT0001-lwp-OST0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1789403494.297750:0:21199:0:(genops.c:1552:class_disconnect_exports()) OBD device 24 (ffff90a27e00b380) has exports, disconnecting them 00000020:00080000:3.0:1789403494.297754:0:21199:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0001-lwp-OST0000: disconnecting export at 0@lo (ffff90a143334000), last request at 1789403421 00000020:00000080:3.0:1789403494.297758:0:21199:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x5fb08b1e5b761f37 00000020:00080000:3.0:1789403494.297772:0:21199:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff90a143334000): rc 0 00000020:00000080:3.0:1789403494.297777:0:21199:0:(genops.c:885:class_export_put()) final put ffff90a143334000/lustre-MDT0001-lwp-OST0000 00000020:00000080:2.0:1789403494.297851:0:37:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff90a143333800 for lustre-MDT0000-lwp-OST0000 00000020:00000080:2.0:1789403494.297861:0:37:0:(genops.c:885:class_export_put()) final put ffff90a143333000/lustre-MDT0000-lwp-OST0000_UUID 00000020:00000080:2.0:1789403494.297864:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff90a143333000/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000-lwp-OST0000 00000020:01000000:2.0:1789403494.297872:0:37:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0000 (lustre-MDT0000-lwp-OST0000_UUID) 00000020:00000080:2.0:1789403494.297940:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff90a143334000/lustre-MDT0001-lwp-OST0000 for lustre-MDT0001-lwp-OST0000 00010000:01000000:2.0:1789403494.298861:0:21199:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0001-lwp-OST0000: client import never connected 00000100:00080000:2.0:1789403494.298868:0:21199:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:2.0:1789403494.298871:0:21199:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 5 00000100:00100000:2.0:1789403494.298878:0:21199:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1789403494.298901:0:37:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff90a14368b000 for lustre-MDT0001-lwp-OST0000 00000020:00000080:2.0:1789403494.299057:0:21199:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1789403494.299078:0:21199:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-lwp-OST0000 (uuid lustre-MDT0001-lwp-OST0000_UUID) 00000020:00000080:2.0:1789403494.299082:0:21199:0:(genops.c:885:class_export_put()) final put ffff90a2488f9800/lustre-MDT0001-lwp-OST0000_UUID 00000020:00000080:2.0:1789403494.299085:0:21199:0:(genops.c:844:class_export_destroy()) destroying export ffff90a2488f9800/lustre-MDT0001-lwp-OST0000_UUID for lustre-MDT0001-lwp-OST0000 00000020:01000000:2.0:1789403494.299093:0:21199:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-lwp-OST0000 (lustre-MDT0001-lwp-OST0000_UUID) 00000020:01000004:2.0:1789403494.299134:0:21199:0:(obd_mount.c:710:lustre_put_lsi()) put ffff90a2702b7000 1 00000020:00000080:2.0:1789403494.299138:0:21199:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x5fb08b1e5b761ed5 00000020:00000080:2.0:1789403494.299143:0:21199:0:(genops.c:885:class_export_put()) final put ffff90a2488fe800/lustre-OST0000-osd_UUID 00000020:01000000:2.0:1789403494.299151:0:21199:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osd (flags='') 00000020:00000080:2.0:1789403494.299159:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff90a2488fe800/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:2.0:1789403494.299166:0:21199:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1789403494.299170:0:21199:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osd: forcing exports to disconnect: 0/1 00000020:00080000:2.0:1789403494.299173:0:21199:0:(genops.c:1557:class_disconnect_exports()) OBD device 20 (ffff90a2818719c0) has no exports 00000020:00000080:2.0:1789403494.411751:0:21199:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1789403494.411765:0:21199:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00000020:00000080:2.0:1789403494.411771:0:21199:0:(genops.c:885:class_export_put()) final put ffff90a2702b0800/lustre-OST0000-osd_UUID 00000020:00000080:2.0:1789403494.411776:0:21199:0:(genops.c:844:class_export_destroy()) destroying export ffff90a2702b0800/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:01000000:2.0:1789403494.411788:0:21199:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osd (lustre-OST0000-osd_UUID) 00000020:01000004:2.0:1789403494.411907:0:21199:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff90a2702b2800 00000020:02000400:2.0:1789403494.411962:0:21199:0:(tgt_mount.c:2180:server_put_super()) server umount lustre-OST0000 complete 00010000:00010000:3.0:1789403494.641986:0:17978:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1789403494.642497:0:17331:0:(pinger.c:229:ptlrpc_pinger_process_import()) 41b7c44b-9a12-452a-b9e6-b5b285399ec4->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1789403494.642502:0:17331:0:(pinger.c:247:ptlrpc_pinger_process_import()) 41b7c44b-9a12-452a-b9e6-b5b285399ec4->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1789403494.642505:0:17331:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1789403494.642509:0:17331:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1789403494.642562:0:3629:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789403494.642580:0:3629:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a144b2a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3629:1876325050831360:0@lo:400:kworker.0 00000400:00000100:3.0:1789403494.642632:0:3629:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1876325050831360 offset 0 length 224: 4 00000100:00100000:3.0:1789403495.283852:0:3625:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789403480/real 1789403480] req@ffff90a144bedc00 x1876325050830464/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 1 dl 1789403495 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789403495.283894:0:3625:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff90a144bedc00 x1876325050830464/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 1 dl 1789403495 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1789403495.283914:0:3625:0:(import.c:65:import_set_state_nolock()) ffff90a1434d4000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1789403495.283945:0:3625:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-110) 00000100:00100000:3.0:1789403495.283949:0:3625:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a144bedc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3625:1876325050830464:0@lo:38:kworker.0 00000100:00080000:3.0:1789403495.283988:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 41b7c44b-9a12-452a-b9e6-b5b285399ec4->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1789403495.283992:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) 41b7c44b-9a12-452a-b9e6-b5b285399ec4->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1789403495.283994:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1789403495.283997:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1789403495.284000:0:37:0:(import.c:65:import_set_state_nolock()) ffff90a1434d4000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1789403495.284005:0:37:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 526 00000100:00080000:3.0:1789403495.284009:0:37:0:(import.c:630:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 10s 00000100:00080000:3.0:1789403495.284020:0:37:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff90a1434d4000 using connection 192.168.203.143@tcp/0@lo 00000100:00100000:3.0:1789403495.284049:0:37:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff90a144b2b100 x1876325050831488/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1789403495.284100:0:3629:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a144b2bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3629:1876325050831616:0@lo:400:kworker.0 00000400:00000100:3.0:1789403495.284153:0:3629:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1876325050831616 offset 0 length 224: 4 00000100:00100000:3.0:1789403495.284213:0:3625:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a144b2b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3625:1876325050831488:0@lo:38:kworker.0 00000400:00000100:3.0:1789403495.284229:0:3625:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1876325050831488 offset 0 length 520: 4 00010000:00010000:2.0:1789403495.670111:0:17212:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00000400:1.0:1789403496.689535:0:3628:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789403480/real 1789403480] req@ffff90a144bef800 x1876325050830592/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1789403496 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00010000:00010000:0.0:1789403496.689656:0:17213:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789403496.739354:0:3628:0:(client.c:2548:ptlrpc_expire_one_request()) @@@ TIMEOUT-NORESEND: req@ffff90a144bef800 x1876325050830592/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1789403496 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1789403496.739368:0:3628:0:(import.c:65:import_set_state_nolock()) ffff90a1434d0000 lustre-MDT0001_UUID: changing import state from FULL to DISCONN 00000100:02000400:1.0:1789403496.739372:0:3628:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0001-lwp-OST0001: Connection to lustre-MDT0001 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:1.0:1789403496.766512:0:3628:0:(import.c:418:ptlrpc_pinger_force()) lustre-MDT0001_UUID: waking up pinger s:DISCONN 00000100:00080000:0.0:1789403496.766850:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) 41b7c44b-9a12-452a-b9e6-b5b285399ec4->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1789403496.766868:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) 41b7c44b-9a12-452a-b9e6-b5b285399ec4->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1789403496.766871:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1789403496.766874:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1789403496.766876:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1789403496.766894:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:0.0:1789403496.766898:0:36:0:(import.c:65:import_set_state_nolock()) ffff90a1434d0000 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1789403496.766906:0:36:0:(import.c:545:import_select_connection()) lustre-MDT0001-lwp-OST0001: connect to NID 0@lo last attempt 480 00000100:00080000:0.0:1789403496.766921:0:36:0:(import.c:666:import_select_connection()) lustre-MDT0001-lwp-OST0001: import ffff90a1434d0000 using connection 192.168.203.143@tcp/0@lo 00000100:00100000:0.0:1789403496.766958:0:36:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff90a144bed500 x1876325050831744/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1789403496.767015:0:3628:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a144bef800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3628:1876325050830592:0@lo:400:kworker.0 00000100:00100000:1.0:1789403496.767450:0:3625:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a144bed500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3625:1876325050831744:0@lo:38:kworker.0 00000400:00000100:1.0:1789403496.767512:0:3625:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1876325050831744 offset 0 length 520: 4 00010000:00010000:3.0:1789403497.713772:0:17978:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1789403498.180250:0:21402:0:(tgt_mount.c:2191:server_umount_begin()) umount -f 00000020:01000004:2.0:1789403498.191699:0:21402:0:(tgt_mount.c:2061:server_put_super()) server put_super lustre-OST0001 00010000:00010000:2.0:1789403498.191792:0:21402:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.143@tcp lock: ffff90a259946a00/0x5fb08b1e5b761fa7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb08b1e5b761fae expref: -99 pid: 19544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403498.191807:0:21402:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.143@tcp lock: ffff90a259946a00/0x5fb08b1e5b761fa7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x5fb08b1e5b761fae expref: -99 pid: 19544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403498.191816:0:21402:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.143@tcp lock: ffff90a259946a00/0x5fb08b1e5b761fa7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x5fb08b1e5b761fae expref: -99 pid: 19544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403498.191841:0:21402:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.143@tcp lock: ffff90a259946a00/0x5fb08b1e5b761fa7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x5fb08b1e5b761fae expref: -99 pid: 19544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403498.191862:0:21402:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:2.0:1789403498.191867:0:21402:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:2.0:1789403498.191891:0:21402:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1789403498.191902:0:21402:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff90a144b2b100 x1876325050831488/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1789403515 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00010000:00010000:0.0:1789403498.192026:0:17212:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789403498.192035:0:17212:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.143@tcp lock: ffff90a259946a00/0x5fb08b1e5b761fa7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x5fb08b1e5b761fae expref: -99 pid: 19544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403498.192042:0:17212:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a259946a00 already unused, calling callback (ffffffffc120dc20) 10000000:00010000:0.0:1789403498.192046:0:17212:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.143@tcp lock: ffff90a259946a00/0x5fb08b1e5b761fa7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x5fb08b1e5b761fae expref: -99 pid: 19544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403498.192054:0:17212:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.143@tcp lock: ffff90a259946a00/0x5fb08b1e5b761fa7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x5fb08b1e5b761fae expref: -99 pid: 19544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789403498.192061:0:17212:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.143@tcp lock: ffff90a259946a00/0x5fb08b1e5b761fa7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x5fb08b1e5b761fae expref: -99 pid: 19544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789403498.192067:0:17212:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1789403498.192070:0:17212:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:0.0:1789403498.192072:0:17212:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:0.0:1789403498.192084:0:17212:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff90a2599a1000 00010000:00010000:0.0:1789403498.192087:0:17212:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.143@tcp lock: ffff90a259946a00/0x5fb08b1e5b761fa7 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x5fb08b1e5b761fae expref: -99 pid: 19544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403498.192093:0:17212:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.143@tcp lock: ffff90a259946a00/0x5fb08b1e5b761fa7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x5fb08b1e5b761fae expref: -99 pid: 19544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403498.192111:0:17212:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789403498.192113:0:17212:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789403498.192115:0:17212:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789403498.192278:0:21402:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 3 00000100:00080000:2.0:1789403498.192285:0:21402:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00080000:2.0:1789403498.192291:0:21402:0:(import.c:65:import_set_state_nolock()) ffff90a1434d4000 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00080000:2.0:1789403498.192296:0:21402:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1789403498.192301:0:21402:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff90a144b2b100 x1876325050831488/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1789403515 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789403498.192802:0:21402:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 4 00000100:00100000:1.0:1789403498.192826:0:3625:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a144b2b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3625:1876325050831488:0@lo:38:kworker.0 00000100:00100000:2.0:1789403498.192923:0:21402:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00080000:2.0:1789403498.194269:0:21402:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:2.0:1789403498.194282:0:21402:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff90a144b28380 x1876325050830848/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789403500 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789403498.195270:0:21402:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff90a144b2ad80 x1876325050830976/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789403501 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789403498.195299:0:21402:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff90a141aafb80 x1876325050831232/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789403505 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789403498.195308:0:21402:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff90a144b2a300 x1876325050831360/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789403510 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789403498.195317:0:21402:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff90a144b2bb80 x1876325050831616/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789403511 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789403498.195340:0:21402:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff90a144bed500 x1876325050831744/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1789403506 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789403498.195441:0:21402:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 3 00000100:00080000:2.0:1789403498.195461:0:21402:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID 00000100:00080000:2.0:1789403498.195468:0:21402:0:(import.c:65:import_set_state_nolock()) ffff90a1434d0000 lustre-MDT0001_UUID: changing import state from CONNECTING to CLOSED 00000100:00080000:2.0:1789403498.195474:0:21402:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:2.0:1789403498.195479:0:21402:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff90a144b28380 x1876325050830848/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789403500 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789403498.195574:0:3626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a141aafb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3626:1876325050831232:0@lo:400:kworker.0 00000100:00100000:2.0:1789403498.196530:0:21402:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff90a144b2ad80 x1876325050830976/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789403501 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789403498.196542:0:21402:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff90a141aafb80 x1876325050831232/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789403505 ref 1 fl Complete:ENQU/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789403498.196551:0:21402:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff90a144b2a300 x1876325050831360/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789403510 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789403498.196559:0:21402:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff90a144b2bb80 x1876325050831616/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789403511 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789403498.196568:0:21402:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff90a144bed500 x1876325050831744/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1789403506 ref 1 fl Interpret:ENQU/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789403498.196576:0:21402:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 4 00000100:00100000:0.0:1789403498.196608:0:3629:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a144b28380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3629:1876325050830848:0@lo:400:kworker.0 00000100:00100000:3.0:1789403498.197953:0:3626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a144b2ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3626:1876325050830976:0@lo:400:kworker.0 00000100:00100000:1.0:1789403498.200296:0:3625:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a144bed500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3625:1876325050831744:0@lo:38:kworker.0 00000100:00100000:2.0:1789403498.200301:0:21402:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 17s for inflight to error out 00000100:00100000:0.0:1789403498.200606:0:3629:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a144b2bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3629:1876325050831616:0@lo:400:kworker.0 00000100:00100000:0.0:1789403498.200685:0:3629:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a144b2a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3629:1876325050831360:0@lo:400:kworker.0 00010000:00010000:2.0:1789403498.202098:0:21402:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.143@tcp lock: ffff90a259947800/0x5fb08b1e5b761f7d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb08b1e5b761f84 expref: -99 pid: 19544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403498.202116:0:21402:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.143@tcp lock: ffff90a259947800/0x5fb08b1e5b761f7d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x5fb08b1e5b761f84 expref: -99 pid: 19544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403498.202123:0:21402:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.143@tcp lock: ffff90a259947800/0x5fb08b1e5b761f7d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x5fb08b1e5b761f84 expref: -99 pid: 19544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403498.202141:0:21402:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.143@tcp lock: ffff90a259947800/0x5fb08b1e5b761f7d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x5fb08b1e5b761f84 expref: -99 pid: 19544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403498.202164:0:21402:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789403498.202172:0:21402:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.143@tcp lock: ffff90a281b04e00/0x5fb08b1e5b762232 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb08b1e5b762239 expref: -99 pid: 17221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403498.202179:0:21402:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.143@tcp lock: ffff90a281b04e00/0x5fb08b1e5b762232 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x5fb08b1e5b762239 expref: -99 pid: 17221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403498.202184:0:21402:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.143@tcp lock: ffff90a281b04e00/0x5fb08b1e5b762232 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x5fb08b1e5b762239 expref: -99 pid: 17221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403498.202189:0:21402:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.143@tcp lock: ffff90a281b04e00/0x5fb08b1e5b762232 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x5fb08b1e5b762239 expref: -99 pid: 17221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403498.202207:0:21402:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 10000000:01000000:2.0:1789403498.202212:0:21402:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0001 (0) 00000020:01000004:2.0:1789403498.202236:0:21402:0:(tgt_mount.c:2111:server_put_super()) stopping lustre-OST0001 00000020:01000000:2.0:1789403498.202240:0:21402:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001 (flags='F') 00000020:00000080:2.0:1789403498.202245:0:21402:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1789403498.202250:0:21402:0:(obd_config.c:956:class_cleanup()) lustre-OST0001: forcing exports to disconnect: 0/1 00000020:00080000:2.0:1789403498.202253:0:21402:0:(genops.c:1557:class_disconnect_exports()) OBD device 26 (ffff90a2606599c0) has no exports 00010000:00010000:3.0:1789403498.202267:0:17978:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1789403498.202274:0:17978:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.143@tcp lock: ffff90a259947800/0x5fb08b1e5b761f7d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x5fb08b1e5b761f84 expref: -99 pid: 19544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00080000:2.0:1789403498.202274:0:21402:0:(genops.c:1557:class_disconnect_exports()) OBD device 26 (ffff90a2606599c0) has no exports 00010000:00010000:3.0:1789403498.202281:0:17978:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a259947800 already unused, calling callback (ffffffffc120dc20) 10000000:00010000:3.0:1789403498.202284:0:17978:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.143@tcp lock: ffff90a259947800/0x5fb08b1e5b761f7d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x5fb08b1e5b761f84 expref: -99 pid: 19544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403498.202299:0:17978:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.143@tcp lock: ffff90a259947800/0x5fb08b1e5b761f7d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x5fb08b1e5b761f84 expref: -99 pid: 19544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789403498.202307:0:17978:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.143@tcp lock: ffff90a259947800/0x5fb08b1e5b761f7d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x5fb08b1e5b761f84 expref: -99 pid: 19544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789403498.202329:0:17978:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1789403498.202331:0:17978:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0001: stopping, won't requeue 10000000:01000000:3.0:1789403498.202333:0:17978:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0001 00010000:00010000:3.0:1789403498.202346:0:17978:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff90a2599a1000 00010000:00010000:3.0:1789403498.202349:0:17978:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.143@tcp lock: ffff90a259947800/0x5fb08b1e5b761f7d lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x5fb08b1e5b761f84 expref: -99 pid: 19544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403498.202356:0:17978:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.143@tcp lock: ffff90a259947800/0x5fb08b1e5b761f7d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x5fb08b1e5b761f84 expref: -99 pid: 19544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403498.202369:0:17978:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789403498.202372:0:17978:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.143@tcp lock: ffff90a281b04e00/0x5fb08b1e5b762232 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x5fb08b1e5b762239 expref: -99 pid: 17221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403498.202377:0:17978:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a281b04e00 already unused, calling callback (ffffffffc120dc20) 10000000:00010000:3.0:1789403498.202380:0:17978:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.143@tcp lock: ffff90a281b04e00/0x5fb08b1e5b762232 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x5fb08b1e5b762239 expref: -99 pid: 17221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403498.202412:0:17978:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.143@tcp lock: ffff90a281b04e00/0x5fb08b1e5b762232 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x5fb08b1e5b762239 expref: -99 pid: 17221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789403498.202419:0:17978:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.143@tcp lock: ffff90a281b04e00/0x5fb08b1e5b762232 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x5fb08b1e5b762239 expref: -99 pid: 17221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789403498.202434:0:17978:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:3.0:1789403498.202440:0:17978:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:3.0:1789403498.202442:0:17978:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:3.0:1789403498.202466:0:17978:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff90a2599a1000 00010000:00010000:3.0:1789403498.202469:0:17978:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.143@tcp lock: ffff90a281b04e00/0x5fb08b1e5b762232 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0x5fb08b1e5b762239 expref: -99 pid: 17221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403498.202476:0:17978:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.143@tcp lock: ffff90a281b04e00/0x5fb08b1e5b762232 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0x5fb08b1e5b762239 expref: -99 pid: 17221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403498.202489:0:17978:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789403498.202491:0:17978:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789403498.202493:0:17978:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789403498.202816:0:17213:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:2.0:1789403498.204906:0:21402:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff90a27c2079c0 - data ffff90a2583c2438/ffff90a14277b400 00000020:01000000:2.0:1789403498.205210:0:21402:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff90a1432943c0 - data ffff90a26d9dbbd0/ffff90a1444a6c00 00100000:10000000:2.0:1789403498.218797:0:21402:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0001-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:2.0:1789403498.225632:0:21402:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x5fb08b1e5b761f92 00000020:00000080:2.0:1789403498.225649:0:21402:0:(genops.c:885:class_export_put()) final put ffff90a143690800/lustre-OST0001-osd_UUID 00000020:01000004:2.0:1789403498.226746:0:21402:0:(tgt_mount.c:187:server_put_mount()) put mount ffff90a144166800 from lustre-OST0001, refs=2 00000020:01000004:2.0:1789403498.226754:0:21402:0:(obd_mount.c:710:lustre_put_lsi()) put ffff90a144166800 2 00000020:01000004:2.0:1789403498.226758:0:21402:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff90a144166800 from lustre-OST0001 00000020:00000080:2.0:1789403498.226805:0:21402:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1789403498.226816:0:21402:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:00000080:2.0:1789403498.226820:0:21402:0:(genops.c:885:class_export_put()) final put ffff90a143696000/lustre-OST0001_UUID 00000020:00000080:2.0:1789403498.226824:0:21402:0:(genops.c:844:class_export_destroy()) destroying export ffff90a143696000/lustre-OST0001_UUID for lustre-OST0001 00000020:01000000:2.0:1789403498.227027:0:21402:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001 (lustre-OST0001_UUID) 00000020:00000080:1.0:1789403498.227079:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff90a143690800/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000100:00080000:2.0:1789403498.227224:0:21402:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import 41b7c44b-9a12-452a-b9e6-b5b285399ec4->MGS 00010000:00010000:2.0:1789403498.227241:0:21402:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.143@tcp lock: ffff90a1425c7e00/0x5fb08b1e5b761da1 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x5fb08b1e5b761da8 expref: -99 pid: 17956 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789403498.227254:0:21402:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.143@tcp lock: ffff90a1425c7e00/0x5fb08b1e5b761da1 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x5fb08b1e5b761da8 expref: -99 pid: 17956 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789403498.227260:0:21402:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 10000000:01000000:2.0:1789403498.227263:0:21402:0:(mgc_request.c:954:mgc_blocking_ast()) log nodemap: disconnecting, won't requeue 10000000:01000000:2.0:1789403498.227266:0:21402:0:(mgc_request.c:130:config_log_put()) dropping config log nodemap 00010000:00010000:2.0:1789403498.227280:0:21402:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff90a2599a1000 00010000:00010000:2.0:1789403498.227284:0:21402:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.143@tcp lock: ffff90a1425c7e00/0x5fb08b1e5b761da1 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x5fb08b1e5b761da8 expref: -99 pid: 17956 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403498.227306:0:21402:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.143@tcp lock: ffff90a2821e9200/0x5fb08b1e5b761c90 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x5fb08b1e5b761c97 expref: -99 pid: 17203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789403498.227313:0:21402:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.143@tcp lock: ffff90a2821e9200/0x5fb08b1e5b761c90 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x5fb08b1e5b761c97 expref: -99 pid: 17203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789403498.227318:0:21402:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1789403498.227321:0:21402:0:(mgc_request.c:954:mgc_blocking_ast()) log lustre-s: disconnecting, won't requeue 10000000:01000000:2.0:1789403498.227323:0:21402:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-sptlrpc 00010000:00010000:2.0:1789403498.227342:0:21402:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff90a2599a1000 00010000:00010000:2.0:1789403498.227345:0:21402:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.143@tcp lock: ffff90a2821e9200/0x5fb08b1e5b761c90 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x5fb08b1e5b761c97 expref: -99 pid: 17203 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1789403498.227362:0:21402:0:(import.c:65:import_set_state_nolock()) ffff90a2599a1000 MGS: changing import state from CONNECTING to CLOSED 10000000:01000000:2.0:1789403498.227365:0:21402:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:2.0:1789403498.227367:0:21402:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:2.0:1789403498.227369:0:21402:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:2.0:1789403498.227373:0:21402:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:2.0:1789403498.227384:0:21402:0:(client.c:3591:ptlrpc_abort_inflight()) @@@ inflight req@ffff90a141aaf100 x1876325050831104/t0(0) o250->MGC192.168.203.143@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 1789403504 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 10000000:01000000:2.0:1789403498.227419:0:21402:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:2.0:1789403498.227421:0:21402:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 8s for inflight to error out 00000100:00100000:1.0:1789403498.227486:0:3625:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a141aaf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:41b7c44b-9a12-452a-b9e6-b5b285399ec4:3625:1876325050831104:0@lo:250:kworker.0 10000000:01000000:2.0:1789403498.227589:0:21402:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:2.0:1789403498.227597:0:21402:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x5fb08b1e5b761c7b 00000020:00000080:2.0:1789403498.227602:0:21402:0:(genops.c:885:class_export_put()) final put ffff90a14452f000/41b7c44b-9a12-452a-b9e6-b5b285399ec4 00000020:01000000:2.0:1789403498.227615:0:21402:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGC192.168.203.143@tcp (flags='') 00000020:00000080:1.0:1789403498.227621:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff90a14452f000/41b7c44b-9a12-452a-b9e6-b5b285399ec4 for MGC192.168.203.143@tcp 00000020:00000080:2.0:1789403498.227631:0:21402:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1789403498.227637:0:21402:0:(obd_config.c:956:class_cleanup()) MGC192.168.203.143@tcp: forcing exports to disconnect: 0/2 00000020:00080000:2.0:1789403498.227641:0:21402:0:(genops.c:1557:class_disconnect_exports()) OBD device 2 (ffff90a142648000) has no exports 10000000:01000000:1.0:1789403498.227720:0:17221:0:(mgc_request.c:708:mgc_requeue_thread()) Ending requeue thread 10000000:01000000:2.0:1789403498.227748:0:21402:0:(obd_class.h:670:obd_cleanup_client_import()) MGC192.168.203.143@tcp: client import never connected 00000100:00080000:2.0:1789403498.227751:0:21402:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 10000000:01000000:2.0:1789403498.227754:0:21402:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:2.0:1789403498.227757:0:21402:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 10000000:01000000:2.0:1789403498.227758:0:21402:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:2.0:1789403498.227804:0:21402:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1789403498.227809:0:21402:0:(obd_config.c:883:class_detach()) detach on obd MGC192.168.203.143@tcp (uuid 41b7c44b-9a12-452a-b9e6-b5b285399ec4) 00000020:00000080:0.0:1789403498.227810:0:37:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff90a2599a1000 for MGC192.168.203.143@tcp 00000020:01000000:2.0:1789403498.227815:0:21402:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0001 (flags='F') 00000020:00000080:2.0:1789403498.227819:0:21402:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1789403498.227822:0:21402:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-OST0001: forcing exports to disconnect: 1/3 00000020:00080000:2.0:1789403498.227828:0:21402:0:(genops.c:1818:print_export_data()) lustre-MDT0000-lwp-OST0001: ACTIVE ffff90a142429000 lustre-MDT0000-lwp-OST0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1789403498.227833:0:21402:0:(genops.c:1552:class_disconnect_exports()) OBD device 27 (ffff90a281808000) has exports, disconnecting them 00000020:00000080:0.0:1789403498.227835:0:37:0:(genops.c:885:class_export_put()) final put ffff90a2599a6000/41b7c44b-9a12-452a-b9e6-b5b285399ec4 00000020:00000080:0.0:1789403498.227839:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff90a2599a6000/41b7c44b-9a12-452a-b9e6-b5b285399ec4 for MGC192.168.203.143@tcp 00000020:00080000:2.0:1789403498.227848:0:21402:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0001: disconnecting export at 0@lo (ffff90a142429000), last request at 1789403434 00000020:01000000:0.0:1789403498.227851:0:37:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGC192.168.203.143@tcp (41b7c44b-9a12-452a-b9e6-b5b285399ec4) 00000020:00000080:2.0:1789403498.227854:0:21402:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x5fb08b1e5b761fbc 00000020:00080000:2.0:1789403498.227867:0:21402:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff90a142429000): rc 0 00000020:00000080:2.0:1789403498.227871:0:21402:0:(genops.c:885:class_export_put()) final put ffff90a142429000/lustre-MDT0000-lwp-OST0001 00000020:00000080:0.0:1789403498.228381:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff90a142429000/lustre-MDT0000-lwp-OST0001 for lustre-MDT0000-lwp-OST0001 00010000:01000000:0.0:1789403498.229488:0:21402:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0001: client import never connected 00000100:00080000:0.0:1789403498.229498:0:21402:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1789403498.229503:0:21402:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 5 00000100:00100000:0.0:1789403498.229509:0:21402:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1789403498.229657:0:21402:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1789403498.229665:0:21402:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000020:01000000:0.0:1789403498.229671:0:21402:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-lwp-OST0001 (flags='F') 00000020:00000080:0.0:1789403498.229675:0:21402:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1789403498.229679:0:21402:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-lwp-OST0001: forcing exports to disconnect: 1/3 00000020:00080000:0.0:1789403498.229684:0:21402:0:(genops.c:1818:print_export_data()) lustre-MDT0001-lwp-OST0001: ACTIVE ffff90a1434d1000 lustre-MDT0001-lwp-OST0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1789403498.229690:0:21402:0:(genops.c:1552:class_disconnect_exports()) OBD device 28 (ffff90a28180cd40) has exports, disconnecting them 00000020:00080000:0.0:1789403498.229694:0:21402:0:(genops.c:1527:class_disconnect_export_list()) lustre-MDT0001-lwp-OST0001: disconnecting export at 0@lo (ffff90a1434d1000), last request at 1789403434 00000020:00000080:0.0:1789403498.229698:0:21402:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x5fb08b1e5b761fd1 00000020:00080000:0.0:1789403498.229745:0:21402:0:(genops.c:1532:class_disconnect_export_list()) disconnected export at 0@lo (ffff90a1434d1000): rc 0 00000020:00000080:0.0:1789403498.229751:0:21402:0:(genops.c:885:class_export_put()) final put ffff90a1434d1000/lustre-MDT0001-lwp-OST0001 00000020:00000080:1.0:1789403498.229804:0:37:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff90a1434d4000 for lustre-MDT0000-lwp-OST0001 00000020:00000080:1.0:1789403498.229811:0:37:0:(genops.c:885:class_export_put()) final put ffff90a1432ec000/lustre-MDT0000-lwp-OST0001_UUID 00000020:00000080:1.0:1789403498.229813:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff90a1432ec000/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000-lwp-OST0001 00000020:01000000:1.0:1789403498.229835:0:37:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0001 (lustre-MDT0000-lwp-OST0001_UUID) 00000020:00000080:1.0:1789403498.229887:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff90a1434d1000/lustre-MDT0001-lwp-OST0001 for lustre-MDT0001-lwp-OST0001 00010000:01000000:1.0:1789403498.233606:0:21402:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0001-lwp-OST0001: client import never connected 00000100:00080000:1.0:1789403498.233615:0:21402:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:1.0:1789403498.233619:0:21402:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 5 00000100:00100000:1.0:1789403498.233627:0:21402:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1789403498.233676:0:37:0:(genops.c:1182:obd_zombie_import_free()) destroying import ffff90a1434d0000 for lustre-MDT0001-lwp-OST0001 00010000:00010000:1.0:1789403498.235553:0:17212:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-1 blwis in pool) 00010000:00010000:3.0:1789403498.236791:0:17978:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-2 blwis in pool) 00010000:00010000:1.0:1789403498.238445:0:17213:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-3 blwis in pool) 00000100:00100000:1.0:1789403498.241009:0:17207:0:(service.c:3188:ptlrpc_main()) ldlm_cb00_000: service thread [ffff90a142767e00:17207] 0 exiting: rc = 1 00000100:00100000:1.0:1789403498.241130:0:17208:0:(service.c:3188:ptlrpc_main()) ldlm_cb00_001: service thread [ffff90a142766a00:17208] 1 exiting: rc = 0 00000100:00100000:1.0:1789403498.241201:0:21402:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789403498.241483:0:17210:0:(service.c:3188:ptlrpc_main()) ldlm_cn00_001: service thread [ffff90a142766c00:17210] 1 exiting: rc = 0 00000100:00100000:1.0:1789403498.241542:0:17211:0:(service.c:3188:ptlrpc_main()) ldlm_cn00_002: service thread [ffff90a142766800:17211] 2 exiting: rc = 0 00000100:00100000:0.0:1789403498.242147:0:17209:0:(service.c:3188:ptlrpc_main()) ldlm_cn00_000: service thread [ffff90a142766400:17209] 0 exiting: rc = 1 00000100:00100000:0.0:1789403498.242253:0:20998:0:(service.c:3188:ptlrpc_main()) ldlm_cn00_004: service thread [ffff90a26d144a00:20998] 4 exiting: rc = 0 00000100:00100000:2.0:1789403498.242318:0:17979:0:(service.c:3188:ptlrpc_main()) ldlm_cn00_003: service thread [ffff90a27ceaa800:17979] 3 exiting: rc = 0 00000100:00100000:1.0:1789403498.242482:0:21402:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789403498.242490:0:21402:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789403498.242496:0:21402:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789403498.242502:0:21402:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789403498.242508:0:21402:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789403498.242514:0:21402:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789403498.242519:0:21402:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789403498.242523:0:21402:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789403498.242528:0:21402:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789403498.242534:0:21402:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789403498.242539:0:21402:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789403498.242544:0:21402:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789403498.242549:0:21402:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789403498.242555:0:21402:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789403498.242560:0:21402:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789403498.242565:0:21402:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789403498.242571:0:21402:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789403498.242576:0:21402:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789403498.242581:0:21402:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789403498.242586:0:21402:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789403498.242592:0:21402:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789403498.242597:0:21402:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789403498.242603:0:21402:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789403498.242610:0:21402:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789403498.242618:0:21402:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789403498.242625:0:21402:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789403498.242644:0:21402:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789403498.242652:0:21402:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789403498.242661:0:21402:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789403498.242666:0:21402:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789403498.242678:0:21402:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789403498.242683:0:21402:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789403498.242688:0:21402:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789403498.242693:0:21402:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789403498.242698:0:21402:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789403498.242704:0:21402:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789403498.242709:0:21402:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789403498.242714:0:21402:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789403498.242719:0:21402:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789403498.242723:0:21402:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789403498.242728:0:21402:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789403498.242733:0:21402:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789403498.242739:0:21402:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789403498.242744:0:21402:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789403498.242749:0:21402:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789403498.242754:0:21402:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789403498.242760:0:21402:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789403498.242765:0:21402:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789403498.242771:0:21402:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789403498.242776:0:21402:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789403498.242782:0:21402:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789403498.242788:0:21402:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789403498.242794:0:21402:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789403498.242799:0:21402:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789403498.242804:0:21402:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789403498.242810:0:21402:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789403498.242831:0:21402:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789403498.242837:0:21402:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789403498.242842:0:21402:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789403498.242848:0:21402:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789403498.242853:0:21402:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789403498.242865:0:21402:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789403498.242870:0:21402:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789403498.242876:0:21402:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:1.0:1789403498.247258:0:21402:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1789403498.247268:0:21402:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-lwp-OST0001 (uuid lustre-MDT0001-lwp-OST0001_UUID) 00000020:00000080:1.0:1789403498.247274:0:21402:0:(genops.c:885:class_export_put()) final put ffff90a1434d6000/lustre-MDT0001-lwp-OST0001_UUID 00000020:00000080:1.0:1789403498.247278:0:21402:0:(genops.c:844:class_export_destroy()) destroying export ffff90a1434d6000/lustre-MDT0001-lwp-OST0001_UUID for lustre-MDT0001-lwp-OST0001 00000020:01000000:1.0:1789403498.247284:0:21402:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-lwp-OST0001 (lustre-MDT0001-lwp-OST0001_UUID) 00000020:01000004:1.0:1789403498.247331:0:21402:0:(obd_mount.c:710:lustre_put_lsi()) put ffff90a144166800 1 00000020:00000080:1.0:1789403498.247337:0:21402:0:(genops.c:1467:class_disconnect()) disconnect: cookie 0x5fb08b1e5b761f76 00000020:00000080:1.0:1789403498.247343:0:21402:0:(genops.c:885:class_export_put()) final put ffff90a27697f800/lustre-OST0001-osd_UUID 00000020:01000000:1.0:1789403498.247356:0:21402:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osd (flags='') 00000020:00000080:1.0:1789403498.247367:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff90a27697f800/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:00000080:1.0:1789403498.247378:0:21402:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1789403498.247383:0:21402:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osd: forcing exports to disconnect: 0/1 00000020:00080000:1.0:1789403498.247429:0:21402:0:(genops.c:1557:class_disconnect_exports()) OBD device 25 (ffff90a28180b380) has no exports 00000020:00000080:0.0:1789403498.366753:0:21402:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1789403498.366767:0:21402:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00000020:00000080:0.0:1789403498.366773:0:21402:0:(genops.c:885:class_export_put()) final put ffff90a143718000/lustre-OST0001-osd_UUID 00000020:00000080:0.0:1789403498.366778:0:21402:0:(genops.c:844:class_export_destroy()) destroying export ffff90a143718000/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:01000000:0.0:1789403498.366788:0:21402:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osd (lustre-OST0001-osd_UUID) 00000020:01000004:0.0:1789403498.367187:0:21402:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff90a270021000 00000020:01000000:0.0:1789403498.367207:0:21402:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of OSS (flags='F') 00000020:00000080:0.0:1789403498.367212:0:21402:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1789403498.367215:0:21402:0:(obd_config.c:956:class_cleanup()) OSS: forcing exports to disconnect: 0/1 00000020:00080000:0.0:1789403498.367219:0:21402:0:(genops.c:1557:class_disconnect_exports()) OBD device 21 (ffff90a27c3619c0) has no exports 00000020:00000080:0.0:1789403498.367255:0:21402:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1789403498.367260:0:21402:0:(obd_config.c:883:class_detach()) detach on obd OSS (uuid OSS_uuid) 00000020:00000080:0.0:1789403498.367263:0:21402:0:(genops.c:885:class_export_put()) final put ffff90a2488fb800/OSS_uuid 00000020:00000080:0.0:1789403498.367265:0:21402:0:(genops.c:844:class_export_destroy()) destroying export ffff90a2488fb800/OSS_uuid for OSS 00000020:01000000:0.0:1789403498.367269:0:21402:0:(genops.c:441:class_free_dev()) finishing cleanup of obd OSS (OSS_uuid) 00000100:00100000:0.0:1789403498.367366:0:19833:0:(service.c:3188:ptlrpc_main()) ll_ost00_003: service thread [ffff90a1424a6800:19833] 3 exiting: rc = 0 00000100:00100000:3.0:1789403498.367371:0:18732:0:(service.c:3188:ptlrpc_main()) ll_ost00_001: service thread [ffff90a14404f000:18732] 1 exiting: rc = 0 00000100:00080000:2.0:1789403498.367557:0:17220:0:(pinger.c:548:ping_evictor_main()) Exiting Ping Evictor 00000100:00100000:2.0:1789403498.369744:0:18731:0:(service.c:3188:ptlrpc_main()) ll_ost00_000: service thread [ffff90a2614bde00:18731] 0 exiting: rc = 1 00000100:00100000:2.0:1789403498.369826:0:18733:0:(service.c:3188:ptlrpc_main()) ll_ost00_002: service thread [ffff90a142164a00:18733] 2 exiting: rc = 0 00000100:00100000:3.0:1789403498.370003:0:19834:0:(service.c:3188:ptlrpc_main()) ll_ost00_004: service thread [ffff90a14338cc00:19834] 4 exiting: rc = 0 00000100:00100000:0.0:1789403498.370201:0:21402:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403498.370210:0:21402:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403498.370216:0:21402:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403498.370221:0:21402:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403498.370226:0:21402:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403498.370231:0:21402:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403498.370237:0:21402:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403498.370242:0:21402:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403498.370248:0:21402:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403498.370253:0:21402:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403498.370258:0:21402:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403498.370263:0:21402:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403498.370269:0:21402:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403498.370286:0:21402:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403498.370291:0:21402:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403498.370296:0:21402:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403498.370300:0:21402:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403498.370305:0:21402:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403498.370310:0:21402:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403498.370314:0:21402:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403498.370319:0:21402:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403498.370323:0:21402:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403498.370328:0:21402:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403498.370333:0:21402:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403498.370339:0:21402:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403498.370343:0:21402:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403498.370348:0:21402:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403498.370353:0:21402:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403498.370358:0:21402:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403498.370362:0:21402:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403498.370367:0:21402:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403498.370372:0:21402:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403498.370376:0:21402:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403498.370382:0:21402:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403498.370521:0:21402:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403498.370529:0:21402:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403498.370535:0:21402:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403498.370540:0:21402:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403498.370545:0:21402:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403498.370551:0:21402:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403498.370556:0:21402:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403498.370561:0:21402:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403498.370568:0:21402:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403498.370575:0:21402:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403498.370582:0:21402:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403498.370589:0:21402:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403498.370598:0:21402:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403498.370606:0:21402:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403498.370621:0:21402:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403498.370629:0:21402:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403498.370638:0:21402:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403498.370646:0:21402:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403498.370656:0:21402:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403498.370668:0:21402:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403498.370675:0:21402:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403498.370679:0:21402:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403498.370684:0:21402:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403498.370689:0:21402:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403498.370694:0:21402:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403498.370698:0:21402:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403498.370702:0:21402:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403498.370707:0:21402:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403498.370715:0:21402:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403498.370721:0:21402:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789403498.373238:0:18735:0:(service.c:3188:ptlrpc_main()) ll_ost_create00_001: service thread [ffff90a143490600:18735] 1 exiting: rc = 0 00000100:00100000:3.0:1789403498.373492:0:20364:0:(service.c:3188:ptlrpc_main()) ll_ost_create00_002: service thread [ffff90a27cae0a00:20364] 2 exiting: rc = 0 00000100:00100000:1.0:1789403498.373677:0:18734:0:(service.c:3188:ptlrpc_main()) ll_ost_create00_000: service thread [ffff90a142164800:18734] 0 exiting: rc = 1 00000100:00100000:0.0:1789403498.374169:0:21402:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403498.374177:0:21402:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403498.374183:0:21402:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403498.374192:0:21402:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403498.374197:0:21402:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403498.374206:0:21402:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403498.374213:0:21402:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403498.374218:0:21402:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403498.374223:0:21402:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403498.374229:0:21402:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403498.374234:0:21402:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403498.374239:0:21402:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403498.374244:0:21402:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403498.374249:0:21402:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403498.374254:0:21402:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403498.374259:0:21402:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403498.374265:0:21402:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403498.374270:0:21402:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403498.374274:0:21402:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403498.374293:0:21402:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403498.374298:0:21402:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403498.374303:0:21402:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403498.374307:0:21402:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403498.374311:0:21402:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403498.374316:0:21402:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403498.374321:0:21402:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403498.374326:0:21402:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403498.374332:0:21402:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403498.374338:0:21402:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403498.374344:0:21402:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403498.374349:0:21402:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403498.374355:0:21402:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403498.374360:0:21402:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403498.374365:0:21402:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403498.374370:0:21402:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403498.374375:0:21402:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403498.374380:0:21402:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403498.374596:0:21402:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403498.374606:0:21402:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403498.374614:0:21402:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403498.374622:0:21402:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403498.374631:0:21402:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403498.374641:0:21402:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403498.374653:0:21402:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403498.374664:0:21402:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403498.374670:0:21402:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403498.374675:0:21402:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403498.374687:0:21402:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403498.374701:0:21402:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403498.374707:0:21402:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403498.374712:0:21402:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403498.374718:0:21402:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403498.374723:0:21402:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403498.374728:0:21402:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403498.374741:0:21402:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403498.374747:0:21402:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403498.374752:0:21402:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403498.374758:0:21402:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403498.374764:0:21402:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403498.374769:0:21402:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403498.374775:0:21402:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403498.374781:0:21402:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403498.374787:0:21402:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403498.374793:0:21402:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789403498.379794:0:18737:0:(service.c:3188:ptlrpc_main()) ll_ost_io00_001: service thread [ffff90a27cac0400:18737] 1 exiting: rc = 0 00000100:00100000:1.0:1789403498.380175:0:18736:0:(service.c:3188:ptlrpc_main()) ll_ost_io00_000: service thread [ffff90a2701ae600:18736] 0 exiting: rc = 1 00000100:00100000:1.0:1789403498.380476:0:18738:0:(service.c:3188:ptlrpc_main()) ll_ost_io00_002: service thread [ffff90a1436d7200:18738] 2 exiting: rc = 0 00000100:00100000:0.0:1789403498.380986:0:20365:0:(service.c:3188:ptlrpc_main()) ll_ost_io00_003: service thread [ffff90a144042400:20365] 3 exiting: rc = 0 00000100:00100000:1.0:1789403498.381055:0:21402:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789403498.381066:0:21402:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789403498.381075:0:21402:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789403498.381082:0:21402:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789403498.382001:0:21402:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789403498.382008:0:21402:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789403498.382015:0:21402:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789403498.382020:0:21402:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789403498.382025:0:21402:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789403498.382030:0:21402:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789403498.382036:0:21402:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789403498.382042:0:21402:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789403498.382065:0:21402:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789403498.382083:0:21402:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789403498.382089:0:21402:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789403498.382095:0:21402:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789403498.382101:0:21402:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789403498.382106:0:21402:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789403498.382112:0:21402:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789403498.382117:0:21402:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789403498.382124:0:21402:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789403498.382130:0:21402:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789403498.382136:0:21402:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789403498.382141:0:21402:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789403498.382147:0:21402:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789403498.382152:0:21402:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789403498.382158:0:21402:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789403498.382163:0:21402:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789403498.382170:0:21402:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789403498.382175:0:21402:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789403498.382243:0:21402:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789403498.382252:0:21402:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789403498.382258:0:21402:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789403498.382263:0:21402:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789403498.382268:0:21402:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789403498.382273:0:21402:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789403498.382486:0:21402:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789403498.382496:0:21402:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789403498.382502:0:21402:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789403498.382507:0:21402:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789403498.382513:0:21402:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789403498.382519:0:21402:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789403498.382524:0:21402:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789403498.382531:0:21402:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789403498.382537:0:21402:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789403498.382544:0:21402:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789403498.382550:0:21402:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789403498.382556:0:21402:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789403498.382644:0:21402:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789403498.382652:0:21402:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789403498.382658:0:21402:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789403498.382663:0:21402:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789403498.382669:0:21402:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789403498.382675:0:21402:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789403498.382690:0:21402:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789403498.382697:0:21402:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789403498.382702:0:21402:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789403498.382716:0:21402:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789403498.382729:0:21402:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789403498.382736:0:21402:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789403498.382741:0:21402:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789403498.382745:0:21402:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789403498.382750:0:21402:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789403498.382764:0:21402:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789403498.394937:0:18739:0:(service.c:3188:ptlrpc_main()) ll_ost_seq00_000: service thread [ffff90a249761000:18739] 0 exiting: rc = 1 00000100:00100000:2.0:1789403498.395096:0:18740:0:(service.c:3188:ptlrpc_main()) ll_ost_seq00_001: service thread [ffff90a2819bc000:18740] 1 exiting: rc = 0 00000100:00100000:3.0:1789403498.395162:0:21402:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789403498.395171:0:21402:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789403498.395176:0:21402:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789403498.395181:0:21402:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789403498.395186:0:21402:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789403498.395204:0:21402:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789403498.395211:0:21402:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789403498.395216:0:21402:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789403498.395222:0:21402:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789403498.395226:0:21402:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789403498.395231:0:21402:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789403498.395248:0:21402:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789403498.395253:0:21402:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789403498.395258:0:21402:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789403498.395262:0:21402:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789403498.395267:0:21402:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789403498.395272:0:21402:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789403498.395278:0:21402:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789403498.395283:0:21402:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789403498.395288:0:21402:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789403498.395293:0:21402:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789403498.395298:0:21402:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789403498.395303:0:21402:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789403498.395309:0:21402:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789403498.395314:0:21402:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789403498.395319:0:21402:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789403498.395324:0:21402:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789403498.395328:0:21402:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789403498.395333:0:21402:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789403498.395338:0:21402:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789403498.395343:0:21402:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789403498.395349:0:21402:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789403498.395354:0:21402:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789403498.395407:0:21402:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789403498.395416:0:21402:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789403498.395421:0:21402:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789403498.395426:0:21402:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789403498.395431:0:21402:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789403498.395437:0:21402:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789403498.395442:0:21402:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789403498.395456:0:21402:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789403498.395462:0:21402:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789403498.395467:0:21402:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789403498.395472:0:21402:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789403498.395476:0:21402:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789403498.395481:0:21402:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789403498.395492:0:21402:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789403498.395497:0:21402:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789403498.395502:0:21402:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789403498.395507:0:21402:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789403498.395512:0:21402:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789403498.395517:0:21402:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789403498.395522:0:21402:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789403498.395526:0:21402:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789403498.395535:0:21402:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789403498.395540:0:21402:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789403498.395546:0:21402:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789403498.395550:0:21402:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789403498.395555:0:21402:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789403498.395560:0:21402:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789403498.395565:0:21402:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789403498.395570:0:21402:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789403498.395575:0:21402:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789403498.395585:0:21402:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789403498.397542:0:18741:0:(service.c:3188:ptlrpc_main()) ll_ost_out00_000: service thread [ffff90a27cac0200:18741] 0 exiting: rc = 1 00000100:00100000:0.0:1789403498.397856:0:18742:0:(service.c:3188:ptlrpc_main()) ll_ost_out00_001: service thread [ffff90a27cac1c00:18742] 1 exiting: rc = 0 00000100:00100000:3.0:1789403498.398694:0:21402:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789403498.398704:0:21402:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789403498.398710:0:21402:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789403498.398716:0:21402:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789403498.398722:0:21402:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789403498.398728:0:21402:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789403498.398734:0:21402:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789403498.398740:0:21402:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789403498.398746:0:21402:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789403498.398752:0:21402:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789403498.398757:0:21402:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789403498.398763:0:21402:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789403498.398783:0:21402:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789403498.398903:0:21402:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789403498.398913:0:21402:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789403498.398920:0:21402:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789403498.398926:0:21402:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789403498.398946:0:21402:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789403498.398951:0:21402:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789403498.398958:0:21402:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789403498.398964:0:21402:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789403498.398970:0:21402:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789403498.398977:0:21402:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789403498.398982:0:21402:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789403498.399003:0:21402:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789403498.399010:0:21402:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789403498.399015:0:21402:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789403498.399021:0:21402:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789403498.399026:0:21402:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789403498.399032:0:21402:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789403498.399037:0:21402:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789403498.399043:0:21402:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789403498.399049:0:21402:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789403498.399055:0:21402:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789403498.399060:0:21402:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789403498.399065:0:21402:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789403498.399087:0:21402:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789403498.399093:0:21402:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789403498.399101:0:21402:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789403498.399107:0:21402:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789403498.399112:0:21402:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789403498.399118:0:21402:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789403498.399137:0:21402:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789403498.399144:0:21402:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789403498.399149:0:21402:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789403498.399154:0:21402:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789403498.399160:0:21402:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789403498.399166:0:21402:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789403498.399201:0:21402:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789403498.399209:0:21402:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789403498.399215:0:21402:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789403498.399220:0:21402:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789403498.399238:0:21402:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789403498.399245:0:21402:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789403498.399250:0:21402:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789403498.399255:0:21402:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789403498.399261:0:21402:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789403498.399268:0:21402:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789403498.399273:0:21402:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789403498.399279:0:21402:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789403498.399309:0:21402:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789403498.399316:0:21402:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789403498.399321:0:21402:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789403498.399327:0:21402:0:(events.c:344:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:02000400:0.0:1789403498.414262:0:21402:0:(tgt_mount.c:2180:server_put_super()) server umount lustre-OST0001 complete 00000001:02000400:2.0:1789403518.554099:0:22166:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg343-server.virtnet: executing load_modules_local 00000020:01000004:3.0:1789403528.783519:0:22765:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:3.0:1789403528.783524:0:22765:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/mds1_flakey 00000020:01000004:3.0:1789403528.783525:0:22765:0:(obd_mount.c:929:lmd_print()) options: user_xattr,errors=remount-ro 00000080:01200004:3.0:1789403528.783636:0:22765:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff90a144559800 00000020:01000004:3.0:1789403528.783650:0:22765:0:(tgt_mount.c:2502:osd_start()) Attempting to start lustre-MDT0000, type=osd-ldiskfs, lsifl=200005, mountfl=0 00000020:01000004:3.0:1789403528.783657:0:22765:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-ldiskfs) 00000020:00000080:3.0:1789403528.783669:0:22765:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (ffff90a27c363380) 00000020:00000080:3.0:1789403528.783680:0:22765:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-ldiskfs with refcount 2 00100000:10000000:2.0:1789403528.892100:0:22765:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:2.0:1789403528.892782:0:22765:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x13:0x0] (16/1) registered 00100000:10000000:2.0:1789403528.893701:0:22765:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/32) registered 00100000:10000000:2.0:1789403528.893908:0:22765:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/32) registered 00100000:10000000:2.0:1789403528.894268:0:22765:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8) registered 00100000:10000000:3.0:1789403528.896676:0:22765:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:3.0:1789403528.897045:0:22765:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8) registered 00100000:10000000:3.0:1789403528.897330:0:22765:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:3.0:1789403528.897914:0:22765:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x9:0x0] (8/32) registered 00100000:10000000:3.0:1789403528.898300:0:22765:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/32) registered 00100000:10000000:3.0:1789403528.898759:0:22765:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/32) registered 00100000:10000000:3.0:1789403528.898952:0:22765:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8) registered 00100000:10000000:0.0:1789403528.899721:0:22765:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:0.0:1789403528.900074:0:22765:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/32) registered 00100000:10000000:0.0:1789403528.903729:0:22765:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x21:0x0] (16/1) registered 00100000:10000000:0.0:1789403528.903920:0:22765:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x23:0x0] (16/1) registered 00100000:10000000:0.0:1789403528.904286:0:22765:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x28:0x0] (24/16) registered 00100000:10000000:0.0:1789403528.904731:0:22765:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1b:0x0] (16/1) registered 00100000:10000000:0.0:1789403528.905214:0:22765:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x33:0x0] (24/16) registered 00100000:10000000:0.0:1789403528.905601:0:22765:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x17:0x0] (16/1) registered 00100000:10000000:0.0:1789403528.905868:0:22765:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x14:0x0] (16/1) registered 00100000:10000000:0.0:1789403528.906284:0:22765:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x20:0x0] (16/1) registered 00100000:10000000:0.0:1789403528.906729:0:22765:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2e:0x0] (24/16) registered 00100000:10000000:0.0:1789403528.906958:0:22765:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1f:0x0] (16/1) registered 00100000:10000000:0.0:1789403528.907382:0:22765:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x19:0x0] (16/1) registered 00100000:10000000:0.0:1789403528.907812:0:22765:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2c:0x0] (24/16) registered 00100000:10000000:0.0:1789403528.908195:0:22765:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x30:0x0] (24/16) registered 00100000:10000000:0.0:1789403528.908554:0:22765:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2f:0x0] (24/16) registered 00100000:10000000:0.0:1789403528.908839:0:22765:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x29:0x0] (24/16) registered 00100000:10000000:0.0:1789403528.909094:0:22765:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x32:0x0] (24/16) registered 00100000:10000000:0.0:1789403528.911719:0:22765:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x22:0x0] (16/1) registered 00100000:10000000:0.0:1789403528.912719:0:22765:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2b:0x0] (24/16) registered 00100000:10000000:0.0:1789403528.913048:0:22765:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x34:0x0] (24/16) registered 00100000:10000000:1.0:1789403528.919563:0:22765:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x25:0x0] (24/16) registered 00100000:10000000:1.0:1789403528.922237:0:22765:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x18:0x0] (16/1) registered 00100000:10000000:1.0:1789403528.923794:0:22765:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x31:0x0] (24/16) registered 00100000:10000000:1.0:1789403528.924280:0:22765:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2a:0x0] (24/16) registered 00100000:10000000:1.0:1789403528.924770:0:22765:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1e:0x0] (16/1) registered 00100000:10000000:1.0:1789403528.925035:0:22765:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x26:0x0] (24/16) registered 00100000:10000000:1.0:1789403528.925316:0:22765:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1a:0x0] (16/1) registered 00100000:10000000:1.0:1789403528.925805:0:22765:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1d:0x0] (16/1) registered 00100000:10000000:1.0:1789403528.926179:0:22765:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1c:0x0] (16/1) registered 00100000:10000000:1.0:1789403528.926526:0:22765:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x16:0x0] (16/1) registered 00100000:10000000:1.0:1789403528.926845:0:22765:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x15:0x0] (16/1) registered 00100000:10000000:1.0:1789403528.927204:0:22765:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x27:0x0] (24/16) registered 00100000:10000000:1.0:1789403528.927769:0:22765:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2d:0x0] (24/16) registered 00100000:10000000:1.0:1789403528.929307:0:22765:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2:0x0] (8/32) registered 00100000:10000000:1.0:1789403528.930891:0:22765:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x1010000:0x0] (8/32) registered 00100000:10000000:1.0:1789403528.931691:0:22765:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x10000:0x0] (8/32) registered 00100000:10000000:1.0:1789403528.932193:0:22765:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x2010000:0x0] (8/32) registered 00100000:10000000:1.0:1789403528.932829:0:22765:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x2020000:0x0] (8/32) registered 00100000:10000000:1.0:1789403528.933186:0:22765:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x20000:0x0] (8/32) registered 00100000:10000000:1.0:1789403528.933381:0:22765:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x1020000:0x0] (8/32) registered 00080000:01000000:1.0:1789403528.937086:0:22765:0:(osd_lproc.c:911:osd_procfs_init()) lustre-MDT0000: register osd-ldiskfs tunable parameters 00000020:00000080:1.0:1789403528.937378:0:22765:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:1.0:1789403528.937386:0:22765:0:(osd_handler.c:8924:osd_obd_connect()) connect #0 00000020:00000080:1.0:1789403528.938185:0:22765:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x5fb08b1e5b7624ee 00000020:01000004:1.0:1789403528.938196:0:22765:0:(tgt_mount.c:2587:server_fill_super()) Found service lustre-MDT0000 on device /dev/mapper/mds1_flakey 00000020:01000000:1.0:1789403528.938201:0:22765:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:1.0:1789403528.938207:0:22765:0:(tgt_mount.c:101:server_register_mount()) register mount ffff90a144559800 from MGS 00000020:01000004:1.0:1789403528.938211:0:22765:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:1.0:1789403528.938232:0:22765:0:(genops.c:413:class_newdev()) Allocate new device MGS (ffff90a28180cd40) 00000020:00000080:1.0:1789403528.938244:0:22765:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:1.0:1789403528.938310:0:22765:0:(tgt_mount.c:153:server_get_mount()) get mount ffff90a144559800 from MGS, refs=2 00080000:01000000:1.0:1789403528.938315:0:22765:0:(osd_handler.c:8924:osd_obd_connect()) connect #1 00000020:00000080:1.0:1789403528.938321:0:22765:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x5fb08b1e5b7624fc 00000100:00100000:1.0:1789403528.938802:0:22765:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:1.0:1789403528.938946:0:22765:0:(service.c:3467:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:1.0:1789403528.938953:0:22765:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:2.0:1789403528.943283:0:22765:0:(service.c:3467:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:2.0:1789403528.943294:0:22765:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:2.0:1789403528.944360:0:22765:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1789403528.944826:0:22765:0:(service.c:3467:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:2.0:1789403528.944831:0:22765:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:2.0:1789403528.946768:0:22765:0:(service.c:3467:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:2.0:1789403528.946780:0:22765:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:2.0:1789403528.951918:0:22765:0:(service.c:3467:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:2.0:1789403528.951944:0:22765:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:3.0:1789403528.953325:0:22774:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789403528.953329:0:22774:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789403528.953331:0:22774:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789403528.953937:0:22775:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789403528.953941:0:22775:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789403528.953942:0:22775:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789403528.955302:0:22765:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00010000:00010000:1.0:1789403528.961299:0:22774:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:01000000:3.0:1789403528.977596:0:22765:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 10000000:01000000:3.0:1789403528.979682:0:22777:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:2.0:1789403528.979749:0:22765:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:2.0:1789403528.979798:0:22765:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:2.0:1789403528.981145:0:22765:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:2.0:1789403528.981899:0:22765:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1789403528.982281:0:22765:0:(service.c:3467:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:2.0:1789403528.982288:0:22765:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:3.0:1789403528.989595:0:22765:0:(service.c:3467:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:3.0:1789403528.989621:0:22765:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:2.0:1789403528.992061:0:22765:0:(service.c:3467:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:2.0:1789403528.992073:0:22765:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:2.0:1789403528.993329:0:22765:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:2.0:1789403528.993349:0:22765:0:(obd_mount.c:411:lustre_start_mgc()) Start MGC 'MGC192.168.203.143@tcp' 00000020:01000004:2.0:1789403528.993351:0:22765:0:(obd_mount.c:420:lustre_start_mgc()) mgs NIDs (null). 00000020:01000004:2.0:1789403528.993575:0:22765:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGC192.168.203.143@tcp (typ=mgc) 00000020:00000080:2.0:1789403528.993590:0:22765:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.203.143@tcp (ffff90a27e00b380) 00000020:00000080:2.0:1789403528.993668:0:22765:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00010000:00080000:2.0:1789403528.993747:0:22765:0:(ldlm_lib.c:102:import_set_conn()) imp ffff90a277e0d800@MGC192.168.203.143@tcp: add connection 192.168.203.143@tcp at head 00010000:00010000:2.0:1789403528.993890:0:22765:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.203.143@tcp-0 is initialized 00000040:01000000:2.0:1789403528.993895:0:22765:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.143@tcp ctxt 1 is initialized 10000000:01000000:0.0:1789403528.997085:0:22783:0:(mgc_request.c:631:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:2.0:1789403528.997214:0:22765:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.203.143@tcp (uuid 7ccb4038-daf9-4dcd-9b85-da9390181204) 00000020:00000080:2.0:1789403528.997246:0:22765:0:(genops.c:1384:class_connect()) connect: client 7ccb4038-daf9-4dcd-9b85-da9390181204, cookie 0x5fb08b1e5b76250a 00000100:00080000:2.0:1789403528.997257:0:22765:0:(import.c:545:import_select_connection()) MGC192.168.203.143@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1789403528.997268:0:22765:0:(import.c:666:import_select_connection()) MGC192.168.203.143@tcp: import ffff90a277e0d800 using connection 192.168.203.143@tcp/0@lo 00000100:00100000:2.0:1789403528.997300:0:22765:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff90a27a64ed80 x1876325050831872/t0(0) o250->MGC192.168.203.143@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1789403528.997329:0:22765:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import 7ccb4038-daf9-4dcd-9b85-da9390181204->MGS 00000020:01000004:2.0:1789403528.997350:0:22765:0:(tgt_mount.c:1808:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:2.0:1789403528.997355:0:22765:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:2.0:1789403528.997367:0:22765:0:(genops.c:413:class_newdev()) Allocate new device MDS (ffff90a27e00cd40) 00000020:00000080:2.0:1789403528.997378:0:22765:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00100000:0.0:1789403528.997672:0:3625:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a27a64ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:7ccb4038-daf9-4dcd-9b85-da9390181204:3625:1876325050831872:0@lo:250:mount.lustre.0 00000100:00100000:0.0:1789403528.997732:0:3625:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789403528.997807:0:22778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050831872 00000100:00100000:0.0:1789403528.997815:0:22778:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050831872 00000100:00100000:0.0:1789403528.997844:0:22778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1789403528.997851:0:22778:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a277f41850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3625:x1876325050831872:12345-0@lo:250:mount.lustre.0 00010000:00080000:0.0:1789403528.997870:0:22778:0:(ldlm_lib.c:1453:target_handle_connect()) MGS: connection from 7ccb4038-daf9-4dcd-9b85-da9390181204@0@lo t0 exp 0000000000000000 cur 574 last 0 00000020:00000080:0.0:1789403528.997891:0:22778:0:(genops.c:1384:class_connect()) connect: client 7ccb4038-daf9-4dcd-9b85-da9390181204, cookie 0x5fb08b1e5b762518 00000100:00080000:1.0:1789403528.998311:0:22782:0:(pinger.c:466:ping_evictor_main()) Starting Ping Evictor 00000100:00080000:0.0:1789403529.000289:0:22778:0:(import.c:65:import_set_state_nolock()) ffff90a14368a000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1789403529.000375:0:22778:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a277f41850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7ccb4038-daf9-4dcd-9b85-da9390181204+5:3625:x1876325050831872:12345-0@lo:250:mount.lustre.0 Request processed in 2522us (2642us total) trans 0 rc 0/0 00000100:00100000:0.0:1789403529.000385:0:22778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1789403529.002038:0:3625:0:(client.c:3126:ptlrpc_free_committed()) MGC192.168.203.143@tcp: committing for last_committed 0 gen 1 00000100:00080000:0.0:1789403529.002051:0:3625:0:(import.c:1177:ptlrpc_connect_interpret()) MGC192.168.203.143@tcp: connect to target with instance 0 00000100:00080000:0.0:1789403529.002058:0:3625:0:(import.c:1001:ptlrpc_connect_set_flags()) MGC192.168.203.143@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:0.0:1789403529.002063:0:3625:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:0.0:1789403529.002067:0:3625:0:(import.c:65:import_set_state_nolock()) ffff90a277e0d800 MGS: changing import state from CONNECTING to FULL 10000000:01000000:0.0:1789403529.002070:0:3625:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:0.0:1789403529.002088:0:3625:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:0.0:1789403529.002095:0:3625:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a27a64ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:7ccb4038-daf9-4dcd-9b85-da9390181204:3625:1876325050831872:0@lo:250:mount.lustre.0 00000100:00100000:2.0:1789403529.013822:0:22765:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1789403529.014771:0:22765:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:2.0:1789403529.014779:0:22765:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:0.0:1789403529.027701:0:22765:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:0.0:1789403529.027716:0:22765:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:1.0:1789403529.029543:0:22765:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:1.0:1789403529.029553:0:22765:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:1.0:1789403529.031791:0:22765:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1789403529.032089:0:22765:0:(service.c:3467:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:1.0:1789403529.032095:0:22765:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:1.0:1789403529.032870:0:22765:0:(service.c:3467:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:1.0:1789403529.032878:0:22765:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:2.0:1789403529.101324:0:22765:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1789403529.101560:0:22765:0:(service.c:3467:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:2.0:1789403529.101573:0:22765:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:0.0:1789403529.103305:0:22765:0:(service.c:3467:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:0.0:1789403529.103319:0:22765:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:2.0:1789403529.105676:0:22765:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1789403529.105869:0:22765:0:(service.c:3467:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:2.0:1789403529.105876:0:22765:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:0.0:1789403529.107191:0:22765:0:(service.c:3467:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:0.0:1789403529.107202:0:22765:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:1.0:1789403529.108011:0:22765:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1789403529.108309:0:22765:0:(service.c:3467:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:1.0:1789403529.108321:0:22765:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:1.0:1789403529.109770:0:22765:0:(service.c:3467:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:1.0:1789403529.109780:0:22765:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:2.0:1789403529.110779:0:22765:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1789403529.111784:0:22765:0:(service.c:3467:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:2.0:1789403529.111793:0:22765:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:2.0:1789403529.118896:0:22765:0:(service.c:3467:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:2.0:1789403529.118912:0:22765:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:2.0:1789403529.153251:0:22765:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1789403529.153491:0:22765:0:(service.c:3467:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:2.0:1789403529.153498:0:22765:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:1.0:1789403529.159210:0:22765:0:(service.c:3467:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:1.0:1789403529.159239:0:22765:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:1.0:1789403529.169877:0:22765:0:(service.c:3467:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:1.0:1789403529.169894:0:22765:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:1.0:1789403529.171042:0:22765:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:1.0:1789403529.171071:0:22765:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/mds1_flakey 10000000:01000000:1.0:1789403529.171077:0:22765:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.143@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:1.0:1789403529.171188:0:22765:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.143@tcp ctxt 0 is initialized 00000020:01000004:1.0:1789403529.171234:0:22765:0:(tgt_mount.c:1416:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.203.143@tcp, index=0000, flags=0x20005 00000020:01000004:1.0:1789403529.171239:0:22765:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:1.0:1789403529.171240:0:22765:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1789403529.171242:0:22765:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1789403529.171243:0:22765:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1789403529.171244:0:22765:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1789403529.171245:0:22765:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1789403529.171247:0:22765:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1789403529.171248:0:22765:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1789403529.171250:0:22765:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1789403529.171252:0:22765:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1789403529.171254:0:22765:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020005 00000020:01000004:1.0:1789403529.171257:0:22765:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1789403529.171258:0:22765:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1789403529.171259:0:22765:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1789403529.171261:0:22765:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1789403529.171262:0:22765:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1789403529.171263:0:22765:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1789403529.171264:0:22765:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1789403529.171265:0:22765:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1789403529.171266:0:22765:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1789403529.171267:0:22765:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1789403529.171291:0:22765:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:1.0:1789403529.171310:0:22765:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a141aaf100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7ccb4038-daf9-4dcd-9b85-da9390181204:22765:1876325050832000:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1789403529.171372:0:22765:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789403529.171450:0:22765:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a246bf8c00 going to sleep for 11 seconds 00000100:00100000:3.0:1789403529.172227:0:22781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050832000 00000100:00100000:3.0:1789403529.172235:0:22781:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050832000 00000100:00100000:3.0:1789403529.172284:0:22781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1789403529.172294:0:22781:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a277f43050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7ccb4038-daf9-4dcd-9b85-da9390181204+5:22765:x1876325050832000:12345-0@lo:253:mount.lustre.0 20000000:01000000:3.0:1789403529.172342:0:22781:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:3.0:1789403529.172345:0:22781:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:3.0:1789403529.172348:0:22781:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-MDT0000 is running on 0@lo 10000000:01000000:3.0:1789403529.173299:0:22802:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:2.0:1789403529.174075:0:22781:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 10 20000000:01000000:2.0:1789403529.176716:0:22803:0:(mgs_llog.c:340:mgs_fsdb_handler()) MDT index is 0 20000000:01000000:2.0:1789403529.176723:0:22803:0:(mgs_llog.c:340:mgs_fsdb_handler()) MDT index is 1 20000000:01000000:2.0:1789403529.176726:0:22803:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0000_UUID is 0 (0) 20000000:01000000:2.0:1789403529.176729:0:22803:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0001_UUID is 1 (1) 00000040:00080000:2.0:1789403529.176949:0:22803:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 20000000:01000000:3.0:1789403529.177170:0:22781:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:3.0:1789403529.177180:0:22781:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:3.0:1789403529.179701:0:22781:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a277f43050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7ccb4038-daf9-4dcd-9b85-da9390181204+5:22765:x1876325050832000:12345-0@lo:253:mount.lustre.0 Request processed in 7398us (8318us total) trans 0 rc 0/0 00000100:00100000:3.0:1789403529.179718:0:22781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1789403529.179906:0:22765:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a141aaf100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7ccb4038-daf9-4dcd-9b85-da9390181204:22765:1876325050832000:0@lo:253:mount.lustre.0 10000000:01000000:1.0:1789403529.179921:0:22765:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:1.0:1789403529.180205:0:22765:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1789403529.180209:0:22765:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1789403529.180210:0:22765:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1789403529.180212:0:22765:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1789403529.180213:0:22765:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1789403529.180223:0:22765:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1789403529.180225:0:22765:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1789403529.180226:0:22765:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1789403529.180228:0:22765:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1789403529.180229:0:22765:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:1.0:1789403529.180254:0:22765:0:(tgt_mount.c:101:server_register_mount()) register mount ffff90a144559800 from lustre-MDT0000 10000000:01000000:1.0:1789403529.180285:0:22765:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:1.0:1789403529.180288:0:22765:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:1.0:1789403529.180292:0:22765:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffff90a27e00b380 10000000:01000000:1.0:1789403529.180297:0:22765:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1789403529.180305:0:22765:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff90a27e00b380 from 1 10000000:01000000:1.0:1789403529.180308:0:22765:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:1.0:1789403529.180343:0:22765:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.143@tcp lock: ffff90a144063400/0x5fb08b1e5b76251f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403529.180354:0:22765:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.143@tcp lock: ffff90a144063400/0x5fb08b1e5b76251f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403529.180363:0:22765:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.143@tcp lock: ffff90a144063400/0x5fb08b1e5b76251f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789403529.180384:0:22765:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a141aaf100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7ccb4038-daf9-4dcd-9b85-da9390181204:22765:1876325050832128:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1789403529.181273:0:22765:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789403529.181304:0:22765:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a246bf8240 going to sleep for 11 seconds 00000100:00100000:0.0:1789403529.181685:0:22778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050832128 00000100:00100000:0.0:1789403529.181693:0:22778:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050832128 00000100:00100000:0.0:1789403529.181741:0:22778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1789403529.181751:0:22778:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a277f43c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7ccb4038-daf9-4dcd-9b85-da9390181204+5:22765:x1876325050832128:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1789403529.181765:0:22778:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789403529.181782:0:22778:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90a248af0c00/0x5fb08b1e5b762526 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x5fb08b1e5b76251f expref: -99 pid: 22778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403529.181806:0:22778:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90a248af0c00/0x5fb08b1e5b762526 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5fb08b1e5b76251f expref: 6 pid: 22778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403529.181818:0:22778:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90a248af0c00/0x5fb08b1e5b762526 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5fb08b1e5b76251f expref: 6 pid: 22778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403529.181827:0:22778:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a248af0c00, rc 0) 00000100:00100000:0.0:1789403529.181932:0:22778:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a277f43c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7ccb4038-daf9-4dcd-9b85-da9390181204+6:22765:x1876325050832128:12345-0@lo:101:mount.lustre.0 Request processed in 182us (658us total) trans 0 rc 0/0 00000100:00100000:0.0:1789403529.181939:0:22778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1789403529.183555:0:22765:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a141aaf100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7ccb4038-daf9-4dcd-9b85-da9390181204:22765:1876325050832128:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1789403529.183579:0:22765:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.143@tcp lock: ffff90a144063400/0x5fb08b1e5b76251f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb08b1e5b762526 expref: -99 pid: 22765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403529.183590:0:22765:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.143@tcp lock: ffff90a144063400/0x5fb08b1e5b76251f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x5fb08b1e5b762526 expref: -99 pid: 22765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789403529.183738:0:22765:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a27a64f480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7ccb4038-daf9-4dcd-9b85-da9390181204:22765:1876325050832256:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789403529.183786:0:22765:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789403529.183878:0:22765:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a248244480 going to sleep for 11 seconds 00000100:00100000:3.0:1789403529.183921:0:22781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050832256 00000100:00100000:3.0:1789403529.184049:0:22781:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050832256 00000100:00100000:3.0:1789403529.184145:0:22781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1789403529.184155:0:22781:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a277f40c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7ccb4038-daf9-4dcd-9b85-da9390181204+6:22765:x1876325050832256:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789403529.184252:0:22781:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a277f40c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7ccb4038-daf9-4dcd-9b85-da9390181204+6:22765:x1876325050832256:12345-0@lo:501:mount.lustre.0 Request processed in 98us (466us total) trans 0 rc -2/-2 00000100:00100000:3.0:1789403529.184260:0:22781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1789403529.184325:0:22765:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a27a64f480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7ccb4038-daf9-4dcd-9b85-da9390181204:22765:1876325050832256:0@lo:501:mount.lustre.0 10000000:01000000:2.0:1789403529.184353:0:22765:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.143@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:2.0:1789403529.184372:0:22765:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.143@tcp lock: ffff90a144063400/0x5fb08b1e5b76251f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb08b1e5b762526 expref: -99 pid: 22765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403529.184426:0:22765:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.143@tcp lock: ffff90a144063400/0x5fb08b1e5b76251f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb08b1e5b762526 expref: -99 pid: 22765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789403529.184442:0:22765:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff90a144559800 10000000:01000000:2.0:1789403529.184447:0:22765:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:2.0:1789403529.184452:0:22765:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff90a144559800 10000000:01000000:2.0:1789403529.184455:0:22765:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:2.0:1789403529.184458:0:22765:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff90a144559800 from 1 10000000:01000000:2.0:1789403529.184461:0:22765:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:2.0:1789403529.184487:0:22765:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.143@tcp lock: ffff90a270184a00/0x5fb08b1e5b76252d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403529.184495:0:22765:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.143@tcp lock: ffff90a270184a00/0x5fb08b1e5b76252d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403529.184503:0:22765:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.143@tcp lock: ffff90a270184a00/0x5fb08b1e5b76252d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789403529.184516:0:22765:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a27a64f480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7ccb4038-daf9-4dcd-9b85-da9390181204:22765:1876325050832384:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1789403529.184541:0:22765:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789403529.185186:0:22765:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a248244480 going to sleep for 11 seconds 00000100:00100000:0.0:1789403529.185310:0:22778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050832384 00000100:00100000:0.0:1789403529.185316:0:22778:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050832384 00000100:00100000:0.0:1789403529.185343:0:22778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1789403529.185351:0:22778:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a277f42850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7ccb4038-daf9-4dcd-9b85-da9390181204+6:22765:x1876325050832384:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1789403529.185361:0:22778:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789403529.185381:0:22778:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90a248af0a00/0x5fb08b1e5b762534 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x5fb08b1e5b76252d expref: -99 pid: 22778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403529.185651:0:22778:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90a248af0a00/0x5fb08b1e5b762534 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5fb08b1e5b76252d expref: 7 pid: 22778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403529.185661:0:22778:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90a248af0a00/0x5fb08b1e5b762534 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5fb08b1e5b76252d expref: 7 pid: 22778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403529.185668:0:22778:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a248af0a00, rc 0) 00000100:00100000:0.0:1789403529.185713:0:22778:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a277f42850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7ccb4038-daf9-4dcd-9b85-da9390181204+7:22765:x1876325050832384:12345-0@lo:101:mount.lustre.0 Request processed in 363us (1171us total) trans 0 rc 0/0 00000100:00100000:0.0:1789403529.185719:0:22778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1789403529.185833:0:22765:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a27a64f480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7ccb4038-daf9-4dcd-9b85-da9390181204:22765:1876325050832384:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1789403529.185848:0:22765:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.143@tcp lock: ffff90a270184a00/0x5fb08b1e5b76252d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb08b1e5b762534 expref: -99 pid: 22765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403529.185858:0:22765:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.143@tcp lock: ffff90a270184a00/0x5fb08b1e5b76252d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x5fb08b1e5b762534 expref: -99 pid: 22765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789403529.185884:0:22765:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.143@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:2.0:1789403529.185900:0:22765:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.143@tcp lock: ffff90a270184a00/0x5fb08b1e5b76252d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb08b1e5b762534 expref: -99 pid: 22765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403529.185909:0:22765:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.143@tcp lock: ffff90a270184a00/0x5fb08b1e5b76252d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb08b1e5b762534 expref: -99 pid: 22765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789403529.185916:0:22765:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:2.0:1789403529.185920:0:22765:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1789403529.185934:0:22765:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff90a144559800 10000000:01000000:2.0:1789403529.185937:0:22765:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:2.0:1789403529.185941:0:22765:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:2.0:1789403529.185943:0:22765:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:2.0:1789403529.185960:0:22765:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.143@tcp lock: ffff90a270184800/0x5fb08b1e5b76253b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403529.185979:0:22765:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.143@tcp lock: ffff90a270184800/0x5fb08b1e5b76253b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403529.185986:0:22765:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.143@tcp lock: ffff90a270184800/0x5fb08b1e5b76253b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789403529.186001:0:22765:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a27a64f480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7ccb4038-daf9-4dcd-9b85-da9390181204:22765:1876325050832512:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1789403529.186028:0:22765:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789403529.186047:0:22765:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a248244480 going to sleep for 11 seconds 00000100:00100000:0.0:1789403529.186318:0:22778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050832512 00000100:00100000:0.0:1789403529.186323:0:22778:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050832512 00000100:00100000:0.0:1789403529.186346:0:22778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1789403529.186353:0:22778:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a26c7fd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7ccb4038-daf9-4dcd-9b85-da9390181204+7:22765:x1876325050832512:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1789403529.186361:0:22778:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789403529.186369:0:22778:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90a248af1a00/0x5fb08b1e5b762542 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x5fb08b1e5b76253b expref: -99 pid: 22778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403529.186384:0:22778:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90a248af1a00/0x5fb08b1e5b762542 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5fb08b1e5b76253b expref: 8 pid: 22778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403529.186424:0:22778:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90a248af1a00/0x5fb08b1e5b762542 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5fb08b1e5b76253b expref: 8 pid: 22778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403529.186431:0:22778:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a248af1a00, rc 0) 00000100:00100000:0.0:1789403529.186472:0:22778:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a26c7fd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7ccb4038-daf9-4dcd-9b85-da9390181204+8:22765:x1876325050832512:12345-0@lo:101:mount.lustre.0 Request processed in 119us (443us total) trans 0 rc 0/0 00000100:00100000:0.0:1789403529.186487:0:22778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1789403529.186747:0:22765:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a27a64f480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7ccb4038-daf9-4dcd-9b85-da9390181204:22765:1876325050832512:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1789403529.186760:0:22765:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.143@tcp lock: ffff90a270184800/0x5fb08b1e5b76253b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb08b1e5b762542 expref: -99 pid: 22765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403529.186774:0:22765:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.143@tcp lock: ffff90a270184800/0x5fb08b1e5b76253b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x5fb08b1e5b762542 expref: -99 pid: 22765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789403529.186827:0:22765:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a27a64f480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7ccb4038-daf9-4dcd-9b85-da9390181204:22765:1876325050832640:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789403529.186853:0:22765:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789403529.186870:0:22765:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a248244480 going to sleep for 11 seconds 00000100:00100000:3.0:1789403529.186922:0:22781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050832640 00000100:00100000:3.0:1789403529.186927:0:22781:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050832640 00000100:00100000:3.0:1789403529.186961:0:22781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1789403529.186978:0:22781:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a26c7ff050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7ccb4038-daf9-4dcd-9b85-da9390181204+8:22765:x1876325050832640:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789403529.187102:0:22781:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a26c7ff050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7ccb4038-daf9-4dcd-9b85-da9390181204+9:22765:x1876325050832640:12345-0@lo:501:mount.lustre.0 Request processed in 125us (248us total) trans 0 rc 0/0 00000100:00100000:2.0:1789403529.187276:0:22765:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a27a64f480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7ccb4038-daf9-4dcd-9b85-da9390181204:22765:1876325050832640:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789403529.187305:0:22765:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a27a64f480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7ccb4038-daf9-4dcd-9b85-da9390181204:22765:1876325050832768:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1789403529.187344:0:22765:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789403529.187354:0:22765:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a248244480 going to sleep for 11 seconds 00000100:00100000:3.0:1789403529.187630:0:22781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1789403529.187662:0:22781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050832768 00000100:00100000:3.0:1789403529.187666:0:22781:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050832768 00000100:00100000:3.0:1789403529.187683:0:22781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1789403529.187688:0:22781:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a26c7fc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7ccb4038-daf9-4dcd-9b85-da9390181204+9:22765:x1876325050832768:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1789403529.189235:0:22781:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a26c7fc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7ccb4038-daf9-4dcd-9b85-da9390181204+9:22765:x1876325050832768:12345-0@lo:503:mount.lustre.0 Request processed in 1539us (1883us total) trans 0 rc 0/0 00000100:00100000:3.0:1789403529.189247:0:22781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1789403529.189575:0:22765:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a27a64f480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7ccb4038-daf9-4dcd-9b85-da9390181204:22765:1876325050832768:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1789403529.190208:0:22804:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a144bef480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7ccb4038-daf9-4dcd-9b85-da9390181204:22804:1876325050832896:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789403529.190274:0:22804:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789403529.190348:0:22804:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a277b00480 going to sleep for 11 seconds 00000100:00100000:2.0:1789403529.190586:0:22778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050832896 00000100:00100000:2.0:1789403529.190593:0:22778:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050832896 00000100:00100000:2.0:1789403529.190746:0:22778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1789403529.190756:0:22778:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a26c7fe050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7ccb4038-daf9-4dcd-9b85-da9390181204+9:22804:x1876325050832896:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789403529.192027:0:22778:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a26c7fe050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7ccb4038-daf9-4dcd-9b85-da9390181204+9:22804:x1876325050832896:12345-0@lo:502:llog_process_th.0 Request processed in 1268us (1748us total) trans 0 rc 0/0 00000100:00100000:2.0:1789403529.192038:0:22778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1789403529.192296:0:22804:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a144bef480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7ccb4038-daf9-4dcd-9b85-da9390181204:22804:1876325050832896:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1789403529.192331:0:22804:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789403529.192342:0:22804:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789403529.192344:0:22804:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:0.0:1789403529.192349:0:22804:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:0.0:1789403529.192352:0:22804:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1789403529.192366:0:22804:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (ffff90a26065cd40) 00000020:00000080:0.0:1789403529.192381:0:22804:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:0.0:1789403529.192416:0:22804:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:0.0:1789403529.192520:0:22804:0:(osd_handler.c:8924:osd_obd_connect()) connect #2 00000020:00000080:0.0:1789403529.192529:0:22804:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x5fb08b1e5b762550 00000020:00000080:0.0:1789403529.192737:0:22804:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:0.0:1789403529.192742:0:22804:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789403529.192745:0:22804:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789403529.192747:0:22804:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:0.0:1789403529.192750:0:22804:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789403529.192754:0:22804:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789403529.192755:0:22804:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:0.0:1789403529.192759:0:22804:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1789403529.192766:0:22804:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (ffff90a260658000) 00000020:00000080:0.0:1789403529.192777:0:22804:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:0.0:1789403529.192781:0:22804:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:0.0:1789403529.192783:0:22804:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:0.0:1789403529.192786:0:22804:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:0.0:1789403529.192791:0:22804:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:0.0:1789403529.192837:0:22804:0:(tgt_mount.c:153:server_get_mount()) get mount ffff90a144559800 from lustre-MDT0000, refs=3 00000020:00000080:0.0:1789403529.192855:0:22804:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (ffff90a26065b380) 00000020:00000080:0.0:1789403529.192863:0:22804:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:0.0:1789403529.192923:0:22804:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:0.0:1789403529.192929:0:22804:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x5fb08b1e5b762565 00000020:00000080:0.0:1789403529.193260:0:22804:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:0.0:1789403529.193267:0:22804:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:0.0:1789403529.193272:0:22804:0:(genops.c:1384:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0x5fb08b1e5b76256c 00080000:01000000:0.0:1789403529.193277:0:22804:0:(osd_handler.c:8924:osd_obd_connect()) connect #3 00000020:00000080:0.0:1789403529.193281:0:22804:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x5fb08b1e5b762573 00010000:00010000:2.0:1789403529.300161:0:22804:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:00000004:2.0:1789403529.301666:0:22804:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 3, last_transno is 8589934629 00000001:00080000:2.0:1789403529.303873:0:22804:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:2.0:1789403529.307007:0:22804:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (ffff90a27e0099c0) 00000020:00000080:2.0:1789403529.307030:0:22804:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:2.0:1789403529.307409:0:22804:0:(osd_handler.c:8924:osd_obd_connect()) connect #4 00000020:00000080:2.0:1789403529.307423:0:22804:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x5fb08b1e5b762581 00000020:00000080:2.0:1789403529.310093:0:22804:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:3.0:1789403529.327233:0:22804:0:(genops.c:1384:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0x5fb08b1e5b762588 00000020:00000080:3.0:1789403529.334622:0:22804:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:3.0:1789403529.334635:0:22804:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789403529.334645:0:22804:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789403529.334647:0:22804:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:3.0:1789403529.334651:0:22804:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:3.0:1789403529.334665:0:22804:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #9 00000020:01000000:3.0:1789403529.334668:0:22804:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1789403529.334669:0:22804:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1789403529.334671:0:22804:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:3.0:1789403529.334674:0:22804:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789403529.334676:0:22804:0:(obd_config.c:1563:class_process_config()) marker 9 (0x6) lustre sys.timeout 00000020:01000000:3.0:1789403529.334679:0:22804:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789403529.334684:0:22804:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789403529.334686:0:22804:0:(obd_config.c:1563:class_process_config()) marker 10 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:3.0:1789403529.334690:0:22804:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:3.0:1789403529.334744:0:22804:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:3.0:1789403529.334759:0:22804:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789403529.334762:0:22804:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789403529.334764:0:22804:0:(obd_config.c:1563:class_process_config()) marker 10 (0x2) lustre-MDT0000 mdt.identity_upcall 00000020:01000000:3.0:1789403529.334767:0:22804:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789403529.334770:0:22804:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789403529.334771:0:22804:0:(obd_config.c:1563:class_process_config()) marker 17 (0x1) lustre-MDT0001 add osp 00000020:00000080:3.0:1789403529.334775:0:22804:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1789403529.334780:0:22804:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.203.143@tcp to nid 0x20000c0a8cb8f (192.168.203.143@tcp) 00000020:00000080:3.0:1789403529.334818:0:22804:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1789403529.334833:0:22804:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-osp-MDT0000 (ffff90a27c360000) 00000020:00000080:3.0:1789403529.334850:0:22804:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type osp with refcount 2 00000020:00000080:3.0:1789403529.334856:0:22804:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1789403529.334910:0:22804:0:(osp_dev.c:1203:osp_init0()) lustre-MDT0001-osp-MDT0000: connect to lustre-MDT0000-osd (lustre-MDT0001-osp-MDT0000) 00080000:01000000:3.0:1789403529.334917:0:22804:0:(osd_handler.c:8924:osd_obd_connect()) connect #5 00000020:00000080:3.0:1789403529.334935:0:22804:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x5fb08b1e5b762596 00010000:00080000:3.0:1789403529.334991:0:22804:0:(ldlm_lib.c:102:import_set_conn()) imp ffff90a27dbdd800@lustre-MDT0001-osp-MDT0000: add connection 192.168.203.143@tcp at head 00010000:00010000:3.0:1789403529.336657:0:22804:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-osp-MDT0000-1 is initialized 00000020:00000080:1.0:1789403529.354267:0:22804:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-osp-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1789403529.354293:0:22804:0:(obd_config.c:1472:class_process_config()) processing cmd: cf014 00000004:01000000:1.0:1789403529.354347:0:22804:0:(lod_lov.c:128:lod_add_device()) osp:lustre-MDT0001_UUID idx:1 gen:1 00000020:00000080:1.0:1789403529.354367:0:22804:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x5fb08b1e5b76259d 00000100:00080000:1.0:1789403529.354376:0:22804:0:(import.c:545:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1789403529.354417:0:22804:0:(import.c:666:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff90a27dbdd800 using connection 192.168.203.143@tcp/0@lo 00000100:00100000:1.0:1789403529.354453:0:22804:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff90a141aaf480 x1876325050833024/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1789403529.354475:0:22804:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID 00000020:01000000:1.0:1789403529.354536:0:22804:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789403529.354540:0:22804:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789403529.354542:0:22804:0:(obd_config.c:1563:class_process_config()) marker 17 (0x2) lustre-MDT0001 add osp 00000020:01000000:1.0:1789403529.354545:0:22804:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:1.0:1789403529.354548:0:22804:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #20 00000020:01000000:1.0:1789403529.354550:0:22804:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1789403529.354551:0:22804:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1789403529.354552:0:22804:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:1.0:1789403529.354555:0:22804:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789403529.354556:0:22804:0:(obd_config.c:1563:class_process_config()) marker 20 (0x6) lustre sys.timeout 00000020:01000000:1.0:1789403529.354559:0:22804:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1789403529.354563:0:22804:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:1.0:1789403529.354566:0:22804:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789403529.354567:0:22804:0:(obd_config.c:1563:class_process_config()) marker 22 (0x1) lustre-OST0000 add osc 00000020:00000080:1.0:1789403529.354570:0:22804:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1789403529.354573:0:22804:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.203.143@tcp to nid 0x20000c0a8cb8f (192.168.203.143@tcp) 00000020:01000000:1.0:1789403529.354593:0:22804:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:1.0:1789403529.354595:0:22804:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1789403529.354606:0:22804:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff90a281808000) 00000020:00000080:1.0:1789403529.354617:0:22804:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osp with refcount 2 00000020:00000080:1.0:1789403529.354622:0:22804:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1789403529.354674:0:22804:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:1.0:1789403529.354680:0:22804:0:(osd_handler.c:8924:osd_obd_connect()) connect #6 00000020:00000080:1.0:1789403529.354691:0:22804:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x5fb08b1e5b7625ab 00010000:00080000:1.0:1789403529.354729:0:22804:0:(ldlm_lib.c:102:import_set_conn()) imp ffff90a143719000@lustre-OST0000-osc-MDT0000: add connection 192.168.203.143@tcp at head 00010000:00010000:1.0:1789403529.354933:0:22804:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-2 is initialized 00000100:00100000:0.0:1789403529.355550:0:3625:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a141aaf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3625:1876325050833024:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1789403529.355612:0:3625:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789403529.355882:0:22791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050833024 00000100:00100000:0.0:1789403529.355889:0:22791:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050833024 00000100:00100000:0.0:1789403529.355957:0:22791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1789403529.355965:0:22791:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a144bef480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3625:x1876325050833024:12345-0@lo:38:llog_process_th.0 00010000:00020000:0.0:1789403529.355980:0:22791:0:(ldlm_lib.c:1199:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000040:01000000:1.0:1789403529.360709:0:22804:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000100:00100000:0.0:1789403529.365963:0:22791:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a144bef480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3625:x1876325050833024:12345-0@lo:38:llog_process_th.0 Request processed in 9990us (10342us total) trans 0 rc -19/-19 00000100:00100000:0.0:1789403529.365978:0:22791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00080000:2.0:1789403529.366094:0:3625:0:(import.c:65:import_set_state_nolock()) ffff90a27dbdd800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1789403529.366101:0:3625:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1789403529.366105:0:3625:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a141aaf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3625:1876325050833024:0@lo:38:llog_process_th.0 00000040:01000000:1.0:1789403529.369070:0:22804:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:2.0:1789403529.372927:0:22804:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1789403529.373313:0:22804:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].3, 64 off8384 00000040:00080000:2.0:1789403529.384136:0:22804:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x10:0x0].1, 64 off8256 00000040:00080000:1.0:1789403529.385476:0:22810:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:1.0:1789403529.385483:0:22810:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x10:0x0] at index 3 of catalog [0x1:0x2:0x0] 00000020:00000080:3.0:1789403529.390053:0:22804:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1789403529.390068:0:22804:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:3.0:1789403529.390115:0:22804:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:3.0:1789403529.390137:0:22804:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x5fb08b1e5b7625b2 00000100:00080000:3.0:1789403529.390147:0:22804:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1789403529.390160:0:22804:0:(import.c:666:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff90a143719000 using connection 192.168.203.143@tcp/0@lo 00000100:00100000:3.0:1789403529.390196:0:22804:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff90a144b2ad80 x1876325050833152/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1789403529.390236:0:22804:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:3.0:1789403529.390304:0:22804:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789403529.390308:0:22804:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789403529.390310:0:22804:0:(obd_config.c:1563:class_process_config()) marker 22 (0x2) lustre-OST0000 add osc 00000020:01000000:3.0:1789403529.390313:0:22804:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:3.0:1789403529.390316:0:22804:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #28 00000020:01000000:3.0:1789403529.390317:0:22804:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1789403529.390318:0:22804:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1789403529.390320:0:22804:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:3.0:1789403529.390322:0:22804:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789403529.390324:0:22804:0:(obd_config.c:1563:class_process_config()) marker 28 (0x6) lustre sys.timeout 00000020:01000000:3.0:1789403529.390327:0:22804:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1789403529.390330:0:22804:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:3.0:1789403529.390334:0:22804:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789403529.390348:0:22804:0:(obd_config.c:1563:class_process_config()) marker 30 (0x1) lustre-OST0001 add osc 00000020:00000080:3.0:1789403529.390352:0:22804:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1789403529.390356:0:22804:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.203.143@tcp to nid 0x20000c0a8cb8f (192.168.203.143@tcp) 00000020:01000000:3.0:1789403529.390375:0:22804:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:3.0:1789403529.390377:0:22804:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1789403529.390422:0:22804:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff90a27c364d40) 00000020:00000080:3.0:1789403529.390435:0:22804:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type osp with refcount 2 00000020:00000080:3.0:1789403529.390440:0:22804:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1789403529.390495:0:22804:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:3.0:1789403529.390501:0:22804:0:(osd_handler.c:8924:osd_obd_connect()) connect #7 00000020:00000080:3.0:1789403529.390506:0:22804:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x5fb08b1e5b7625c0 00010000:00080000:3.0:1789403529.390534:0:22804:0:(ldlm_lib.c:102:import_set_conn()) imp ffff90a2488fd000@lustre-OST0001-osc-MDT0000: add connection 192.168.203.143@tcp at head 00010000:00010000:3.0:1789403529.390750:0:22804:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-3 is initialized 00000040:01000000:3.0:1789403529.390816:0:22804:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:3.0:1789403529.390830:0:22804:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000100:00100000:2.0:1789403529.391036:0:3625:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a144b2ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3625:1876325050833152:0@lo:8:llog_process_th.0 00000400:00000100:2.0:1789403529.391098:0:3625:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1876325050833152 offset 0 length 520: 4 00000040:00080000:3.0:1789403529.401642:0:22804:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1789403529.404199:0:22804:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].3, 64 off8384 00000040:00080000:3.0:1789403529.404431:0:22804:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x12:0x0].1, 64 off8256 00000040:00080000:1.0:1789403529.405766:0:22812:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:1.0:1789403529.405773:0:22812:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x12:0x0] at index 3 of catalog [0x1:0x5:0x0] 00000020:00000080:2.0:1789403529.407065:0:22804:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1789403529.407077:0:22804:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:2.0:1789403529.407115:0:22804:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:2.0:1789403529.407135:0:22804:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x5fb08b1e5b7625c7 00000100:00080000:2.0:1789403529.407144:0:22804:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1789403529.407156:0:22804:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff90a2488fd000 using connection 192.168.203.143@tcp/0@lo 00000100:00100000:2.0:1789403529.407202:0:22804:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff90a27a64f480 x1876325050833280/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1789403529.407242:0:22804:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:2.0:1789403529.407308:0:22804:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789403529.407313:0:22804:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789403529.407315:0:22804:0:(obd_config.c:1563:class_process_config()) marker 30 (0x2) lustre-OST0001 add osc 00000020:01000000:2.0:1789403529.407318:0:22804:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789403529.407322:0:22804:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789403529.407324:0:22804:0:(obd_config.c:1563:class_process_config()) marker 37 (0x1) lustre sys.timeout 00000020:00000080:2.0:1789403529.407327:0:22804:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1789403529.407329:0:22804:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:2.0:1789403529.407331:0:22804:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789403529.407334:0:22804:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789403529.407343:0:22804:0:(obd_config.c:1563:class_process_config()) marker 37 (0x2) lustre sys.timeout 00000020:01000000:2.0:1789403529.407346:0:22804:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789403529.407350:0:22804:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789403529.407351:0:22804:0:(obd_config.c:1563:class_process_config()) marker 42 (0x1) lustre sys.jobid_var 00000020:00000080:2.0:1789403529.407356:0:22804:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:2.0:1789403529.407423:0:22804:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a27a64ce00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7ccb4038-daf9-4dcd-9b85-da9390181204:22804:1876325050833408:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789403529.407497:0:22804:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789403529.407536:0:22804:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a270148e40 going to sleep for 11 seconds 00000100:00100000:1.0:1789403529.407725:0:22780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050833408 00000100:00100000:1.0:1789403529.407734:0:22780:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050833408 00000100:00100000:0.0:1789403529.407784:0:3625:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a27a64f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3625:1876325050833280:0@lo:8:llog_process_th.0 00000100:00100000:1.0:1789403529.407786:0:22780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1789403529.407795:0:22780:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a26c7fe450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7ccb4038-daf9-4dcd-9b85-da9390181204+9:22804:x1876325050833408:12345-0@lo:502:llog_process_th.0 00000400:00000100:0.0:1789403529.407813:0:3625:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1876325050833280 offset 0 length 520: 4 00000100:00100000:1.0:1789403529.407913:0:22780:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a26c7fe450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7ccb4038-daf9-4dcd-9b85-da9390181204+9:22804:x1876325050833408:12345-0@lo:502:llog_process_th.0 Request processed in 118us (415us total) trans 0 rc 0/0 00000100:00100000:1.0:1789403529.407920:0:22780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1789403529.408241:0:22804:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a27a64ce00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7ccb4038-daf9-4dcd-9b85-da9390181204:22804:1876325050833408:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1789403529.408269:0:22804:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789403529.408275:0:22804:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789403529.408277:0:22804:0:(obd_config.c:1563:class_process_config()) marker 42 (0x2) lustre sys.jobid_var 00000040:00080000:2.0:1789403529.408282:0:22804:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 46 count 46 00000020:01000000:1.0:1789403529.408548:0:22765:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-45 (rc=0) 10000000:01000000:1.0:1789403529.408568:0:22765:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.143@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:1.0:1789403529.408590:0:22765:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.143@tcp lock: ffff90a270184800/0x5fb08b1e5b76253b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb08b1e5b762542 expref: -99 pid: 22765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403529.408600:0:22765:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.143@tcp lock: ffff90a270184800/0x5fb08b1e5b76253b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb08b1e5b762542 expref: -99 pid: 22765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789403529.408607:0:22765:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff90a144559800 from 1 10000000:01000000:1.0:1789403529.408610:0:22765:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1789403529.408636:0:22765:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.143@tcp lock: ffff90a144062800/0x5fb08b1e5b7625ce lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403529.408643:0:22765:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.143@tcp lock: ffff90a144062800/0x5fb08b1e5b7625ce lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403529.408658:0:22765:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.143@tcp lock: ffff90a144062800/0x5fb08b1e5b7625ce lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789403529.408672:0:22765:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a141aaca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7ccb4038-daf9-4dcd-9b85-da9390181204:22765:1876325050833536:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1789403529.408704:0:22765:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789403529.408899:0:22765:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a2484c7e40 going to sleep for 11 seconds 00000100:00100000:2.0:1789403529.409208:0:22778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050833536 00000100:00100000:2.0:1789403529.409226:0:22778:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050833536 00000100:00100000:2.0:1789403529.409267:0:22778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1789403529.409274:0:22778:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a26c7fe850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7ccb4038-daf9-4dcd-9b85-da9390181204+9:22765:x1876325050833536:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1789403529.409286:0:22778:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789403529.409301:0:22778:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90a270184400/0x5fb08b1e5b7625d5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x5fb08b1e5b7625ce expref: -99 pid: 22778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403529.409321:0:22778:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90a270184400/0x5fb08b1e5b7625d5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5fb08b1e5b7625ce expref: 10 pid: 22778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403529.409331:0:22778:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90a270184400/0x5fb08b1e5b7625d5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5fb08b1e5b7625ce expref: 10 pid: 22778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403529.409340:0:22778:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a270184400, rc 0) 00000100:00100000:2.0:1789403529.409423:0:22778:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a26c7fe850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7ccb4038-daf9-4dcd-9b85-da9390181204+10:22765:x1876325050833536:12345-0@lo:101:mount.lustre.0 Request processed in 115us (683us total) trans 0 rc 0/0 00000100:00100000:2.0:1789403529.409441:0:22778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1789403529.409507:0:22765:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a141aaca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7ccb4038-daf9-4dcd-9b85-da9390181204:22765:1876325050833536:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1789403529.409521:0:22765:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.143@tcp lock: ffff90a144062800/0x5fb08b1e5b7625ce lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb08b1e5b7625d5 expref: -99 pid: 22765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403529.409530:0:22765:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.143@tcp lock: ffff90a144062800/0x5fb08b1e5b7625ce lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x5fb08b1e5b7625d5 expref: -99 pid: 22765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789403529.410101:0:22765:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a144bef100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7ccb4038-daf9-4dcd-9b85-da9390181204:22765:1876325050833664:0@lo:256:mount.lustre.0 00000100:00100000:0.0:1789403529.410142:0:22765:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789403529.410221:0:22781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050833664 00000100:00100000:3.0:1789403529.410226:0:22781:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050833664 00000100:00100000:0.0:1789403529.410250:0:22765:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a248262c00 going to sleep for 11 seconds 00000100:00100000:3.0:1789403529.410259:0:22781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1789403529.410266:0:22781:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a26c7fdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7ccb4038-daf9-4dcd-9b85-da9390181204+10:22765:x1876325050833664:12345-0@lo:256:mount.lustre.0 20000000:01000000:3.0:1789403529.410280:0:22781:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:3.0:1789403529.410294:0:22781:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:3.0:1789403529.410365:0:22781:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a26c7fdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7ccb4038-daf9-4dcd-9b85-da9390181204+10:22765:x1876325050833664:12345-0@lo:256:mount.lustre.0 Request processed in 99us (222us total) trans 0 rc 0/0 00000100:00100000:3.0:1789403529.410372:0:22781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1789403529.412781:0:22765:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a144bef100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7ccb4038-daf9-4dcd-9b85-da9390181204:22765:1876325050833664:0@lo:256:mount.lustre.0 10000000:01000000:0.0:1789403529.413359:0:22765:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.143@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1789403529.413515:0:22765:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.143@tcp lock: ffff90a144062800/0x5fb08b1e5b7625ce lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb08b1e5b7625d5 expref: -99 pid: 22765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403529.413527:0:22765:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.143@tcp lock: ffff90a144062800/0x5fb08b1e5b7625ce lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb08b1e5b7625d5 expref: -99 pid: 22765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789403529.413535:0:22765:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff90a144559800 from 1 10000000:01000000:0.0:1789403529.413538:0:22765:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1789403529.413574:0:22765:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.143@tcp lock: ffff90a248af1600/0x5fb08b1e5b7625dc lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403529.413582:0:22765:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.143@tcp lock: ffff90a248af1600/0x5fb08b1e5b7625dc lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403529.413590:0:22765:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.143@tcp lock: ffff90a248af1600/0x5fb08b1e5b7625dc lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789403529.413611:0:22765:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a144bef100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7ccb4038-daf9-4dcd-9b85-da9390181204:22765:1876325050833792:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1789403529.413669:0:22765:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789403529.413711:0:22765:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a248262c00 going to sleep for 11 seconds 00000100:00100000:3.0:1789403529.413885:0:22780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050833792 00000100:00100000:3.0:1789403529.413893:0:22780:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050833792 00000100:00100000:3.0:1789403529.413940:0:22780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1789403529.413949:0:22780:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a26c7fec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7ccb4038-daf9-4dcd-9b85-da9390181204+10:22765:x1876325050833792:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1789403529.413962:0:22780:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789403529.413977:0:22780:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90a259947800/0x5fb08b1e5b7625e3 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x5fb08b1e5b7625dc expref: -99 pid: 22780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403529.414001:0:22780:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90a259947800/0x5fb08b1e5b7625e3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5fb08b1e5b7625dc expref: 11 pid: 22780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403529.414012:0:22780:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90a259947800/0x5fb08b1e5b7625e3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5fb08b1e5b7625dc expref: 11 pid: 22780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403529.414020:0:22780:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a259947800, rc 0) 00000100:00100000:3.0:1789403529.414064:0:22780:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a26c7fec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7ccb4038-daf9-4dcd-9b85-da9390181204+11:22765:x1876325050833792:12345-0@lo:101:mount.lustre.0 Request processed in 116us (395us total) trans 0 rc 0/0 00000100:00100000:3.0:1789403529.414071:0:22780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1789403529.416355:0:22765:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a144bef100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7ccb4038-daf9-4dcd-9b85-da9390181204:22765:1876325050833792:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1789403529.416382:0:22765:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.143@tcp lock: ffff90a248af1600/0x5fb08b1e5b7625dc lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb08b1e5b7625e3 expref: -99 pid: 22765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403529.416440:0:22765:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.143@tcp lock: ffff90a248af1600/0x5fb08b1e5b7625dc lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x5fb08b1e5b7625e3 expref: -99 pid: 22765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789403529.416540:0:22765:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a144bef100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7ccb4038-daf9-4dcd-9b85-da9390181204:22765:1876325050833920:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789403529.416593:0:22765:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789403529.416642:0:22765:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a248262c00 going to sleep for 11 seconds 00000100:00100000:3.0:1789403529.416951:0:22778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050833920 00000100:00100000:3.0:1789403529.416958:0:22778:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050833920 00000100:00100000:3.0:1789403529.416997:0:22778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1789403529.417005:0:22778:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a26c7ffc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7ccb4038-daf9-4dcd-9b85-da9390181204+11:22765:x1876325050833920:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789403529.417139:0:22778:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a26c7ffc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7ccb4038-daf9-4dcd-9b85-da9390181204+11:22765:x1876325050833920:12345-0@lo:501:mount.lustre.0 Request processed in 134us (546us total) trans 0 rc 0/0 00000100:00100000:3.0:1789403529.417146:0:22778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1789403529.417511:0:22765:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a144bef100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7ccb4038-daf9-4dcd-9b85-da9390181204:22765:1876325050833920:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789403529.417546:0:22765:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a144bef100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7ccb4038-daf9-4dcd-9b85-da9390181204:22765:1876325050834048:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1789403529.417586:0:22765:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789403529.417614:0:22765:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a248262c00 going to sleep for 11 seconds 00000100:00100000:2.0:1789403529.422325:0:22781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050834048 00000100:00100000:2.0:1789403529.422340:0:22781:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050834048 00000100:00100000:2.0:1789403529.422423:0:22781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1789403529.422433:0:22781:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a26c7fc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7ccb4038-daf9-4dcd-9b85-da9390181204+11:22765:x1876325050834048:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1789403529.422601:0:22781:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a26c7fc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7ccb4038-daf9-4dcd-9b85-da9390181204+11:22765:x1876325050834048:12345-0@lo:503:mount.lustre.0 Request processed in 170us (5014us total) trans 0 rc 0/0 00000100:00100000:2.0:1789403529.422609:0:22781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1789403529.422661:0:22765:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a144bef100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7ccb4038-daf9-4dcd-9b85-da9390181204:22765:1876325050834048:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1789403529.423176:0:22814:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a141aaca80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7ccb4038-daf9-4dcd-9b85-da9390181204:22814:1876325050834176:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789403529.423234:0:22814:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789403529.423272:0:22814:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a2484c7180 going to sleep for 11 seconds 00000100:00100000:2.0:1789403529.423322:0:22780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050834176 00000100:00100000:2.0:1789403529.423327:0:22780:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050834176 00000100:00100000:2.0:1789403529.423361:0:22780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1789403529.423369:0:22780:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a26c7fcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7ccb4038-daf9-4dcd-9b85-da9390181204+11:22814:x1876325050834176:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789403529.423997:0:22780:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a26c7fcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7ccb4038-daf9-4dcd-9b85-da9390181204+11:22814:x1876325050834176:12345-0@lo:502:llog_process_th.0 Request processed in 627us (761us total) trans 0 rc 0/0 00000100:00100000:2.0:1789403529.424007:0:22780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1789403529.424093:0:22814:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a141aaca80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7ccb4038-daf9-4dcd-9b85-da9390181204:22814:1876325050834176:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1789403529.424119:0:22814:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789403529.424128:0:22814:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789403529.424130:0:22814:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:1.0:1789403529.424138:0:22814:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff90a144559800 00000020:00000080:1.0:1789403529.424141:0:22814:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1789403529.424148:0:22814:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789403529.424151:0:22814:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789403529.424153:0:22814:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:1.0:1789403529.424155:0:22814:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789403529.424158:0:22814:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789403529.424159:0:22814:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:1.0:1789403529.424162:0:22814:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff90a144559800 00000020:00000080:1.0:1789403529.424164:0:22814:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1789403529.424233:0:22814:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789403529.424237:0:22814:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789403529.424239:0:22814:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:1.0:1789403529.424251:0:22814:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789403529.424255:0:22814:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789403529.424256:0:22814:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1789403529.424261:0:22814:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff90a144559800 00000020:00000080:1.0:1789403529.424263:0:22814:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1789403529.424285:0:22814:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789403529.424288:0:22814:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789403529.424289:0:22814:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1789403529.424291:0:22814:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789403529.424294:0:22814:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789403529.424295:0:22814:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:1.0:1789403529.424298:0:22814:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff90a144559800 00000020:00000080:1.0:1789403529.424300:0:22814:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1789403529.424336:0:22814:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a141aaca80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7ccb4038-daf9-4dcd-9b85-da9390181204:22814:1876325050834304:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789403529.424373:0:22814:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789403529.424444:0:22814:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a2484c7180 going to sleep for 11 seconds 00000100:00100000:3.0:1789403529.424455:0:22778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050834304 00000100:00100000:3.0:1789403529.424462:0:22778:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050834304 00000100:00100000:3.0:1789403529.424507:0:22778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1789403529.424516:0:22778:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a26c7fc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7ccb4038-daf9-4dcd-9b85-da9390181204+11:22814:x1876325050834304:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789403529.424613:0:22778:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a26c7fc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7ccb4038-daf9-4dcd-9b85-da9390181204+11:22814:x1876325050834304:12345-0@lo:502:llog_process_th.0 Request processed in 97us (238us total) trans 0 rc 0/0 00000100:00100000:3.0:1789403529.424620:0:22778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1789403529.424749:0:22814:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a141aaca80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7ccb4038-daf9-4dcd-9b85-da9390181204:22814:1876325050834304:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1789403529.424771:0:22814:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789403529.424776:0:22814:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789403529.424778:0:22814:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:1.0:1789403529.424782:0:22814:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 13 count 13 00000020:01000000:3.0:1789403529.424947:0:22765:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:3.0:1789403529.424971:0:22765:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.143@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1789403529.424991:0:22765:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.143@tcp lock: ffff90a248af1600/0x5fb08b1e5b7625dc lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb08b1e5b7625e3 expref: -99 pid: 22765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403529.425003:0:22765:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.143@tcp lock: ffff90a248af1600/0x5fb08b1e5b7625dc lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb08b1e5b7625e3 expref: -99 pid: 22765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789403529.425053:0:22765:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:3.0:1789403529.425056:0:22765:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff90a144559800 10000000:01000000:3.0:1789403529.425059:0:22765:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff90a144559800 10000000:01000000:3.0:1789403529.425063:0:22765:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1789403529.425068:0:22765:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff90a144559800 from 1 10000000:01000000:3.0:1789403529.425071:0:22765:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1789403529.425099:0:22765:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.143@tcp lock: ffff90a259946c00/0x5fb08b1e5b7625ea lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403529.425107:0:22765:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.143@tcp lock: ffff90a259946c00/0x5fb08b1e5b7625ea lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403529.425117:0:22765:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.143@tcp lock: ffff90a259946c00/0x5fb08b1e5b7625ea lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789403529.425150:0:22765:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a144b29500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7ccb4038-daf9-4dcd-9b85-da9390181204:22765:1876325050834432:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1789403529.425195:0:22765:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789403529.425230:0:22765:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a27a7d1780 going to sleep for 11 seconds 00000100:00100000:0.0:1789403529.425293:0:22778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050834432 00000100:00100000:0.0:1789403529.425298:0:22778:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050834432 00000100:00100000:0.0:1789403529.425338:0:22778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1789403529.425346:0:22778:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a26c7ff850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7ccb4038-daf9-4dcd-9b85-da9390181204+11:22765:x1876325050834432:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1789403529.425355:0:22778:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789403529.425368:0:22778:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90a248af1e00/0x5fb08b1e5b7625f1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x5fb08b1e5b7625ea expref: -99 pid: 22778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403529.425420:0:22778:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90a248af1e00/0x5fb08b1e5b7625f1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5fb08b1e5b7625ea expref: 12 pid: 22778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403529.425432:0:22778:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90a248af1e00/0x5fb08b1e5b7625f1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5fb08b1e5b7625ea expref: 12 pid: 22778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403529.425441:0:22778:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a248af1e00, rc 0) 00000100:00100000:0.0:1789403529.425475:0:22778:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a26c7ff850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7ccb4038-daf9-4dcd-9b85-da9390181204+12:22765:x1876325050834432:12345-0@lo:101:mount.lustre.0 Request processed in 130us (279us total) trans 0 rc 0/0 00000100:00100000:0.0:1789403529.425480:0:22778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1789403529.425559:0:22765:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a144b29500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7ccb4038-daf9-4dcd-9b85-da9390181204:22765:1876325050834432:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1789403529.425571:0:22765:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.143@tcp lock: ffff90a259946c00/0x5fb08b1e5b7625ea lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb08b1e5b7625f1 expref: -99 pid: 22765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403529.425580:0:22765:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.143@tcp lock: ffff90a259946c00/0x5fb08b1e5b7625ea lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x5fb08b1e5b7625f1 expref: -99 pid: 22765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789403529.425625:0:22765:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a144b29500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7ccb4038-daf9-4dcd-9b85-da9390181204:22765:1876325050834560:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789403529.425647:0:22765:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789403529.425674:0:22765:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a27a7d1780 going to sleep for 11 seconds 00000100:00100000:0.0:1789403529.425725:0:22780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050834560 00000100:00100000:0.0:1789403529.425730:0:22780:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050834560 00000100:00100000:0.0:1789403529.425757:0:22780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1789403529.425763:0:22780:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a26c7ff450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7ccb4038-daf9-4dcd-9b85-da9390181204+12:22765:x1876325050834560:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789403529.425858:0:22780:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a26c7ff450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7ccb4038-daf9-4dcd-9b85-da9390181204+12:22765:x1876325050834560:12345-0@lo:501:mount.lustre.0 Request processed in 95us (209us total) trans 0 rc 0/0 00000100:00100000:0.0:1789403529.425873:0:22780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1789403529.426015:0:22765:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a144b29500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7ccb4038-daf9-4dcd-9b85-da9390181204:22765:1876325050834560:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789403529.426040:0:22765:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a144b29500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7ccb4038-daf9-4dcd-9b85-da9390181204:22765:1876325050834688:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1789403529.426075:0:22765:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789403529.426098:0:22765:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a27a7d1780 going to sleep for 11 seconds 00000100:00100000:0.0:1789403529.426152:0:22781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050834688 00000100:00100000:0.0:1789403529.426157:0:22781:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050834688 00000100:00100000:0.0:1789403529.426194:0:22781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1789403529.426200:0:22781:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a24344e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7ccb4038-daf9-4dcd-9b85-da9390181204+12:22765:x1876325050834688:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1789403529.426283:0:22781:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a24344e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7ccb4038-daf9-4dcd-9b85-da9390181204+12:22765:x1876325050834688:12345-0@lo:503:mount.lustre.0 Request processed in 83us (207us total) trans 0 rc 0/0 00000100:00100000:0.0:1789403529.426290:0:22781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1789403529.426424:0:22765:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a144b29500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7ccb4038-daf9-4dcd-9b85-da9390181204:22765:1876325050834688:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1789403529.426769:0:22815:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a144b29500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7ccb4038-daf9-4dcd-9b85-da9390181204:22815:1876325050834816:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789403529.426801:0:22815:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789403529.426830:0:22815:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a27a7d1600 going to sleep for 11 seconds 00000100:00100000:0.0:1789403529.426878:0:22778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050834816 00000100:00100000:0.0:1789403529.426883:0:22778:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050834816 00000100:00100000:0.0:1789403529.426915:0:22778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1789403529.426922:0:22778:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a24344f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7ccb4038-daf9-4dcd-9b85-da9390181204+12:22815:x1876325050834816:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789403529.427006:0:22778:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a24344f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7ccb4038-daf9-4dcd-9b85-da9390181204+12:22815:x1876325050834816:12345-0@lo:502:llog_process_th.0 Request processed in 84us (204us total) trans 0 rc 0/0 00000100:00100000:0.0:1789403529.427014:0:22778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1789403529.427097:0:22815:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a144b29500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7ccb4038-daf9-4dcd-9b85-da9390181204:22815:1876325050834816:0@lo:502:llog_process_th.0 00000020:01000004:3.0:1789403529.427151:0:22815:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:3.0:1789403529.427184:0:22815:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (ffff90a27c3619c0) 00000020:00000080:3.0:1789403529.427204:0:22815:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type lwp with refcount 2 00000020:01000004:3.0:1789403529.427311:0:22815:0:(tgt_mount.c:153:server_get_mount()) get mount ffff90a144559800 from lustre-MDT0000, refs=4 00000020:01000004:3.0:1789403529.427315:0:22815:0:(tgt_mount.c:187:server_put_mount()) put mount ffff90a144559800 from lustre-MDT0000, refs=4 00000020:01000004:3.0:1789403529.427317:0:22815:0:(obd_mount.c:710:lustre_put_lsi()) put ffff90a144559800 4 00010000:00080000:3.0:1789403529.427350:0:22815:0:(ldlm_lib.c:102:import_set_conn()) imp ffff90a281b14000@lustre-MDT0000-lwp-MDT0000: add connection 192.168.203.143@tcp at head 00010000:00010000:3.0:1789403529.429013:0:22815:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-4 is initialized 00000020:00000080:3.0:1789403529.429205:0:22815:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:3.0:1789403529.429258:0:22815:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1789403529.429271:0:22815:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0x5fb08b1e5b7625ff 00000100:00080000:3.0:1789403529.429280:0:22815:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1789403529.429289:0:22815:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff90a281b14000 using connection 192.168.203.143@tcp/0@lo 00000100:00100000:3.0:1789403529.429321:0:22815:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff90a144b29500 x1876325050834944/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1789403529.429344:0:22815:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:0.0:1789403529.429599:0:3625:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a144b29500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3625:1876325050834944:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1789403529.429659:0:3625:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789403529.433763:0:22786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050834944 00000100:00100000:3.0:1789403529.433776:0:22786:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050834944 00000100:00100000:3.0:1789403529.433814:0:22786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1789403529.433822:0:22786:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a144bef800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3625:x1876325050834944:12345-0@lo:38:llog_process_th.0 00000100:00100000:3.0:1789403529.433963:0:22786:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a144bef800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3625:x1876325050834944:12345-0@lo:38:llog_process_th.0 Request processed in 140us (4303us total) trans 0 rc -11/-11 00000100:00100000:3.0:1789403529.433969:0:22786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1789403529.434100:0:22815:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a144b28700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7ccb4038-daf9-4dcd-9b85-da9390181204:22815:1876325050835072:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789403529.434147:0:22815:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789403529.437283:0:22780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050835072 00000100:00100000:3.0:1789403529.437298:0:22780:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050835072 00000100:00100000:3.0:1789403529.437358:0:22780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1789403529.437369:0:22780:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a24344ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7ccb4038-daf9-4dcd-9b85-da9390181204+12:22815:x1876325050835072:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789403529.437555:0:22780:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a24344ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7ccb4038-daf9-4dcd-9b85-da9390181204+12:22815:x1876325050835072:12345-0@lo:502:llog_process_th.0 Request processed in 189us (3407us total) trans 0 rc 0/0 00000100:00100000:3.0:1789403529.437563:0:22780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1789403529.437638:0:22815:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a27a7d1900 going to sleep for 11 seconds 00000100:00100000:3.0:1789403529.437663:0:22815:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a144b28700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7ccb4038-daf9-4dcd-9b85-da9390181204:22815:1876325050835072:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789403529.437730:0:22815:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a144b28700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7ccb4038-daf9-4dcd-9b85-da9390181204:22815:1876325050835200:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789403529.437778:0:22815:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789403529.437801:0:22781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050835200 00000100:00100000:3.0:1789403529.437804:0:22781:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050835200 00000100:00100000:3.0:1789403529.437828:0:22781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1789403529.437835:0:22781:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a24344d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7ccb4038-daf9-4dcd-9b85-da9390181204+12:22815:x1876325050835200:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789403529.437908:0:22781:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a24344d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7ccb4038-daf9-4dcd-9b85-da9390181204+12:22815:x1876325050835200:12345-0@lo:502:llog_process_th.0 Request processed in 73us (130us total) trans 0 rc 0/0 00000100:00100000:3.0:1789403529.437915:0:22781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1789403529.437954:0:22815:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a27a7d1900 going to sleep for 11 seconds 00000100:00100000:3.0:1789403529.437966:0:22815:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a144b28700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:7ccb4038-daf9-4dcd-9b85-da9390181204:22815:1876325050835200:0@lo:502:llog_process_th.0 00000040:00080000:3.0:1789403529.437983:0:22815:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 00000100:00100000:1.0:1789403529.439334:0:3625:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1789403529.439344:0:3625:0:(import.c:65:import_set_state_nolock()) ffff90a281b14000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1789403529.439350:0:3625:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:1.0:1789403529.439353:0:3625:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a144b29500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3625:1876325050834944:0@lo:38:llog_process_th.0 00000020:01000000:0.0:1789403529.439560:0:22765:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:0.0:1789403529.439587:0:22765:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.143@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1789403529.439619:0:22765:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.143@tcp lock: ffff90a259946c00/0x5fb08b1e5b7625ea lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb08b1e5b7625f1 expref: -99 pid: 22765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403529.439630:0:22765:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.143@tcp lock: ffff90a259946c00/0x5fb08b1e5b7625ea lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb08b1e5b7625f1 expref: -99 pid: 22765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1789403529.439676:0:22765:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:0.0:1789403529.439682:0:22765:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1789403529.439684:0:22765:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789403529.439685:0:22765:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789403529.439686:0:22765:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789403529.439687:0:22765:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789403529.439688:0:22765:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1789403529.439689:0:22765:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1789403529.439691:0:22765:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789403529.439692:0:22765:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1789403529.439695:0:22765:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020005 00000020:01000004:0.0:1789403529.439698:0:22765:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1789403529.439699:0:22765:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1789403529.439699:0:22765:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789403529.439700:0:22765:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789403529.439701:0:22765:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789403529.439702:0:22765:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789403529.439703:0:22765:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1789403529.439704:0:22765:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1789403529.439705:0:22765:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789403529.439706:0:22765:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1789403529.439725:0:22765:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:0.0:1789403529.439738:0:22765:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a144bece00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7ccb4038-daf9-4dcd-9b85-da9390181204:22765:1876325050835328:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1789403529.439789:0:22765:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789403529.439820:0:22765:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a248262c00 going to sleep for 11 seconds 00000100:00100000:3.0:1789403529.441384:0:22778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050835328 00000100:00100000:3.0:1789403529.441417:0:22778:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050835328 00000100:00100000:3.0:1789403529.441464:0:22778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1789403529.441474:0:22778:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a242b64450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7ccb4038-daf9-4dcd-9b85-da9390181204+12:22765:x1876325050835328:12345-0@lo:253:mount.lustre.0 20000000:01000000:3.0:1789403529.441502:0:22778:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:3.0:1789403529.441515:0:22778:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:1.0:1789403529.444332:0:22778:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:1.0:1789403529.444350:0:22778:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:1.0:1789403529.444877:0:22778:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a242b64450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7ccb4038-daf9-4dcd-9b85-da9390181204+12:22765:x1876325050835328:12345-0@lo:253:mount.lustre.0 Request processed in 3401us (5084us total) trans 0 rc 0/0 00000100:00100000:1.0:1789403529.444900:0:22778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1789403529.448119:0:22765:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a144bece00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7ccb4038-daf9-4dcd-9b85-da9390181204:22765:1876325050835328:0@lo:253:mount.lustre.0 10000000:01000000:1.0:1789403529.448139:0:22765:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:1.0:1789403529.448142:0:22765:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1789403529.448144:0:22765:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1789403529.448146:0:22765:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1789403529.448147:0:22765:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1789403529.448148:0:22765:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1789403529.448150:0:22765:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1789403529.448151:0:22765:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1789403529.448152:0:22765:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1789403529.448155:0:22765:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1789403529.448156:0:22765:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:1.0:1789403529.448169:0:22765:0:(tgt_mount.c:2694:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 20000000:01000000:3.0:1789403529.449291:0:22802:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:3.0:1789403529.449299:0:22802:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:3.0:1789403529.449325:0:22802:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff90a259947600/0x5fb08b1e5b762606 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 22802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403529.449343:0:22802:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff90a270184400/0x5fb08b1e5b7625d5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5fb08b1e5b7625ce expref: 11 pid: 22778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403529.449351:0:22802:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff90a259947600/0x5fb08b1e5b762606 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 22802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403529.449401:0:22802:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff90a270184400/0x5fb08b1e5b7625d5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5fb08b1e5b7625ce expref: 11 pid: 22778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403529.449416:0:22802:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff90a270184400/0x5fb08b1e5b7625d5 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5fb08b1e5b7625ce expref: 11 pid: 22778 timeout: 675 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789403529.449430:0:22802:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a144b28700 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22802:1876325050835456:0@lo:104: 00000100:00100000:3.0:1789403529.449486:0:22802:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789403529.449525:0:22802:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a27a7d1900 going to sleep for 11 seconds 00000100:00100000:1.0:1789403529.456568:0:22769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050835456 00000100:00100000:1.0:1789403529.456580:0:22769:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050835456 00000100:00100000:1.0:1789403529.456628:0:22769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1789403529.456637:0:22769:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a144b28a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:7ccb4038-daf9-4dcd-9b85-da9390181204+3:22802:x1876325050835456:12345-0@lo:104: 00010000:00010000:1.0:1789403529.456653:0:22769:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.143@tcp lock: ffff90a144062800/0x5fb08b1e5b7625ce lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x5fb08b1e5b7625d5 expref: -99 pid: 22765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403529.456736:0:22769:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1789403529.456742:0:22769:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a144b28a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:7ccb4038-daf9-4dcd-9b85-da9390181204+3:22802:x1876325050835456:12345-0@lo:104: Request processed in 106us (7255us total) trans 0 rc 0/0 00000100:00100000:1.0:1789403529.456748:0:22769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1789403529.456802:0:22802:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a144b28700 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22802:1876325050835456:0@lo:104: 00010000:00010000:1.0:1789403529.456824:0:22802:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff90a259947600/0x5fb08b1e5b762606 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 22802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403529.457275:0:22775:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789403529.457284:0:22775:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.143@tcp lock: ffff90a144062800/0x5fb08b1e5b7625ce lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x5fb08b1e5b7625d5 expref: -99 pid: 22765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403529.457567:0:22775:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a144062800 already unused, calling callback (ffffffffc120dc20) 10000000:00010000:2.0:1789403529.457572:0:22775:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.143@tcp lock: ffff90a144062800/0x5fb08b1e5b7625ce lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x5fb08b1e5b7625d5 expref: -99 pid: 22765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403529.457581:0:22775:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.143@tcp lock: ffff90a144062800/0x5fb08b1e5b7625ce lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x5fb08b1e5b7625d5 expref: -99 pid: 22765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789403529.457589:0:22775:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.143@tcp lock: ffff90a144062800/0x5fb08b1e5b7625ce lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x5fb08b1e5b7625d5 expref: -99 pid: 22765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789403529.457603:0:22775:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1789403529.457638:0:22775:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.143@tcp lock: ffff90a144062800/0x5fb08b1e5b7625ce lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5fb08b1e5b7625d5 expref: -99 pid: 22765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403529.457644:0:22775:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789403529.457665:0:22775:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.143@tcp lock: ffff90a144062800/0x5fb08b1e5b7625ce lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5fb08b1e5b7625d5 expref: -99 pid: 22765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403529.457672:0:22775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.143@tcp lock: ffff90a144062800/0x5fb08b1e5b7625ce lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5fb08b1e5b7625d5 expref: -99 pid: 22765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403529.457691:0:22775:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789403529.457693:0:22775:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789403529.457696:0:22775:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789403529.457732:0:3626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a27a64ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7ccb4038-daf9-4dcd-9b85-da9390181204:3626:1876325050835584:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789403529.457779:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789403529.457821:0:22771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050835584 00000100:00100000:0.0:1789403529.457828:0:22771:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050835584 00010000:00010000:0.0:1789403529.457853:0:22771:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff90a270184400/0x5fb08b1e5b7625d5 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5fb08b1e5b7625ce expref: 12 pid: 22778 timeout: 675 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789403529.457880:0:22771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1789403529.457888:0:22771:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a27a64e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7ccb4038-daf9-4dcd-9b85-da9390181204+12:3626:x1876325050835584:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789403529.457898:0:22771:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789403529.457903:0:22771:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff90a270184400/0x5fb08b1e5b7625d5 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5fb08b1e5b7625ce expref: 12 pid: 22778 timeout: 675 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403529.457935:0:22771:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff90a270184400/0x5fb08b1e5b7625d5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5fb08b1e5b7625ce expref: 12 pid: 22778 timeout: 675 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403529.457948:0:22771:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90a270184400/0x5fb08b1e5b7625d5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5fb08b1e5b7625ce expref: 12 pid: 22778 timeout: 675 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403529.457961:0:22771:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff90a259947600/0x5fb08b1e5b762606 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 22802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403529.457968:0:22771:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90a259947600/0x5fb08b1e5b762606 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 22802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1789403529.457981:0:22771:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.008683331s 00010000:00010000:0.0:1789403529.457986:0:22771:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff90a259947600/0x5fb08b1e5b762606 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 22802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403529.457992:0:22771:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff90a259947600/0x5fb08b1e5b762606 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 22802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403529.457999:0:22771:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff90a259947600/0x5fb08b1e5b762606 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 22802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403529.458005:0:22771:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff90a259947600/0x5fb08b1e5b762606 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 22802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403529.458010:0:22771:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a259947600 already unused, calling callback (ffffffffc0c0b8b0) 00010000:00010000:0.0:1789403529.458014:0:22771:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff90a259947600/0x5fb08b1e5b762606 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 22802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403529.458021:0:22771:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff90a259947600/0x5fb08b1e5b762606 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 22802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403529.458048:0:22771:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff90a259947600/0x5fb08b1e5b762606 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403529.458057:0:22771:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789403529.458089:0:22771:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a27a64e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7ccb4038-daf9-4dcd-9b85-da9390181204+11:3626:x1876325050835584:12345-0@lo:103:ldlm_bl.0 Request processed in 203us (311us total) trans 0 rc 0/0 00000100:00100000:0.0:1789403529.458095:0:22771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1789403529.458126:0:3626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a27a64ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7ccb4038-daf9-4dcd-9b85-da9390181204:3626:1876325050835584:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789403529.458596:0:22802:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff90a259947600/0x5fb08b1e5b762606 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403529.458607:0:22802:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff90a259947600/0x5fb08b1e5b762606 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403529.458615:0:22802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90a259947600/0x5fb08b1e5b762606 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00080000:2.0:1789403529.469686:0:22765:0:(update_trans.c:1496:distribute_txn_commit_batchid_init()) lustre-MDT0000: committed batchid 4294967529 00000040:01000000:2.0:1789403529.470447:0:22765:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000020:00080000:0.0:1789403529.470474:0:22824:0:(update_trans.c:1538:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 4294967529 00000020:00080000:0.0:1789403529.470478:0:22824:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4294967529 00000040:01000000:1.0:1789403529.471619:0:22825:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:0.0:1789403529.471802:0:22765:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0001-osp-MDT0000 ctxt 16 is initialized 00000040:00080000:1.0:1789403529.472475:0:22825:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1789403529.476714:0:22825:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000004:00080000:1.0:1789403529.476789:0:22825:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000040:01000000:3.0:1789403529.478667:0:22765:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:3.0:1789403529.478709:0:22765:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:3.0:1789403529.482806:0:22765:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:3.0:1789403529.482827:0:22765:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:3.0:1789403529.482917:0:22765:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00080000:2.0:1789403529.484611:0:22827:0:(client.c:1846:ptlrpc_send_new_req()) @@@ req waiting for recovery: (FULL != DISCONN) req@ffff90a27a64ca80 x1876325050835712/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 304/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'lod0000_rec0001.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789403529.484642:0:22827:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a2413700c0 going to sleep for 0 seconds 00000040:00080000:3.0:1789403529.485047:0:22765:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:0.0:1789403529.487312:0:22765:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:0.0:1789403529.487363:0:22765:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00000040:00080000:0.0:1789403529.489132:0:22765:0:(llog_cat.c:403:llog_cat_set_first_idx()) catlog [0xa:0x7:0x0] first idx 1, last_idx 2 00080000:10000000:1.0:1789403529.492995:0:22765:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x36:0x0] (8/32) registered 00000001:00000004:1.0:1789403529.497522:0:22765:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 3, last_transno is 12884901888 00000001:00080000:1.0:1789403529.503583:0:22765:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:1.0:1789403529.503638:0:22765:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffbb21c19ab988 00100000:10000000:1.0:1789403529.503646:0:22765:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:0.0:1789403529.504340:0:22765:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:0.0:1789403529.504354:0:22765:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.143@tcp: cl_mgc_mutex unlock 00000020:01000004:0.0:1789403529.504373:0:22765:0:(tgt_mount.c:2460:server_fill_super_common()) Server sb, dev=45 00000080:00000004:0.0:1789403529.504435:0:22765:0:(super25.c:182:lustre_fill_super()) /dev/mapper/mds1_flakey: Mount complete 00000020:00000004:1.0:1789403529.509419:0:22765:0:(tgt_mount.c:2346:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1789403529.511130:0:22765:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1789403529.980713:0:22774:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789403530.546350:0:22827:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a2413700c0 going to sleep for 0 seconds 00000040:00080000:2.0:1789403530.548016:0:22826:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:2.0:1789403530.548024:0:22826:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1789403530.553881:0:22826:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:0.0:1789403530.553893:0:22826:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 10000000:01000000:0.0:1789403530.866222:0:22783:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1789403530.866230:0:22783:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff90a144559800 from 11 10000000:01000000:0.0:1789403530.866236:0:22783:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1789403530.866278:0:22783:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.143@tcp lock: ffff90a248af0600/0x5fb08b1e5b76260d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403530.866290:0:22783:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.143@tcp lock: ffff90a248af0600/0x5fb08b1e5b76260d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403530.866315:0:22783:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.143@tcp lock: ffff90a248af0600/0x5fb08b1e5b76260d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789403530.866340:0:22783:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a144bee680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7ccb4038-daf9-4dcd-9b85-da9390181204:22783:1876325050835840:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1789403530.866424:0:22783:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789403530.866466:0:22783:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a281bb6d80 going to sleep for 11 seconds 00000100:00100000:2.0:1789403530.866496:0:22780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050835840 00000100:00100000:2.0:1789403530.866504:0:22780:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050835840 00000100:00100000:2.0:1789403530.866622:0:22780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1789403530.866633:0:22780:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a276a74450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7ccb4038-daf9-4dcd-9b85-da9390181204+11:22783:x1876325050835840:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789403530.866647:0:22780:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789403530.866661:0:22780:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90a270184c00/0x5fb08b1e5b762614 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x5fb08b1e5b76260d expref: -99 pid: 22780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403530.866684:0:22780:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90a270184c00/0x5fb08b1e5b762614 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5fb08b1e5b76260d expref: 12 pid: 22780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403530.866694:0:22780:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90a270184c00/0x5fb08b1e5b762614 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5fb08b1e5b76260d expref: 12 pid: 22780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403530.866702:0:22780:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a270184c00, rc 0) 00000100:00100000:2.0:1789403530.866748:0:22780:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a276a74450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7ccb4038-daf9-4dcd-9b85-da9390181204+12:22783:x1876325050835840:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 117us (323us total) trans 0 rc 0/0 00000100:00100000:2.0:1789403530.866755:0:22780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1789403530.866774:0:22783:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a144bee680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7ccb4038-daf9-4dcd-9b85-da9390181204:22783:1876325050835840:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789403530.866788:0:22783:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.143@tcp lock: ffff90a248af0600/0x5fb08b1e5b76260d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb08b1e5b762614 expref: -99 pid: 22783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403530.866797:0:22783:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.143@tcp lock: ffff90a248af0600/0x5fb08b1e5b76260d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x5fb08b1e5b762614 expref: -99 pid: 22783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789403530.866846:0:22783:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a144bee680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7ccb4038-daf9-4dcd-9b85-da9390181204:22783:1876325050835968:0@lo:256:ll_cfg_requeue.0 00000100:00100000:0.0:1789403530.866875:0:22783:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789403530.866907:0:22783:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a281bb6d80 going to sleep for 11 seconds 00000100:00100000:2.0:1789403530.866951:0:22778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050835968 00000100:00100000:2.0:1789403530.866956:0:22778:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050835968 00000100:00100000:2.0:1789403530.867046:0:22778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1789403530.867053:0:22778:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a276a75850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7ccb4038-daf9-4dcd-9b85-da9390181204+12:22783:x1876325050835968:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:2.0:1789403530.867065:0:22778:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1789403530.867081:0:22778:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1789403530.867089:0:22778:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 11 00000100:00100000:2.0:1789403530.867172:0:22778:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a276a75850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7ccb4038-daf9-4dcd-9b85-da9390181204+12:22783:x1876325050835968:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 119us (295us total) trans 0 rc 0/0 00000100:00100000:2.0:1789403530.867178:0:22778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1789403530.867306:0:22783:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a144bee680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7ccb4038-daf9-4dcd-9b85-da9390181204:22783:1876325050835968:0@lo:256:ll_cfg_requeue.0 10000000:01000000:2.0:1789403530.867346:0:22783:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.143@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1789403530.867353:0:22783:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.143@tcp lock: ffff90a248af0600/0x5fb08b1e5b76260d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb08b1e5b762614 expref: -99 pid: 22783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403530.867362:0:22783:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.143@tcp lock: ffff90a248af0600/0x5fb08b1e5b76260d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb08b1e5b762614 expref: -99 pid: 22783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403530.993948:0:22775:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1789403531.569563:0:22826:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:0.0:1789403531.569572:0:22826:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1789403531.569704:0:22826:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 1 count 1 00000100:00100000:1.0:1789403531.569746:0:22827:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a2413700c0 going to sleep for 0 seconds 00000040:00080000:0.0:1789403531.569746:0:22826:0:(llog_cat_server.c:902:llog_cat_cleanup()) cancel plain log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1789403531.569889:0:22826:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 1 00010000:00010000:0.0:1789403532.020182:0:22774:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789403532.593526:0:22827:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a2413700c0 going to sleep for 0 seconds 00010000:00010000:2.0:1789403533.041541:0:22775:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789403533.620386:0:22827:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a2413700c0 going to sleep for 0 seconds 00000001:02000400:3.0:1789403533.829020:0:23071:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg343-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:3.0:1789403534.068994:0:22774:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1789403534.578646:0:17331:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:3.0:1789403534.578654:0:17331:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:3.0:1789403534.578657:0:17331:0:(import.c:65:import_set_state_nolock()) ffff90a27dbdd800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1789403534.578664:0:17331:0:(import.c:545:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 575 00000100:00080000:3.0:1789403534.578679:0:17331:0:(import.c:630:import_select_connection()) lustre-MDT0001-osp-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1789403534.578691:0:17331:0:(import.c:666:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff90a27dbdd800 using connection 192.168.203.143@tcp/0@lo 00000100:00100000:3.0:1789403534.578717:0:17331:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff90a144b28700 x1876325050836224/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1789403534.578730:0:17331:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1789403534.578733:0:17331:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1789403534.578736:0:17331:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1789403534.578740:0:17331:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1789403534.578742:0:17331:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:3.0:1789403534.578745:0:17331:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1789403534.578747:0:17331:0:(import.c:65:import_set_state_nolock()) ffff90a281b14000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1789403534.578752:0:17331:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff90a281b14000 using connection 192.168.203.143@tcp/0@lo 00000100:00100000:3.0:1789403534.578764:0:17331:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff90a144b29500 x1876325050836352/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1789403534.578788:0:3626:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789403534.578800:0:3626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a144b29c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7ccb4038-daf9-4dcd-9b85-da9390181204:3626:1876325050836096:0@lo:400:kworker.0 00000100:00100000:3.0:1789403534.578866:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789403534.578919:0:22780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050836096 00000100:00100000:3.0:1789403534.578926:0:22780:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050836096 00000100:00100000:3.0:1789403534.578971:0:22780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1789403534.578979:0:22780:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a276a76450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7ccb4038-daf9-4dcd-9b85-da9390181204+12:3626:x1876325050836096:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789403534.581426:0:22780:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a276a76450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7ccb4038-daf9-4dcd-9b85-da9390181204+12:3626:x1876325050836096:12345-0@lo:400:kworker.0 Request processed in 2437us (2549us total) trans 0 rc 0/0 00000100:00100000:3.0:1789403534.581442:0:22780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1789403534.581531:0:3626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a144b29c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7ccb4038-daf9-4dcd-9b85-da9390181204:3626:1876325050836096:0@lo:400:kworker.0 00000100:00100000:2.0:1789403534.583446:0:3625:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a144b28700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3625:1876325050836224:0@lo:38:kworker.0 00000100:00100000:2.0:1789403534.583527:0:3625:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789403534.583560:0:3625:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a144b29500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3625:1876325050836352:0@lo:38:kworker.0 00000100:00100000:2.0:1789403534.583587:0:3625:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789403534.583675:0:22788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050836352 00000100:00100000:1.0:1789403534.583683:0:22788:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050836352 00000100:00100000:1.0:1789403534.583726:0:22788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1789403534.583733:0:22788:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a27a64e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3625:x1876325050836352:12345-0@lo:38:kworker.0 00010000:00080000:1.0:1789403534.583759:0:22788:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 580 last 0 00000020:00000080:1.0:1789403534.583794:0:22788:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0x5fb08b1e5b76261b 00000004:00100000:1.0:1789403534.583808:0:22788:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1789403534.583937:0:22788:0:(import.c:65:import_set_state_nolock()) ffff90a1436b4000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1789403534.583987:0:22788:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a27a64e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3625:x1876325050836352:12345-0@lo:38:kworker.0 Request processed in 252us (397us total) trans 0 rc 0/0 00000100:00100000:1.0:1789403534.583994:0:22788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1789403534.584189:0:22792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050836224 00000100:00100000:3.0:1789403534.584195:0:22792:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050836224 00000100:00100000:3.0:1789403534.584346:0:22792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1789403534.584352:0:22792:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a27a64c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3625:x1876325050836224:12345-0@lo:38:kworker.0 00010000:00020000:3.0:1789403534.584376:0:22792:0:(ldlm_lib.c:1199:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1789403534.584429:0:22792:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a27a64c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3625:x1876325050836224:12345-0@lo:38:kworker.0 Request processed in 77us (902us total) trans 0 rc -19/-19 00000100:00100000:3.0:1789403534.584435:0:22792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00080000:2.0:1789403534.584760:0:3625:0:(import.c:65:import_set_state_nolock()) ffff90a27dbdd800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1789403534.584767:0:3625:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1789403534.584772:0:3625:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a144b28700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3625:1876325050836224:0@lo:38:kworker.0 00010000:00080000:2.0:1789403534.584786:0:3625:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff90a144b29500 x1876325050836352/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1789403544 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1789403534.584800:0:3625:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 3 00000100:00080000:2.0:1789403534.584808:0:3625:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:2.0:1789403534.584821:0:3625:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1789403534.584824:0:3625:0:(import.c:65:import_set_state_nolock()) ffff90a281b14000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1789403534.584830:0:3625:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a144b29500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3625:1876325050836352:0@lo:38:kworker.0 00000100:00100000:2.0:1789403534.641453:0:22827:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a2413700c0 going to sleep for 0 seconds 00000020:00000004:2.0:1789403534.763876:0:23123:0:(tgt_mount.c:2346:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1789403534.764043:0:23123:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:3.0:1789403535.094127:0:22775:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789403535.666424:0:22827:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a2413700c0 going to sleep for 0 seconds 00000020:00000004:0.0:1789403535.769316:0:23173:0:(tgt_mount.c:2346:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1789403535.770735:0:23173:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1789403536.124384:0:22774:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789403536.691056:0:22827:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a2413700c0 going to sleep for 0 seconds 00010000:00010000:3.0:1789403537.138072:0:22775:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789403537.717442:0:22827:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a2413700c0 going to sleep for 0 seconds 00010000:00010000:0.0:1789403538.165180:0:22774:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789403538.737577:0:22827:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a2413700c0 going to sleep for 0 seconds 00010000:00010000:3.0:1789403539.186101:0:22775:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1789403539.698609:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:3.0:1789403539.698615:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:3.0:1789403539.698618:0:37:0:(import.c:65:import_set_state_nolock()) ffff90a27dbdd800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1789403539.698625:0:37:0:(import.c:545:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 580 00000100:00080000:3.0:1789403539.698630:0:37:0:(import.c:630:import_select_connection()) lustre-MDT0001-osp-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:3.0:1789403539.698641:0:37:0:(import.c:666:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff90a27dbdd800 using connection 192.168.203.143@tcp/0@lo 00000100:00100000:3.0:1789403539.698661:0:37:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff90a144b2b800 x1876325050836608/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1789403539.698673:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1789403539.698676:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1789403539.698679:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00100000:1.0:1789403539.698680:0:3625:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789403529/real 1789403529] req@ffff90a27a64f480 x1876325050833280/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789403539 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1789403539.698682:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1789403539.698701:0:3625:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff90a27a64f480 x1876325050833280/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789403539 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789403539.698720:0:3625:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789403529/real 1789403529] req@ffff90a144b2ad80 x1876325050833152/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789403539 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789403539.698733:0:3625:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff90a144b2ad80 x1876325050833152/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789403539 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789403539.698751:0:3625:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a144b2b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3625:1876325050836608:0@lo:38:kworker.0 00000100:00100000:1.0:1789403539.698803:0:3625:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1789403539.698858:0:3625:0:(import.c:65:import_set_state_nolock()) ffff90a2488fd000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1789403539.698869:0:3625:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:1.0:1789403539.698874:0:3625:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a27a64f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3625:1876325050833280:0@lo:8:llog_process_th.0 00000100:00080000:1.0:1789403539.698879:0:3625:0:(import.c:65:import_set_state_nolock()) ffff90a143719000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1789403539.698883:0:3625:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:1.0:1789403539.698886:0:3625:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a144b2ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3625:1876325050833152:0@lo:8:llog_process_th.0 00000100:00100000:3.0:1789403539.699994:0:3629:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a144b2aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3629:1876325050836736:0@lo:400:kworker.0 00000100:00100000:3.0:1789403539.700047:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789403539.700082:0:3629:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789403539.700089:0:3629:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a144b29c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:7ccb4038-daf9-4dcd-9b85-da9390181204:3629:1876325050836480:0@lo:400:kworker.0 00000100:00100000:3.0:1789403539.700116:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789403539.700174:0:22792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050836608 00000100:00100000:3.0:1789403539.700181:0:22792:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050836608 00000100:00100000:3.0:1789403539.700210:0:22792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1789403539.700216:0:22792:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a141aaca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3625:x1876325050836608:12345-0@lo:38:kworker.0 00010000:00020000:3.0:1789403539.700236:0:22792:0:(ldlm_lib.c:1199:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:1.0:1789403539.700558:0:22787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050836736 00000100:00100000:1.0:1789403539.700563:0:22787:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050836736 00000100:00100000:1.0:1789403539.700602:0:22787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1789403539.700609:0:22787:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a144b2b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3629:x1876325050836736:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789403539.700665:0:22787:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a144b2b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3629:x1876325050836736:12345-0@lo:400:kworker.0 Request processed in 56us (618us total) trans 0 rc 0/0 00000100:00100000:1.0:1789403539.700672:0:22787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1789403539.703508:0:22781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050836480 00000100:00100000:1.0:1789403539.703525:0:22781:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050836480 00000100:00100000:1.0:1789403539.703580:0:22781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1789403539.703590:0:22781:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a276a74050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7ccb4038-daf9-4dcd-9b85-da9390181204+12:3629:x1876325050836480:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789403539.703694:0:22781:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a276a74050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7ccb4038-daf9-4dcd-9b85-da9390181204+12:3629:x1876325050836480:12345-0@lo:400:kworker.0 Request processed in 106us (3577us total) trans 0 rc 0/0 00000100:00100000:1.0:1789403539.703704:0:22781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00080000:1.0:1789403539.703753:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789403539.703760:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:1.0:1789403539.703764:0:37:0:(import.c:65:import_set_state_nolock()) ffff90a143719000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1789403539.703768:0:37:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 575 00000100:00080000:1.0:1789403539.703776:0:37:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1789403539.703787:0:37:0:(import.c:666:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff90a143719000 using connection 192.168.203.143@tcp/0@lo 00000100:00100000:1.0:1789403539.703825:0:37:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff90a141aaf480 x1876325050836864/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1789403539.703858:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789403539.703862:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1789403539.703864:0:37:0:(import.c:65:import_set_state_nolock()) ffff90a2488fd000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1789403539.703867:0:37:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 575 00000100:00080000:1.0:1789403539.703870:0:37:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1789403539.703874:0:37:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff90a2488fd000 using connection 192.168.203.143@tcp/0@lo 00000100:00100000:1.0:1789403539.703885:0:37:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff90a141aaf100 x1876325050836992/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1789403539.703912:0:3625:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a141aaf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3625:1876325050836864:0@lo:8:kworker.0 00000400:00000100:1.0:1789403539.703942:0:3625:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1876325050836864 offset 0 length 520: 4 00000100:00100000:1.0:1789403539.703970:0:3625:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a141aaf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3625:1876325050836992:0@lo:8:kworker.0 00000400:00000100:1.0:1789403539.704127:0:3625:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1876325050836992 offset 0 length 520: 4 00000100:00100000:2.0:1789403539.709779:0:3629:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a144b29c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:7ccb4038-daf9-4dcd-9b85-da9390181204:3629:1876325050836480:0@lo:400:kworker.0 00010000:00080000:2.0:1789403539.709803:0:3629:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff90a144b2aa00 x1876325050836736/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789403555 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789403539.710409:0:3629:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a144b2aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3629:1876325050836736:0@lo:400:kworker.0 00000100:00100000:3.0:1789403539.738546:0:22792:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a141aaca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3625:x1876325050836608:12345-0@lo:38:kworker.0 Request processed in 38321us (39735us total) trans 0 rc -19/-19 00000100:00100000:3.0:1789403539.738559:0:22792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00080000:2.0:1789403539.738668:0:3625:0:(import.c:65:import_set_state_nolock()) ffff90a27dbdd800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1789403539.738674:0:3625:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1789403539.738678:0:3625:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a144b2b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3625:1876325050836608:0@lo:38:kworker.0 00000100:00100000:1.0:1789403539.763450:0:22827:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a2413700c0 going to sleep for 0 seconds 00010000:00010000:0.0:1789403540.211168:0:22774:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789403540.787839:0:22827:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a2413700c0 going to sleep for 0 seconds 00010000:00010000:3.0:1789403541.233928:0:22775:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789403541.814133:0:22827:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a2413700c0 going to sleep for 0 seconds 00000040:00080000:2.0:1789403541.816511:0:22826:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1789403542.257677:0:22774:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1789403542.388161:0:23518:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1789403542.388165:0:23518:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/mds2_flakey 00000020:01000004:2.0:1789403542.388166:0:23518:0:(obd_mount.c:929:lmd_print()) options: user_xattr,errors=remount-ro 00000080:01200004:2.0:1789403542.388287:0:23518:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff90a144165800 00000020:01000004:2.0:1789403542.388302:0:23518:0:(tgt_mount.c:2502:osd_start()) Attempting to start lustre-MDT0001, type=osd-ldiskfs, lsifl=200001, mountfl=0 00000020:01000004:2.0:1789403542.388314:0:23518:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-osd (typ=osd-ldiskfs) 00000020:00000080:2.0:1789403542.388328:0:23518:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-osd (ffff90a27e008000) 00000020:00000080:2.0:1789403542.388343:0:23518:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type osd-ldiskfs with refcount 2 00100000:10000000:2.0:1789403542.510726:0:23518:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0xd:0x0] (16/1) registered 00100000:10000000:2.0:1789403542.512685:0:23518:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:2.0:1789403542.514339:0:23518:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2e:0x0] (24/16) registered 00100000:10000000:2.0:1789403542.515767:0:23518:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2b:0x0] (24/16) registered 00100000:10000000:2.0:1789403542.516104:0:23518:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x25:0x0] (24/16) registered 00100000:10000000:2.0:1789403542.516365:0:23518:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1a:0x0] (16/1) registered 00100000:10000000:2.0:1789403542.516742:0:23518:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2a:0x0] (24/16) registered 00100000:10000000:2.0:1789403542.516941:0:23518:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1c:0x0] (16/1) registered 00100000:10000000:2.0:1789403542.517243:0:23518:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x22:0x0] (24/16) registered 00100000:10000000:2.0:1789403542.517720:0:23518:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1d:0x0] (16/1) registered 00100000:10000000:2.0:1789403542.518221:0:23518:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x26:0x0] (24/16) registered 00100000:10000000:2.0:1789403542.519601:0:23518:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x12:0x0] (16/1) registered 00100000:10000000:2.0:1789403542.520033:0:23518:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x13:0x0] (16/1) registered 00100000:10000000:2.0:1789403542.520438:0:23518:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x18:0x0] (16/1) registered 00100000:10000000:2.0:1789403542.520963:0:23518:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x20:0x0] (24/16) registered 00100000:10000000:2.0:1789403542.521230:0:23518:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0xe:0x0] (16/1) registered 00100000:10000000:2.0:1789403542.521446:0:23518:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x28:0x0] (24/16) registered 00100000:10000000:2.0:1789403542.521747:0:23518:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x19:0x0] (16/1) registered 00100000:10000000:2.0:1789403542.521962:0:23518:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x16:0x0] (16/1) registered 00100000:10000000:2.0:1789403542.522229:0:23518:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x24:0x0] (24/16) registered 00100000:10000000:2.0:1789403542.522432:0:23518:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x17:0x0] (16/1) registered 00100000:10000000:2.0:1789403542.522874:0:23518:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x10:0x0] (16/1) registered 00100000:10000000:2.0:1789403542.523204:0:23518:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0xf:0x0] (16/1) registered 00100000:10000000:2.0:1789403542.523351:0:23518:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x21:0x0] (24/16) registered 00100000:10000000:2.0:1789403542.523760:0:23518:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1f:0x0] (24/16) registered 00100000:10000000:2.0:1789403542.523945:0:23518:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x15:0x0] (16/1) registered 00100000:10000000:2.0:1789403542.524270:0:23518:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x29:0x0] (24/16) registered 00100000:10000000:2.0:1789403542.524682:0:23518:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x23:0x0] (24/16) registered 00100000:10000000:2.0:1789403542.525241:0:23518:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x11:0x0] (16/1) registered 00100000:10000000:2.0:1789403542.525911:0:23518:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2c:0x0] (24/16) registered 00100000:10000000:2.0:1789403542.526233:0:23518:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1b:0x0] (16/1) registered 00100000:10000000:2.0:1789403542.526679:0:23518:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x14:0x0] (16/1) registered 00100000:10000000:2.0:1789403542.526976:0:23518:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x27:0x0] (24/16) registered 00100000:10000000:2.0:1789403542.527292:0:23518:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2d:0x0] (24/16) registered 00100000:10000000:2.0:1789403542.529783:0:23518:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x3:0x0] (8/32) registered 00100000:10000000:2.0:1789403542.530029:0:23518:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x20003:0x0] (8/8) registered 00100000:10000000:2.0:1789403542.530556:0:23518:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:2.0:1789403542.531126:0:23518:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x4:0x0] (8/32) registered 00100000:10000000:2.0:1789403542.531650:0:23518:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x20001:0x0] (8/8) registered 00100000:10000000:2.0:1789403542.531992:0:23518:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:2.0:1789403542.532347:0:23518:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x5:0x0] (8/32) registered 00100000:10000000:2.0:1789403542.532764:0:23518:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x8:0x0] (8/32) registered 00100000:10000000:2.0:1789403542.533003:0:23518:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x7:0x0] (8/32) registered 00100000:10000000:2.0:1789403542.533622:0:23518:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:2.0:1789403542.533951:0:23518:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x20002:0x0] (8/8) registered 00100000:10000000:2.0:1789403542.534289:0:23518:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x6:0x0] (8/32) registered 00080000:01000000:3.0:1789403542.536598:0:23518:0:(osd_lproc.c:911:osd_procfs_init()) lustre-MDT0001: register osd-ldiskfs tunable parameters 00000020:00000080:3.0:1789403542.536835:0:23518:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-osd (uuid lustre-MDT0001-osd_UUID) 00080000:01000000:3.0:1789403542.536846:0:23518:0:(osd_handler.c:8924:osd_obd_connect()) connect #0 00000020:00000080:3.0:1789403542.536858:0:23518:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x5fb08b1e5b762629 00000020:01000004:3.0:1789403542.536865:0:23518:0:(tgt_mount.c:2587:server_fill_super()) Found service lustre-MDT0001 on device /dev/mapper/mds2_flakey 00000020:01000004:3.0:1789403542.536885:0:23518:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.203.143@tcp:Set MGC reconnect 1 10000000:01000000:3.0:1789403542.536889:0:23518:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.203.143@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:3.0:1789403542.536895:0:23518:0:(tgt_mount.c:1808:server_start_targets()) starting target lustre-MDT0001 00000020:01000004:3.0:1789403542.536921:0:23518:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/mds2_flakey 10000000:01000000:3.0:1789403542.536925:0:23518:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.143@tcp: cl_mgc_mutex lustre-MDT0001-osd for locked: rc = 0 00000040:01000000:3.0:1789403542.544038:0:23518:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.143@tcp ctxt 0 is initialized 00000020:01000004:3.0:1789403542.544090:0:23518:0:(tgt_mount.c:1416:server_register_target()) Registration lustre-MDT0001, fs=lustre, 192.168.203.143@tcp, index=0001, flags=0x20001 00000020:01000004:3.0:1789403542.544094:0:23518:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:3.0:1789403542.544096:0:23518:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:3.0:1789403542.544101:0:23518:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789403542.544102:0:23518:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1789403542.544103:0:23518:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789403542.544104:0:23518:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789403542.544105:0:23518:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1789403542.544107:0:23518:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789403542.544108:0:23518:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1789403542.544111:0:23518:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0001 0x10020001 00000020:01000004:3.0:1789403542.544120:0:23518:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1789403542.544121:0:23518:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:3.0:1789403542.544122:0:23518:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789403542.544123:0:23518:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1789403542.544124:0:23518:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789403542.544125:0:23518:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789403542.544126:0:23518:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1789403542.544127:0:23518:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789403542.544128:0:23518:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1789403542.544159:0:23518:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0001 00000100:00100000:3.0:1789403542.544176:0:23518:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a144b28e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7ccb4038-daf9-4dcd-9b85-da9390181204:23518:1876325050837120:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1789403542.544233:0:23518:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789403542.544279:0:23518:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a142605900 going to sleep for 11 seconds 00000100:00100000:2.0:1789403542.544439:0:22778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050837120 00000100:00100000:2.0:1789403542.544447:0:22778:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050837120 00000100:00100000:2.0:1789403542.544503:0:22778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1789403542.544512:0:22778:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a276a76050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7ccb4038-daf9-4dcd-9b85-da9390181204+12:23518:x1876325050837120:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1789403542.544538:0:22778:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:2.0:1789403542.544541:0:22778:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-MDT0001 is running on 0@lo 20000000:01000000:2.0:1789403542.544548:0:22778:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0001, index=1, rc=0 00000100:00100000:2.0:1789403542.544877:0:22778:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a276a76050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7ccb4038-daf9-4dcd-9b85-da9390181204+12:23518:x1876325050837120:12345-0@lo:253:mount.lustre.0 Request processed in 366us (642us total) trans 0 rc 0/0 00000100:00100000:2.0:1789403542.544886:0:22778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1789403542.545032:0:23518:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a144b28e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7ccb4038-daf9-4dcd-9b85-da9390181204:23518:1876325050837120:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1789403542.545042:0:23518:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0001 got index = 1 00000020:01000004:3.0:1789403542.545044:0:23518:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1789403542.545045:0:23518:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:3.0:1789403542.545046:0:23518:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789403542.545047:0:23518:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1789403542.545048:0:23518:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789403542.545049:0:23518:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789403542.545050:0:23518:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1789403542.545051:0:23518:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789403542.545061:0:23518:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:3.0:1789403542.545222:0:23518:0:(tgt_mount.c:101:server_register_mount()) register mount ffff90a144165800 from lustre-MDT0001 10000000:01000000:3.0:1789403542.545248:0:23518:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0001 from 0 10000000:01000000:3.0:1789403542.545250:0:23518:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0001-0000000000000000 10000000:01000000:3.0:1789403542.545257:0:23518:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff90a27e00b380 local copy 00010000:00010000:3.0:1789403542.545266:0:23518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.143@tcp lock: ffff90a144063400/0x5fb08b1e5b76251f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb08b1e5b762526 expref: -99 pid: 22765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789403542.545354:0:23518:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a144b28e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7ccb4038-daf9-4dcd-9b85-da9390181204:23518:1876325050837248:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789403542.545384:0:23518:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789403542.545433:0:23518:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a1426053c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789403542.545524:0:22781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050837248 00000100:00100000:1.0:1789403542.545529:0:22781:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050837248 00000100:00100000:1.0:1789403542.545607:0:22781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1789403542.545625:0:22781:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a276a77c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7ccb4038-daf9-4dcd-9b85-da9390181204+12:23518:x1876325050837248:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789403542.545684:0:22781:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a276a77c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7ccb4038-daf9-4dcd-9b85-da9390181204+12:23518:x1876325050837248:12345-0@lo:501:mount.lustre.0 Request processed in 60us (298us total) trans 0 rc -2/-2 00000100:00100000:1.0:1789403542.545691:0:22781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1789403542.545898:0:23518:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a144b28e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7ccb4038-daf9-4dcd-9b85-da9390181204:23518:1876325050837248:0@lo:501:mount.lustre.0 10000000:01000000:3.0:1789403542.545914:0:23518:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.203.143@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:3.0:1789403542.545931:0:23518:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.203.143@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:3.0:1789403542.545938:0:23518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.143@tcp lock: ffff90a144063400/0x5fb08b1e5b76251f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb08b1e5b762526 expref: -99 pid: 22765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403542.545946:0:23518:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.143@tcp lock: ffff90a144063400/0x5fb08b1e5b76251f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb08b1e5b762526 expref: -99 pid: 22765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789403542.545968:0:23518:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff90a144165800 10000000:01000000:3.0:1789403542.545973:0:23518:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:3.0:1789403542.545977:0:23518:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffff90a27e00b380 10000000:01000000:3.0:1789403542.545979:0:23518:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:3.0:1789403542.545982:0:23518:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff90a27e00b380 from 1 10000000:01000000:3.0:1789403542.545986:0:23518:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:3.0:1789403542.546008:0:23518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.143@tcp lock: ffff90a259947200/0x5fb08b1e5b762630 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 23518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403542.546015:0:23518:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.143@tcp lock: ffff90a259947200/0x5fb08b1e5b762630 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 23518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403542.546024:0:23518:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.143@tcp lock: ffff90a259947200/0x5fb08b1e5b762630 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 23518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789403542.546048:0:23518:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a144b28e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7ccb4038-daf9-4dcd-9b85-da9390181204:23518:1876325050837376:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1789403542.546093:0:23518:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789403542.546617:0:23518:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a1426053c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789403542.546700:0:22778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050837376 00000100:00100000:0.0:1789403542.546706:0:22778:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050837376 00000100:00100000:0.0:1789403542.546733:0:22778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1789403542.546740:0:22778:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a276a76850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7ccb4038-daf9-4dcd-9b85-da9390181204+12:23518:x1876325050837376:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1789403542.546750:0:22778:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789403542.546762:0:22778:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90a248af1200/0x5fb08b1e5b762637 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x5fb08b1e5b762630 expref: -99 pid: 22778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403542.546782:0:22778:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90a248af1200/0x5fb08b1e5b762637 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5fb08b1e5b762630 expref: 13 pid: 22778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403542.546792:0:22778:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90a248af1200/0x5fb08b1e5b762637 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5fb08b1e5b762630 expref: 13 pid: 22778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403542.546800:0:22778:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a248af1200, rc 0) 00000100:00100000:0.0:1789403542.546884:0:22778:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a276a76850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7ccb4038-daf9-4dcd-9b85-da9390181204+13:23518:x1876325050837376:12345-0@lo:101:mount.lustre.0 Request processed in 145us (790us total) trans 0 rc 0/0 00000100:00100000:0.0:1789403542.546890:0:22778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1789403542.547198:0:23518:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a144b28e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7ccb4038-daf9-4dcd-9b85-da9390181204:23518:1876325050837376:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1789403542.547212:0:23518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.143@tcp lock: ffff90a259947200/0x5fb08b1e5b762630 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb08b1e5b762637 expref: -99 pid: 23518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403542.547220:0:23518:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.143@tcp lock: ffff90a259947200/0x5fb08b1e5b762630 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x5fb08b1e5b762637 expref: -99 pid: 23518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789403542.547236:0:23518:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.143@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:3.0:1789403542.547288:0:23518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.143@tcp lock: ffff90a259947200/0x5fb08b1e5b762630 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb08b1e5b762637 expref: -99 pid: 23518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403542.547305:0:23518:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.143@tcp lock: ffff90a259947200/0x5fb08b1e5b762630 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb08b1e5b762637 expref: -99 pid: 23518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789403542.547315:0:23518:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff90a144165800 10000000:01000000:3.0:1789403542.547319:0:23518:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:3.0:1789403542.547323:0:23518:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff90a144165800 from 1 10000000:01000000:3.0:1789403542.547324:0:23518:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:3.0:1789403542.547341:0:23518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.143@tcp lock: ffff90a259947c00/0x5fb08b1e5b76263e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 23518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403542.547348:0:23518:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.143@tcp lock: ffff90a259947c00/0x5fb08b1e5b76263e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 23518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403542.547354:0:23518:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.143@tcp lock: ffff90a259947c00/0x5fb08b1e5b76263e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 23518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789403542.547377:0:23518:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a144b28e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7ccb4038-daf9-4dcd-9b85-da9390181204:23518:1876325050837504:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1789403542.547433:0:23518:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789403542.547450:0:23518:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a1426053c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789403542.547785:0:22778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050837504 00000100:00100000:0.0:1789403542.547790:0:22778:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050837504 00000100:00100000:0.0:1789403542.547831:0:22778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1789403542.547838:0:22778:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a276a74c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7ccb4038-daf9-4dcd-9b85-da9390181204+13:23518:x1876325050837504:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1789403542.547848:0:22778:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789403542.547863:0:22778:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90a248af1400/0x5fb08b1e5b762645 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x5fb08b1e5b76263e expref: -99 pid: 22778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403542.547877:0:22778:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90a248af1400/0x5fb08b1e5b762645 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5fb08b1e5b76263e expref: 14 pid: 22778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403542.547885:0:22778:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90a248af1400/0x5fb08b1e5b762645 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5fb08b1e5b76263e expref: 14 pid: 22778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403542.547892:0:22778:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a248af1400, rc 0) 00000100:00100000:0.0:1789403542.548262:0:22778:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a276a74c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7ccb4038-daf9-4dcd-9b85-da9390181204+14:23518:x1876325050837504:12345-0@lo:101:mount.lustre.0 Request processed in 424us (827us total) trans 0 rc 0/0 00000100:00100000:0.0:1789403542.548270:0:22778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1789403542.548378:0:23518:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a144b28e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7ccb4038-daf9-4dcd-9b85-da9390181204:23518:1876325050837504:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1789403542.548454:0:23518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.143@tcp lock: ffff90a259947c00/0x5fb08b1e5b76263e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb08b1e5b762645 expref: -99 pid: 23518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403542.548524:0:23518:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.143@tcp lock: ffff90a259947c00/0x5fb08b1e5b76263e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x5fb08b1e5b762645 expref: -99 pid: 23518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789403542.548537:0:23518:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.143@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:3.0:1789403542.548586:0:23518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.143@tcp lock: ffff90a259947c00/0x5fb08b1e5b76263e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb08b1e5b762645 expref: -99 pid: 23518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403542.548594:0:23518:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.143@tcp lock: ffff90a259947c00/0x5fb08b1e5b76263e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb08b1e5b762645 expref: -99 pid: 23518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789403542.548601:0:23518:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0001-0000000000000000 10000000:01000000:3.0:1789403542.548605:0:23518:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1789403542.548620:0:23518:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff90a144165800 10000000:01000000:3.0:1789403542.548623:0:23518:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:3.0:1789403542.548627:0:23518:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 1 10000000:01000000:3.0:1789403542.548629:0:23518:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:3.0:1789403542.548645:0:23518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.143@tcp lock: ffff90a259946400/0x5fb08b1e5b76264c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 23518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403542.548652:0:23518:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.143@tcp lock: ffff90a259946400/0x5fb08b1e5b76264c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 23518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403542.548668:0:23518:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.143@tcp lock: ffff90a259946400/0x5fb08b1e5b76264c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 23518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789403542.548683:0:23518:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a144b28e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7ccb4038-daf9-4dcd-9b85-da9390181204:23518:1876325050837632:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1789403542.548711:0:23518:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789403542.548744:0:23518:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a1426053c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789403542.548960:0:22780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050837632 00000100:00100000:0.0:1789403542.548965:0:22780:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050837632 00000100:00100000:0.0:1789403542.549000:0:22780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1789403542.549007:0:22780:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a276a75450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7ccb4038-daf9-4dcd-9b85-da9390181204+14:23518:x1876325050837632:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1789403542.549015:0:22780:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789403542.549023:0:22780:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90a248af1000/0x5fb08b1e5b762653 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x5fb08b1e5b76264c expref: -99 pid: 22780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403542.549037:0:22780:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90a248af1000/0x5fb08b1e5b762653 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5fb08b1e5b76264c expref: 15 pid: 22780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403542.549045:0:22780:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90a248af1000/0x5fb08b1e5b762653 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5fb08b1e5b76264c expref: 15 pid: 22780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403542.549051:0:22780:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a248af1000, rc 0) 00000100:00100000:0.0:1789403542.549099:0:22780:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a276a75450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7ccb4038-daf9-4dcd-9b85-da9390181204+15:23518:x1876325050837632:12345-0@lo:101:mount.lustre.0 Request processed in 92us (386us total) trans 0 rc 0/0 00000100:00100000:0.0:1789403542.549122:0:22780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1789403542.549287:0:23518:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a144b28e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7ccb4038-daf9-4dcd-9b85-da9390181204:23518:1876325050837632:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1789403542.549299:0:23518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.143@tcp lock: ffff90a259946400/0x5fb08b1e5b76264c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb08b1e5b762653 expref: -99 pid: 23518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403542.549307:0:23518:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.143@tcp lock: ffff90a259946400/0x5fb08b1e5b76264c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x5fb08b1e5b762653 expref: -99 pid: 23518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1789403542.551274:0:23518:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 46 count 46 00000040:00080000:3.0:1789403542.552043:0:23518:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1789403542.558140:0:23518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].1, 224 off8416 00000040:00080000:3.0:1789403542.558201:0:23518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].2, 136 off8552 00000040:00080000:3.0:1789403542.558218:0:23518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].3, 176 off8728 00000040:00080000:3.0:1789403542.558232:0:23518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].4, 224 off8952 00000040:00080000:3.0:1789403542.558246:0:23518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].5, 224 off9176 00000040:00080000:3.0:1789403542.558260:0:23518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].6, 120 off9296 00000040:00080000:3.0:1789403542.558273:0:23518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].7, 112 off9408 00000040:00080000:3.0:1789403542.558286:0:23518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].8, 160 off9568 00000040:00080000:3.0:1789403542.558299:0:23518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].9, 224 off9792 00000040:00080000:3.0:1789403542.558322:0:23518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].10, 224 off10016 00000040:00080000:3.0:1789403542.558330:0:23518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].11, 88 off10104 00000040:00080000:3.0:1789403542.558337:0:23518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].12, 144 off10248 00000040:00080000:3.0:1789403542.558344:0:23518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].13, 152 off10400 00000040:00080000:3.0:1789403542.558351:0:23518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].14, 168 off10568 00000040:00080000:3.0:1789403542.558365:0:23518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].15, 224 off10792 00000040:00080000:3.0:1789403542.558372:0:23518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].16, 224 off11016 00000040:00080000:3.0:1789403542.558379:0:23518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].17, 80 off11096 00000040:00080000:3.0:1789403542.558386:0:23518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].18, 224 off11320 00000040:00080000:3.0:1789403542.558437:0:23518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].19, 224 off11544 00000040:00080000:3.0:1789403542.558450:0:23518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].20, 160 off11704 00000040:00080000:3.0:1789403542.558465:0:23518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].21, 224 off11928 00000040:00080000:3.0:1789403542.558479:0:23518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].22, 224 off12152 00000040:00080000:3.0:1789403542.558509:0:23518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].23, 80 off12232 00000040:00080000:3.0:1789403542.558529:0:23518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].24, 224 off12456 00000040:00080000:3.0:1789403542.558543:0:23518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].25, 224 off12680 00000040:00080000:3.0:1789403542.558570:0:23518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].26, 88 off12768 00000040:00080000:3.0:1789403542.558586:0:23518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].27, 144 off12912 00000040:00080000:3.0:1789403542.558599:0:23518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].28, 152 off13064 00000040:00080000:3.0:1789403542.558612:0:23518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].29, 136 off13200 00000040:00080000:3.0:1789403542.558626:0:23518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].30, 224 off13424 00000040:00080000:3.0:1789403542.558640:0:23518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].31, 224 off13648 00000040:00080000:3.0:1789403542.558652:0:23518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].32, 80 off13728 00000040:00080000:3.0:1789403542.558665:0:23518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].33, 224 off13952 00000040:00080000:3.0:1789403542.558678:0:23518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].34, 224 off14176 00000040:00080000:3.0:1789403542.558691:0:23518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].35, 88 off14264 00000040:00080000:3.0:1789403542.558705:0:23518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].36, 144 off14408 00000040:00080000:3.0:1789403542.558718:0:23518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].37, 152 off14560 00000040:00080000:3.0:1789403542.558730:0:23518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].38, 136 off14696 00000040:00080000:3.0:1789403542.558742:0:23518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].39, 224 off14920 00000040:00080000:3.0:1789403542.558750:0:23518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].40, 224 off15144 00000040:00080000:3.0:1789403542.558757:0:23518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].41, 80 off15224 00000040:00080000:3.0:1789403542.558784:0:23518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].42, 224 off15448 00000040:00080000:3.0:1789403542.558794:0:23518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].43, 224 off15672 00000040:00080000:3.0:1789403542.558801:0:23518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].44, 120 off15792 00000040:00080000:3.0:1789403542.558817:0:23518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].45, 224 off16016 00000040:00080000:3.0:1789403542.558820:0:23518:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 45 count 46 00000100:00100000:3.0:1789403542.559060:0:23518:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a144b28e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7ccb4038-daf9-4dcd-9b85-da9390181204:23518:1876325050837760:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789403542.559136:0:23518:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789403542.559182:0:23518:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a1426059c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789403542.559331:0:22778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050837760 00000100:00100000:0.0:1789403542.559338:0:22778:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050837760 00000100:00100000:0.0:1789403542.559454:0:22778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1789403542.559463:0:22778:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a276a77850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7ccb4038-daf9-4dcd-9b85-da9390181204+15:23518:x1876325050837760:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789403542.559600:0:22778:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a276a77850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7ccb4038-daf9-4dcd-9b85-da9390181204+15:23518:x1876325050837760:12345-0@lo:501:mount.lustre.0 Request processed in 138us (463us total) trans 0 rc 0/0 00000100:00100000:0.0:1789403542.559608:0:22778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1789403542.559803:0:23518:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a144b28e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7ccb4038-daf9-4dcd-9b85-da9390181204:23518:1876325050837760:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789403542.559843:0:23518:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a144b28e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7ccb4038-daf9-4dcd-9b85-da9390181204:23518:1876325050837888:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1789403542.559880:0:23518:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789403542.560105:0:23518:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a1426059c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789403542.560179:0:22780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050837888 00000100:00100000:1.0:1789403542.560185:0:22780:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050837888 00000100:00100000:1.0:1789403542.560208:0:22780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1789403542.560215:0:22780:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a276a75c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7ccb4038-daf9-4dcd-9b85-da9390181204+15:23518:x1876325050837888:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1789403542.562535:0:22780:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a276a75c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7ccb4038-daf9-4dcd-9b85-da9390181204+15:23518:x1876325050837888:12345-0@lo:503:mount.lustre.0 Request processed in 2312us (2646us total) trans 0 rc 0/0 00000100:00100000:1.0:1789403542.562547:0:22780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1789403542.562656:0:23518:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a144b28e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7ccb4038-daf9-4dcd-9b85-da9390181204:23518:1876325050837888:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1789403542.563537:0:23518:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1789403542.563613:0:23518:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a144b28e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7ccb4038-daf9-4dcd-9b85-da9390181204:23518:1876325050838016:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789403542.563666:0:23518:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789403542.563764:0:23518:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a1426053c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789403542.564310:0:22778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050838016 00000100:00100000:0.0:1789403542.564317:0:22778:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050838016 00000100:00100000:0.0:1789403542.564362:0:22778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1789403542.564370:0:22778:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a276a75050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7ccb4038-daf9-4dcd-9b85-da9390181204+15:23518:x1876325050838016:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1789403542.565243:0:22778:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a276a75050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7ccb4038-daf9-4dcd-9b85-da9390181204+15:23518:x1876325050838016:12345-0@lo:502:mount.lustre.0 Request processed in 863us (1566us total) trans 0 rc 0/0 00000100:00100000:0.0:1789403542.565252:0:22778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1789403542.565459:0:23518:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a144b28e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7ccb4038-daf9-4dcd-9b85-da9390181204:23518:1876325050838016:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1789403542.565658:0:23518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].1, 224 off8416 00000040:00080000:3.0:1789403542.565692:0:23518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].2, 136 off8552 00000040:00080000:3.0:1789403542.565706:0:23518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].3, 176 off8728 00000040:00080000:3.0:1789403542.565713:0:23518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].4, 224 off8952 00000040:00080000:3.0:1789403542.565720:0:23518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].5, 224 off9176 00000040:00080000:3.0:1789403542.565727:0:23518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].6, 120 off9296 00000040:00080000:3.0:1789403542.565734:0:23518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].7, 112 off9408 00000040:00080000:3.0:1789403542.565741:0:23518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].8, 160 off9568 00000040:00080000:3.0:1789403542.565748:0:23518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].9, 224 off9792 00000040:00080000:3.0:1789403542.565755:0:23518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].10, 224 off10016 00000040:00080000:3.0:1789403542.565773:0:23518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].11, 88 off10104 00000040:00080000:3.0:1789403542.565781:0:23518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].12, 144 off10248 00000040:00080000:3.0:1789403542.565788:0:23518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].13, 152 off10400 00000040:00080000:3.0:1789403542.565795:0:23518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].14, 168 off10568 00000040:00080000:3.0:1789403542.565806:0:23518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].15, 224 off10792 00000040:00080000:3.0:1789403542.565825:0:23518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].16, 224 off11016 00000040:00080000:3.0:1789403542.565850:0:23518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].17, 80 off11096 00000040:00080000:3.0:1789403542.565864:0:23518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].18, 224 off11320 00000040:00080000:3.0:1789403542.565877:0:23518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].19, 224 off11544 00000040:00080000:3.0:1789403542.565887:0:23518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].20, 160 off11704 00000040:00080000:3.0:1789403542.565898:0:23518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].21, 224 off11928 00000040:00080000:3.0:1789403542.565909:0:23518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].22, 224 off12152 00000040:00080000:3.0:1789403542.565920:0:23518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].23, 80 off12232 00000040:00080000:3.0:1789403542.565932:0:23518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].24, 224 off12456 00000040:00080000:3.0:1789403542.565943:0:23518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].25, 224 off12680 00000040:00080000:3.0:1789403542.565954:0:23518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].26, 88 off12768 00000040:00080000:3.0:1789403542.565981:0:23518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].27, 144 off12912 00000040:00080000:3.0:1789403542.565994:0:23518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].28, 152 off13064 00000040:00080000:3.0:1789403542.566005:0:23518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].29, 136 off13200 00000040:00080000:3.0:1789403542.566017:0:23518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].30, 224 off13424 00000040:00080000:3.0:1789403542.566030:0:23518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].31, 224 off13648 00000040:00080000:3.0:1789403542.566044:0:23518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].32, 80 off13728 00000040:00080000:3.0:1789403542.566056:0:23518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].33, 224 off13952 00000040:00080000:3.0:1789403542.566069:0:23518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].34, 224 off14176 00000040:00080000:3.0:1789403542.566081:0:23518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].35, 88 off14264 00000040:00080000:3.0:1789403542.566101:0:23518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].36, 144 off14408 00000040:00080000:3.0:1789403542.566123:0:23518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].37, 152 off14560 00000040:00080000:3.0:1789403542.566139:0:23518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].38, 136 off14696 00000040:00080000:3.0:1789403542.566152:0:23518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].39, 224 off14920 00000040:00080000:3.0:1789403542.566165:0:23518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].40, 224 off15144 00000040:00080000:3.0:1789403542.566178:0:23518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].41, 80 off15224 00000040:00080000:3.0:1789403542.566191:0:23518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].42, 224 off15448 00000040:00080000:3.0:1789403542.566215:0:23518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].43, 224 off15672 00000040:00080000:3.0:1789403542.566230:0:23518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].44, 120 off15792 00000100:00100000:3.0:1789403542.566265:0:23518:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a144b28e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7ccb4038-daf9-4dcd-9b85-da9390181204:23518:1876325050838144:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789403542.566316:0:23518:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789403542.566357:0:23518:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a1426053c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789403542.566428:0:22780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050838144 00000100:00100000:1.0:1789403542.566436:0:22780:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050838144 00000100:00100000:1.0:1789403542.566898:0:22780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1789403542.566908:0:22780:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a276a77450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7ccb4038-daf9-4dcd-9b85-da9390181204+15:23518:x1876325050838144:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1789403542.567013:0:22780:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a276a77450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7ccb4038-daf9-4dcd-9b85-da9390181204+15:23518:x1876325050838144:12345-0@lo:502:mount.lustre.0 Request processed in 107us (696us total) trans 0 rc 0/0 00000100:00100000:1.0:1789403542.567020:0:22780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1789403542.567572:0:23518:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a144b28e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7ccb4038-daf9-4dcd-9b85-da9390181204:23518:1876325050838144:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1789403542.567630:0:23518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].45, 224 off16016 00000040:00080000:3.0:1789403542.567641:0:23518:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 45 count 46 00000020:01000000:1.0:1789403542.568319:0:23522:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789403542.568331:0:23522:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789403542.568333:0:23522:0:(obd_config.c:1563:class_process_config()) marker 11 (0x1) lustre-MDT0001-m lov setup 00000020:01000000:1.0:1789403542.568338:0:23522:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0001) 00000020:00000080:1.0:1789403542.568341:0:23522:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1789403542.568355:0:23522:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-mdtlov (ffff90a2818099c0) 00000020:00000080:1.0:1789403542.568374:0:23522:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type lod with refcount 2 00000020:00000080:1.0:1789403542.568407:0:23522:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:1.0:1789403542.568787:0:23522:0:(osd_handler.c:8924:osd_obd_connect()) connect #1 00000020:00000080:1.0:1789403542.568793:0:23522:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x5fb08b1e5b762661 00000020:00000080:1.0:1789403542.568972:0:23522:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-mdtlov (uuid lustre-MDT0001-mdtlov_UUID) 00000020:01000000:1.0:1789403542.568975:0:23522:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789403542.568978:0:23522:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789403542.568979:0:23522:0:(obd_config.c:1563:class_process_config()) marker 11 (0x2) lustre-MDT0001-m lov setup 00000020:01000000:1.0:1789403542.568981:0:23522:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789403542.568983:0:23522:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789403542.568984:0:23522:0:(obd_config.c:1563:class_process_config()) marker 12 (0x1) lustre-MDT0001 add mdt 00000020:00000080:1.0:1789403542.568986:0:23522:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1789403542.568992:0:23522:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001 (ffff90a28180b380) 00000020:00000080:1.0:1789403542.569000:0:23522:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type mdt with refcount 2 00000020:00000080:1.0:1789403542.569002:0:23522:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:1.0:1789403542.569004:0:23522:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0001 osc lustre-MDT0001-mdtlov mdc (null) 00000020:01000000:1.0:1789403542.569006:0:23522:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0001 00000020:00000080:1.0:1789403542.569009:0:23522:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:1.0:1789403542.569049:0:23522:0:(tgt_mount.c:153:server_get_mount()) get mount ffff90a144165800 from lustre-MDT0001, refs=2 00000020:00000080:1.0:1789403542.569067:0:23522:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0001 (ffff90a2818719c0) 00000020:00000080:1.0:1789403542.569074:0:23522:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type mdd with refcount 2 00000004:01000000:1.0:1789403542.569205:0:23522:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:1.0:1789403542.569211:0:23522:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x5fb08b1e5b762676 00000020:00000080:1.0:1789403542.569311:0:23522:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0001 (uuid lustre-MDD0001_UUID) 00000004:01000000:1.0:1789403542.569317:0:23522:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:1.0:1789403542.569320:0:23522:0:(genops.c:1384:class_connect()) connect: client lustre-MDD0001_UUID, cookie 0x5fb08b1e5b76267d 00080000:01000000:1.0:1789403542.569324:0:23522:0:(osd_handler.c:8924:osd_obd_connect()) connect #2 00000020:00000080:1.0:1789403542.569326:0:23522:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x5fb08b1e5b762684 00010000:00010000:2.0:1789403542.650586:0:23522:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0001_UUID-2 is initialized 00000001:00000004:2.0:1789403542.651633:0:23522:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 3, last_transno is 8589934595 00000001:00080000:2.0:1789403542.652020:0:23522:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0001: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:0.0:1789403542.654740:0:23522:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001 (uuid lustre-MDT0001_UUID) 00000020:01000000:0.0:1789403542.654753:0:23522:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789403542.654760:0:23522:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789403542.654762:0:23522:0:(obd_config.c:1563:class_process_config()) marker 12 (0x2) lustre-MDT0001 add mdt 00000020:01000000:0.0:1789403542.654770:0:23522:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789403542.654776:0:23522:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789403542.654778:0:23522:0:(obd_config.c:1563:class_process_config()) marker 13 (0x1) lustre-MDT0000 add osp 00000020:00000080:0.0:1789403542.654782:0:23522:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:0.0:1789403542.654787:0:23522:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.203.143@tcp to nid 0x20000c0a8cb8f (192.168.203.143@tcp) 00000020:00000080:0.0:1789403542.654814:0:23522:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1789403542.654829:0:23522:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osp-MDT0001 (ffff90a2606599c0) 00000020:00000080:0.0:1789403542.654921:0:23522:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type osp with refcount 2 00000020:00000080:0.0:1789403542.654928:0:23522:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:0.0:1789403542.655021:0:23522:0:(osp_dev.c:1203:osp_init0()) lustre-MDT0000-osp-MDT0001: connect to lustre-MDT0001-osd (lustre-MDT0000-osp-MDT0001) 00080000:01000000:0.0:1789403542.655028:0:23522:0:(osd_handler.c:8924:osd_obd_connect()) connect #3 00000020:00000080:0.0:1789403542.655035:0:23522:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x5fb08b1e5b762692 00010000:00080000:0.0:1789403542.655300:0:23522:0:(ldlm_lib.c:102:import_set_conn()) imp ffff90a143690800@lustre-MDT0000-osp-MDT0001: add connection 192.168.203.143@tcp at head 00010000:00010000:0.0:1789403542.658922:0:23522:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-osp-MDT0001-5 is initialized 00000020:00000080:1.0:1789403542.664269:0:23522:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osp-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:1.0:1789403542.664282:0:23522:0:(obd_config.c:1472:class_process_config()) processing cmd: cf014 00000004:01000000:1.0:1789403542.664316:0:23522:0:(lod_lov.c:128:lod_add_device()) osp:lustre-MDT0000_UUID idx:0 gen:1 00000020:00000080:1.0:1789403542.664337:0:23522:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x5fb08b1e5b762699 00000100:00080000:1.0:1789403542.664347:0:23522:0:(import.c:545:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1789403542.664358:0:23522:0:(import.c:666:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff90a143690800 using connection 192.168.203.143@tcp/0@lo 00000100:00100000:1.0:1789403542.664727:0:23522:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff90a141aae300 x1876325050838272/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1789403542.664756:0:23522:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID 00000020:01000000:1.0:1789403542.664808:0:23522:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789403542.664812:0:23522:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789403542.664813:0:23522:0:(obd_config.c:1563:class_process_config()) marker 13 (0x2) lustre-MDT0000 add osp 00000020:01000000:1.0:1789403542.664816:0:23522:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:1.0:1789403542.664820:0:23522:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #14 00000020:01000000:1.0:1789403542.664821:0:23522:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1789403542.664822:0:23522:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1789403542.664824:0:23522:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:1.0:1789403542.664827:0:23522:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789403542.664828:0:23522:0:(obd_config.c:1563:class_process_config()) marker 14 (0x6) lustre sys.timeout 00000020:01000000:1.0:1789403542.664830:0:23522:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789403542.664835:0:23522:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789403542.664836:0:23522:0:(obd_config.c:1563:class_process_config()) marker 15 (0x1) lustre-MDT0001 mdt.identity_upcall 00000020:00000080:1.0:1789403542.664840:0:23522:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:1.0:1789403542.664871:0:23522:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0001: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:1.0:1789403542.664884:0:23522:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789403542.664887:0:23522:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789403542.664889:0:23522:0:(obd_config.c:1563:class_process_config()) marker 15 (0x2) lustre-MDT0001 mdt.identity_upcall 00000020:01000000:1.0:1789403542.664891:0:23522:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:1.0:1789403542.664893:0:23522:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #19 00000020:01000000:1.0:1789403542.664894:0:23522:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1789403542.664896:0:23522:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1789403542.664908:0:23522:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:1.0:1789403542.664911:0:23522:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789403542.664912:0:23522:0:(obd_config.c:1563:class_process_config()) marker 19 (0x6) lustre sys.timeout 00000020:01000000:1.0:1789403542.664915:0:23522:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1789403542.664918:0:23522:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/mds2_flakey 00000020:00000080:1.0:1789403542.664922:0:23522:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789403542.664923:0:23522:0:(obd_config.c:1563:class_process_config()) marker 23 (0x1) lustre-OST0000 add osc 00000020:00000080:1.0:1789403542.664926:0:23522:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1789403542.664934:0:23522:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.203.143@tcp to nid 0x20000c0a8cb8f (192.168.203.143@tcp) 00000020:01000000:1.0:1789403542.664956:0:23522:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0001) 00000020:00000080:1.0:1789403542.664958:0:23522:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1789403542.664970:0:23522:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0001 (ffff90a281874d40) 00000020:00000080:1.0:1789403542.664983:0:23522:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type osp with refcount 2 00000020:00000080:1.0:1789403542.664988:0:23522:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1789403542.665069:0:23522:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0001: connect to lustre-MDT0001-osd (lustre-OST0000-osc-MDT0001) 00080000:01000000:1.0:1789403542.665076:0:23522:0:(osd_handler.c:8924:osd_obd_connect()) connect #4 00000020:00000080:1.0:1789403542.665081:0:23522:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x5fb08b1e5b7626a7 00010000:00080000:1.0:1789403542.665127:0:23522:0:(ldlm_lib.c:102:import_set_conn()) imp ffff90a14249e000@lustre-OST0000-osc-MDT0001: add connection 192.168.203.143@tcp at head 00010000:00010000:1.0:1789403542.665382:0:23522:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0001-6 is initialized 00000100:00100000:3.0:1789403542.665807:0:3625:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a141aae300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3625:1876325050838272:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1789403542.665873:0:3625:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1789403542.665971:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:0.0:1789403542.665977:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:0.0:1789403542.665980:0:37:0:(import.c:65:import_set_state_nolock()) ffff90a27dbdd800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1789403542.665985:0:37:0:(import.c:545:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 585 00000100:00080000:0.0:1789403542.665988:0:37:0:(import.c:630:import_select_connection()) lustre-MDT0001-osp-MDT0000: tried all connections, increasing latency to 15s 00000100:00080000:0.0:1789403542.665995:0:37:0:(import.c:666:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff90a27dbdd800 using connection 192.168.203.143@tcp/0@lo 00000100:00100000:0.0:1789403542.666019:0:37:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff90a144beca80 x1876325050838400/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1789403542.666041:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1789403542.666044:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1789403542.666047:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1789403542.666049:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1789403542.666092:0:3626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a144bec000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3626:1876325050838528:0@lo:400:kworker.0 00000100:00100000:0.0:1789403542.666131:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789403542.666170:0:22786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050838528 00000100:00100000:0.0:1789403542.666176:0:22786:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050838528 00000100:00100000:0.0:1789403542.666215:0:22786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1789403542.666223:0:22786:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a144bee300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3626:x1876325050838528:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789403542.666270:0:22786:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a144bee300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3626:x1876325050838528:12345-0@lo:400:kworker.0 Request processed in 47us (138us total) trans 0 rc 0/0 00000100:00100000:0.0:1789403542.666287:0:22786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:0.0:1789403542.666323:0:3626:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff90a144bec000 x1876325050838528/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789403558 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789403542.666336:0:3626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a144bec000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3626:1876325050838528:0@lo:400:kworker.0 00000100:00100000:3.0:1789403542.666473:0:3625:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a144beca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3625:1876325050838400:0@lo:38:kworker.0 00000100:00100000:3.0:1789403542.666501:0:3625:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789403542.666570:0:22792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050838272 00000100:00100000:0.0:1789403542.666574:0:22792:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050838272 00000100:00100000:0.0:1789403542.666588:0:22792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050838400 00000100:00100000:0.0:1789403542.666590:0:22792:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050838400 00000100:00100000:0.0:1789403542.666600:0:22792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1789403542.666605:0:22792:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a144b28e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3625:x1876325050838272:12345-0@lo:38:llog_process_th.0 00010000:00080000:0.0:1789403542.666693:0:22792:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 588 last 0 00000020:00000080:0.0:1789403542.666724:0:22792:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x5fb08b1e5b7626ae 00000004:00100000:0.0:1789403542.666738:0:22792:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000001:00000004:0.0:1789403542.666744:0:22792:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 3, last_transno is 12884901888 00000040:01000000:1.0:1789403542.667984:0:23522:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:1.0:1789403542.668278:0:23522:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0001 ctxt 2 is initialized 00000040:00080000:1.0:1789403542.672880:0:23522:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1789403542.673753:0:23522:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].3, 64 off8384 00000040:00080000:1.0:1789403542.673922:0:23522:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xc:0x0].1, 64 off8256 00000100:00080000:3.0:1789403542.675935:0:22792:0:(import.c:65:import_set_state_nolock()) ffff90a281b12800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1789403542.676144:0:22792:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a144b28e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3625:x1876325050838272:12345-0@lo:38:llog_process_th.0 Request processed in 9535us (10268us total) trans 0 rc 0/0 00000100:00100000:3.0:1789403542.676155:0:22792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1789403542.676183:0:22792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1789403542.676189:0:22792:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a144b29880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3625:x1876325050838400:12345-0@lo:38:kworker.0 00000100:00100000:3.0:1789403542.676226:0:22792:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a144b29880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3625:x1876325050838400:12345-0@lo:38:kworker.0 Request processed in 37us (9725us total) trans 0 rc -11/-11 00000100:00100000:3.0:1789403542.676232:0:22792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000040:00080000:2.0:1789403542.676469:0:23527:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:2.0:1789403542.676474:0:23527:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xc:0x0] at index 3 of catalog [0x1:0x2:0x0] 00000020:00000080:1.0:1789403542.677169:0:23522:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:1.0:1789403542.677181:0:23522:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:1.0:1789403542.677216:0:23522:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:1.0:1789403542.677237:0:23522:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x5fb08b1e5b7626b5 00000100:00080000:1.0:1789403542.677244:0:23522:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1789403542.677253:0:23522:0:(import.c:666:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff90a14249e000 using connection 192.168.203.143@tcp/0@lo 00000100:00100000:1.0:1789403542.677283:0:23522:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff90a141aac700 x1876325050838656/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1789403542.677300:0:23522:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:1.0:1789403542.677361:0:23522:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789403542.677366:0:23522:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789403542.677367:0:23522:0:(obd_config.c:1563:class_process_config()) marker 23 (0x2) lustre-OST0000 add osc 00000020:01000000:1.0:1789403542.677370:0:23522:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:1.0:1789403542.677373:0:23522:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #27 00000020:01000000:1.0:1789403542.677380:0:23522:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1789403542.677382:0:23522:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1789403542.677384:0:23522:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:1.0:1789403542.677415:0:23522:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789403542.677417:0:23522:0:(obd_config.c:1563:class_process_config()) marker 27 (0x6) lustre sys.timeout 00000020:01000000:1.0:1789403542.677420:0:23522:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1789403542.677425:0:23522:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/mds2_flakey 00000020:00000080:1.0:1789403542.677429:0:23522:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789403542.677430:0:23522:0:(obd_config.c:1563:class_process_config()) marker 31 (0x1) lustre-OST0001 add osc 00000020:00000080:1.0:1789403542.677433:0:23522:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1789403542.677437:0:23522:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.203.143@tcp to nid 0x20000c0a8cb8f (192.168.203.143@tcp) 00000020:01000000:1.0:1789403542.677456:0:23522:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0001) 00000020:00000080:1.0:1789403542.677459:0:23522:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1789403542.677469:0:23522:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0001 (ffff90a281870000) 00000020:00000080:1.0:1789403542.677481:0:23522:0:(obd_config.c:720:class_attach_name()) OBD: dev 18 attached type osp with refcount 2 00000020:00000080:1.0:1789403542.677486:0:23522:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1789403542.677551:0:23522:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0001: connect to lustre-MDT0001-osd (lustre-OST0001-osc-MDT0001) 00080000:01000000:1.0:1789403542.677558:0:23522:0:(osd_handler.c:8924:osd_obd_connect()) connect #5 00000020:00000080:1.0:1789403542.677564:0:23522:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0x5fb08b1e5b7626c3 00010000:00080000:1.0:1789403542.677588:0:23522:0:(ldlm_lib.c:102:import_set_conn()) imp ffff90a26d291800@lustre-OST0001-osc-MDT0001: add connection 192.168.203.143@tcp at head 00010000:00010000:1.0:1789403542.677787:0:23522:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0001-7 is initialized 00000040:01000000:1.0:1789403542.677848:0:23522:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:1.0:1789403542.677863:0:23522:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0001 ctxt 2 is initialized 00000100:00080000:3.0:1789403542.678152:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1789403542.678158:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1789403542.678161:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1789403542.678163:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000040:00080000:3.0:1789403542.683530:0:23522:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1789403542.683745:0:3625:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:0.0:1789403542.683757:0:3625:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0000-osp-MDT0001: connect to target with instance 3 00000100:00080000:0.0:1789403542.683765:0:3625:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0000-osp-MDT0001: Resetting ns_connect_flags to server flags: 0xa2400010450010a0 00000100:00080000:0.0:1789403542.683771:0:3625:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1789403542.683774:0:3625:0:(import.c:65:import_set_state_nolock()) ffff90a143690800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1789403542.683796:0:3625:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a141aae300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3625:1876325050838272:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1789403542.683836:0:3625:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a141aac700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3625:1876325050838656:0@lo:8:llog_process_th.0 00000400:00000100:0.0:1789403542.683885:0:3625:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1876325050838656 offset 0 length 520: 4 00000100:00100000:0.0:1789403542.683927:0:3625:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1789403542.683932:0:3625:0:(import.c:65:import_set_state_nolock()) ffff90a27dbdd800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1789403542.683943:0:3625:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-11) 00000100:00100000:0.0:1789403542.683946:0:3625:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a144beca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3625:1876325050838400:0@lo:38:kworker.0 00000040:00080000:3.0:1789403542.684214:0:23522:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].3, 64 off8384 00000040:00080000:3.0:1789403542.684324:0:23522:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xe:0x0].1, 64 off8256 00000100:00100000:3.0:1789403542.684498:0:3627:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a141aafb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3627:1876325050838784:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1789403542.684538:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789403542.684618:0:22791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050838784 00000100:00100000:1.0:1789403542.684626:0:22791:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050838784 00000100:00100000:1.0:1789403542.684671:0:22791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1789403542.684680:0:22791:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a144b28000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3627:x1876325050838784:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1789403542.684708:0:22791:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446309888 avail 1300070400 00000100:00100000:1.0:1789403542.684778:0:22791:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a144b28000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3627:x1876325050838784:12345-0@lo:41:osp-pre-0-1.0 Request processed in 100us (240us total) trans 0 rc 0/0 00000100:00100000:1.0:1789403542.684784:0:22791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1789403542.684924:0:3627:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a141aafb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3627:1876325050838784:0@lo:41:osp-pre-0-1.0 00000040:00080000:1.0:1789403542.685355:0:23529:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:1.0:1789403542.685360:0:23529:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 3 of catalog [0x1:0x5:0x0] 00000020:00000080:3.0:1789403542.686309:0:23522:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:3.0:1789403542.686322:0:23522:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:3.0:1789403542.686361:0:23522:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:3.0:1789403542.686382:0:23522:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x5fb08b1e5b7626ca 00000100:00080000:3.0:1789403542.686436:0:23522:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1789403542.686446:0:23522:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff90a26d291800 using connection 192.168.203.143@tcp/0@lo 00000100:00100000:3.0:1789403542.686478:0:23522:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff90a144b29f80 x1876325050838912/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1789403542.686496:0:23522:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:3.0:1789403542.686551:0:23522:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789403542.686556:0:23522:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789403542.686558:0:23522:0:(obd_config.c:1563:class_process_config()) marker 31 (0x2) lustre-OST0001 add osc 00000020:01000000:3.0:1789403542.686561:0:23522:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789403542.686564:0:23522:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789403542.686566:0:23522:0:(obd_config.c:1563:class_process_config()) marker 35 (0x1) lustre sys.timeout 00000020:00000080:3.0:1789403542.686569:0:23522:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1789403542.686570:0:23522:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:3.0:1789403542.686573:0:23522:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789403542.686575:0:23522:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789403542.686576:0:23522:0:(obd_config.c:1563:class_process_config()) marker 35 (0x2) lustre sys.timeout 00000020:01000000:3.0:1789403542.686579:0:23522:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789403542.686581:0:23522:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789403542.686582:0:23522:0:(obd_config.c:1563:class_process_config()) marker 40 (0x1) lustre sys.jobid_var 00000020:00000080:3.0:1789403542.686586:0:23522:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:3.0:1789403542.686609:0:23522:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789403542.686612:0:23522:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789403542.686613:0:23522:0:(obd_config.c:1563:class_process_config()) marker 40 (0x2) lustre sys.jobid_var 00000040:00080000:3.0:1789403542.686616:0:23522:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xe:0x0] index 46 count 46 00000020:01000000:3.0:1789403542.686731:0:23518:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 1-45 (rc=0) 10000000:01000000:3.0:1789403542.686760:0:23518:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.143@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:3.0:1789403542.686777:0:23518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.143@tcp lock: ffff90a259946400/0x5fb08b1e5b76264c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb08b1e5b762653 expref: -99 pid: 23518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403542.686798:0:23518:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.143@tcp lock: ffff90a259946400/0x5fb08b1e5b76264c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb08b1e5b762653 expref: -99 pid: 23518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789403542.686814:0:23518:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff90a144165800 from 1 10000000:01000000:3.0:1789403542.686817:0:23518:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1789403542.686851:0:23518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.143@tcp lock: ffff90a259946800/0x5fb08b1e5b7626d1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 23518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403542.686859:0:23518:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.143@tcp lock: ffff90a259946800/0x5fb08b1e5b7626d1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 23518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403542.686869:0:23518:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.143@tcp lock: ffff90a259946800/0x5fb08b1e5b7626d1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 23518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789403542.686886:0:23518:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a144b29180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7ccb4038-daf9-4dcd-9b85-da9390181204:23518:1876325050839040:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1789403542.686940:0:23518:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789403542.686969:0:23518:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a2616436c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789403542.687152:0:22778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050839040 00000100:00100000:0.0:1789403542.687160:0:22778:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050839040 00000100:00100000:0.0:1789403542.687199:0:22778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1789403542.687207:0:22778:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a276a77050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7ccb4038-daf9-4dcd-9b85-da9390181204+15:23518:x1876325050839040:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1789403542.687218:0:22778:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789403542.687231:0:22778:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90a248af1c00/0x5fb08b1e5b7626d8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x5fb08b1e5b7626d1 expref: -99 pid: 22778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403542.687254:0:22778:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90a248af1c00/0x5fb08b1e5b7626d8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5fb08b1e5b7626d1 expref: 16 pid: 22778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403542.687263:0:22778:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90a248af1c00/0x5fb08b1e5b7626d8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5fb08b1e5b7626d1 expref: 16 pid: 22778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403542.687270:0:22778:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a248af1c00, rc 0) 00000100:00100000:0.0:1789403542.687314:0:22778:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a276a77050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7ccb4038-daf9-4dcd-9b85-da9390181204+16:23518:x1876325050839040:12345-0@lo:101:mount.lustre.0 Request processed in 108us (374us total) trans 0 rc 0/0 00000100:00100000:0.0:1789403542.687321:0:22778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1789403542.687355:0:3625:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a144b29f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3625:1876325050838912:0@lo:8:llog_process_th.0 00000400:00000100:0.0:1789403542.687378:0:3625:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1876325050838912 offset 0 length 520: 4 00000100:00080000:1.0:1789403542.687487:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789403542.687492:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1789403542.687495:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789403542.687498:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1789403542.687582:0:23518:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a144b29180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7ccb4038-daf9-4dcd-9b85-da9390181204:23518:1876325050839040:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1789403542.687597:0:23518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.143@tcp lock: ffff90a259946800/0x5fb08b1e5b7626d1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb08b1e5b7626d8 expref: -99 pid: 23518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403542.687606:0:23518:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.143@tcp lock: ffff90a259946800/0x5fb08b1e5b7626d1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x5fb08b1e5b7626d8 expref: -99 pid: 23518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789403542.688658:0:23518:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a144b29180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7ccb4038-daf9-4dcd-9b85-da9390181204:23518:1876325050839168:0@lo:256:mount.lustre.0 00000100:00100000:3.0:1789403542.688709:0:23518:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789403542.688775:0:23518:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a2616436c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789403542.688891:0:22781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050839168 00000100:00100000:2.0:1789403542.688897:0:22781:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050839168 00000100:00100000:2.0:1789403542.688975:0:22781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1789403542.688984:0:22781:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a27c943450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7ccb4038-daf9-4dcd-9b85-da9390181204+16:23518:x1876325050839168:12345-0@lo:256:mount.lustre.0 20000000:01000000:2.0:1789403542.689016:0:22781:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:2.0:1789403542.689033:0:22781:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:2.0:1789403542.689037:0:22781:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 11 00000100:00100000:2.0:1789403542.689144:0:22781:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a27c943450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7ccb4038-daf9-4dcd-9b85-da9390181204+16:23518:x1876325050839168:12345-0@lo:256:mount.lustre.0 Request processed in 160us (434us total) trans 0 rc 0/0 00000100:00100000:2.0:1789403542.689151:0:22781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1789403542.689217:0:23518:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a144b29180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7ccb4038-daf9-4dcd-9b85-da9390181204:23518:1876325050839168:0@lo:256:mount.lustre.0 10000000:01000000:3.0:1789403542.689851:0:23518:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.143@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1789403542.689871:0:23518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.143@tcp lock: ffff90a259946800/0x5fb08b1e5b7626d1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb08b1e5b7626d8 expref: -99 pid: 23518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403542.689881:0:23518:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.143@tcp lock: ffff90a259946800/0x5fb08b1e5b7626d1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb08b1e5b7626d8 expref: -99 pid: 23518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789403542.689890:0:23518:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff90a144165800 from 1 10000000:01000000:3.0:1789403542.689892:0:23518:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1789403542.689917:0:23518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.143@tcp lock: ffff90a259946600/0x5fb08b1e5b7626df lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 23518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403542.689924:0:23518:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.143@tcp lock: ffff90a259946600/0x5fb08b1e5b7626df lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 23518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403542.689933:0:23518:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.143@tcp lock: ffff90a259946600/0x5fb08b1e5b7626df lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 23518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789403542.689949:0:23518:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a144b29180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7ccb4038-daf9-4dcd-9b85-da9390181204:23518:1876325050839296:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1789403542.689981:0:23518:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789403542.690347:0:23518:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a2616436c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789403542.690497:0:22778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050839296 00000100:00100000:0.0:1789403542.690504:0:22778:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050839296 00000100:00100000:0.0:1789403542.690535:0:22778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1789403542.690543:0:22778:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a27c943850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7ccb4038-daf9-4dcd-9b85-da9390181204+16:23518:x1876325050839296:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1789403542.690553:0:22778:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789403542.690573:0:22778:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90a248af0800/0x5fb08b1e5b7626e6 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x5fb08b1e5b7626df expref: -99 pid: 22778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403542.690596:0:22778:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90a248af0800/0x5fb08b1e5b7626e6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5fb08b1e5b7626df expref: 17 pid: 22778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403542.690606:0:22778:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90a248af0800/0x5fb08b1e5b7626e6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5fb08b1e5b7626df expref: 17 pid: 22778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403542.690614:0:22778:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a248af0800, rc 0) 00000100:00100000:0.0:1789403542.690696:0:22778:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a27c943850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7ccb4038-daf9-4dcd-9b85-da9390181204+17:23518:x1876325050839296:12345-0@lo:101:mount.lustre.0 Request processed in 152us (713us total) trans 0 rc 0/0 00000100:00100000:0.0:1789403542.690702:0:22778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1789403542.690923:0:23518:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a144b29180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7ccb4038-daf9-4dcd-9b85-da9390181204:23518:1876325050839296:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1789403542.690937:0:23518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.143@tcp lock: ffff90a259946600/0x5fb08b1e5b7626df lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb08b1e5b7626e6 expref: -99 pid: 23518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403542.690946:0:23518:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.143@tcp lock: ffff90a259946600/0x5fb08b1e5b7626df lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x5fb08b1e5b7626e6 expref: -99 pid: 23518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1789403542.693497:0:23518:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 13 count 13 00000040:00080000:3.0:1789403542.693781:0:23518:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1789403542.694345:0:23518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].1, 224 off8416 00000040:00080000:3.0:1789403542.694372:0:23518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].2, 112 off8528 00000040:00080000:3.0:1789403542.694756:0:23518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].3, 224 off8752 00000040:00080000:3.0:1789403542.694786:0:23518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].4, 224 off8976 00000040:00080000:3.0:1789403542.694803:0:23518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].5, 112 off9088 00000040:00080000:3.0:1789403542.694818:0:23518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].6, 224 off9312 00000040:00080000:3.0:1789403542.694849:0:23518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].7, 224 off9536 00000040:00080000:3.0:1789403542.694864:0:23518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].8, 128 off9664 00000040:00080000:3.0:1789403542.694877:0:23518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].9, 224 off9888 00000040:00080000:3.0:1789403542.694891:0:23518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].10, 224 off10112 00000040:00080000:3.0:1789403542.694906:0:23518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].11, 128 off10240 00000040:00080000:3.0:1789403542.694939:0:23518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].12, 224 off10464 00000040:00080000:3.0:1789403542.694946:0:23518:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 12 count 13 00000100:00100000:3.0:1789403542.695022:0:23518:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a144b29180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7ccb4038-daf9-4dcd-9b85-da9390181204:23518:1876325050839424:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789403542.695097:0:23518:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789403542.695150:0:23518:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a261643000 going to sleep for 11 seconds 00000100:00100000:1.0:1789403542.695311:0:22778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050839424 00000100:00100000:1.0:1789403542.695318:0:22778:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050839424 00000100:00100000:1.0:1789403542.695368:0:22778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1789403542.695378:0:22778:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a27c940450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7ccb4038-daf9-4dcd-9b85-da9390181204+17:23518:x1876325050839424:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789403542.695511:0:22778:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a27c940450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7ccb4038-daf9-4dcd-9b85-da9390181204+17:23518:x1876325050839424:12345-0@lo:501:mount.lustre.0 Request processed in 134us (413us total) trans 0 rc 0/0 00000100:00100000:1.0:1789403542.695518:0:22778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1789403542.695641:0:23518:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a144b29180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7ccb4038-daf9-4dcd-9b85-da9390181204:23518:1876325050839424:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789403542.695678:0:23518:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a27a64df80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7ccb4038-daf9-4dcd-9b85-da9390181204:23518:1876325050839552:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1789403542.695716:0:23518:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789403542.695743:0:23518:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a27a620d80 going to sleep for 11 seconds 00000100:00100000:1.0:1789403542.695796:0:22780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050839552 00000100:00100000:1.0:1789403542.695800:0:22780:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050839552 00000100:00100000:1.0:1789403542.695838:0:22780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1789403542.695845:0:22780:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a27c942450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7ccb4038-daf9-4dcd-9b85-da9390181204+17:23518:x1876325050839552:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1789403542.695923:0:22780:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a27c942450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7ccb4038-daf9-4dcd-9b85-da9390181204+17:23518:x1876325050839552:12345-0@lo:503:mount.lustre.0 Request processed in 77us (205us total) trans 0 rc 0/0 00000100:00100000:1.0:1789403542.695930:0:22780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1789403542.696067:0:23518:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a27a64df80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7ccb4038-daf9-4dcd-9b85-da9390181204:23518:1876325050839552:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1789403542.696470:0:23518:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1789403542.696532:0:23518:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a27a64df80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7ccb4038-daf9-4dcd-9b85-da9390181204:23518:1876325050839680:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1789403542.696567:0:23518:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789403542.696587:0:23518:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a27a620d80 going to sleep for 11 seconds 00000100:00100000:1.0:1789403542.696698:0:22780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050839680 00000100:00100000:1.0:1789403542.696704:0:22780:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050839680 00000100:00100000:1.0:1789403542.696739:0:22780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1789403542.696747:0:22780:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a27c943c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7ccb4038-daf9-4dcd-9b85-da9390181204+17:23518:x1876325050839680:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1789403542.696841:0:22780:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a27c943c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7ccb4038-daf9-4dcd-9b85-da9390181204+17:23518:x1876325050839680:12345-0@lo:502:mount.lustre.0 Request processed in 94us (272us total) trans 0 rc 0/0 00000100:00100000:1.0:1789403542.696848:0:22780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1789403542.697137:0:23518:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a27a64df80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7ccb4038-daf9-4dcd-9b85-da9390181204:23518:1876325050839680:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1789403542.697320:0:23518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].1, 224 off8416 00000040:00080000:2.0:1789403542.697345:0:23518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].2, 112 off8528 00000040:00080000:2.0:1789403542.697369:0:23518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].3, 224 off8752 00000040:00080000:2.0:1789403542.697384:0:23518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].4, 224 off8976 00000040:00080000:2.0:1789403542.697435:0:23518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].5, 112 off9088 00000040:00080000:2.0:1789403542.697450:0:23518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].6, 224 off9312 00000040:00080000:2.0:1789403542.697462:0:23518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].7, 224 off9536 00000040:00080000:2.0:1789403542.697476:0:23518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].8, 128 off9664 00000040:00080000:2.0:1789403542.697488:0:23518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].9, 224 off9888 00000040:00080000:2.0:1789403542.697501:0:23518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].10, 224 off10112 00000040:00080000:2.0:1789403542.697515:0:23518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].11, 128 off10240 00000100:00100000:2.0:1789403542.697538:0:23518:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a27a64df80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7ccb4038-daf9-4dcd-9b85-da9390181204:23518:1876325050839808:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1789403542.697574:0:23518:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789403542.697645:0:23518:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a27a620d80 going to sleep for 11 seconds 00000100:00100000:1.0:1789403542.697785:0:22780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050839808 00000100:00100000:1.0:1789403542.697791:0:22780:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050839808 00000100:00100000:1.0:1789403542.697910:0:22780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1789403542.697919:0:22780:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a27c940c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7ccb4038-daf9-4dcd-9b85-da9390181204+17:23518:x1876325050839808:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1789403542.698003:0:22780:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a27c940c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7ccb4038-daf9-4dcd-9b85-da9390181204+17:23518:x1876325050839808:12345-0@lo:502:mount.lustre.0 Request processed in 85us (429us total) trans 0 rc 0/0 00000100:00100000:1.0:1789403542.698010:0:22780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1789403542.698082:0:23518:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a27a64df80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7ccb4038-daf9-4dcd-9b85-da9390181204:23518:1876325050839808:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1789403542.698134:0:23518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].12, 224 off10464 00000040:00080000:2.0:1789403542.698142:0:23518:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 12 count 13 00000020:01000000:2.0:1789403542.698759:0:23531:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789403542.698767:0:23531:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789403542.698769:0:23531:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:2.0:1789403542.698775:0:23531:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff90a144165800 00000020:00000080:2.0:1789403542.698778:0:23531:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1789403542.698784:0:23531:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789403542.698786:0:23531:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789403542.698788:0:23531:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:2.0:1789403542.698790:0:23531:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789403542.698792:0:23531:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789403542.698793:0:23531:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:2.0:1789403542.698796:0:23531:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff90a144165800 00000020:00000080:2.0:1789403542.698798:0:23531:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1789403542.698862:0:23531:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789403542.698865:0:23531:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789403542.698866:0:23531:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:2.0:1789403542.698875:0:23531:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789403542.698878:0:23531:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789403542.698879:0:23531:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1789403542.698883:0:23531:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff90a144165800 00000020:00000080:2.0:1789403542.698884:0:23531:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1789403542.698904:0:23531:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789403542.698907:0:23531:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789403542.698908:0:23531:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1789403542.698911:0:23531:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789403542.698913:0:23531:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789403542.698914:0:23531:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:2.0:1789403542.698917:0:23531:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff90a144165800 00000020:00000080:2.0:1789403542.698919:0:23531:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1789403542.698951:0:23531:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789403542.698954:0:23531:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789403542.698955:0:23531:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:2.0:1789403542.698958:0:23531:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x10:0x0] index 13 count 13 00000020:01000000:1.0:1789403542.702422:0:23518:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:1.0:1789403542.702597:0:23518:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.143@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1789403542.702614:0:23518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.143@tcp lock: ffff90a259946600/0x5fb08b1e5b7626df lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb08b1e5b7626e6 expref: -99 pid: 23518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403542.702626:0:23518:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.143@tcp lock: ffff90a259946600/0x5fb08b1e5b7626df lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb08b1e5b7626e6 expref: -99 pid: 23518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789403542.702704:0:23518:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:1.0:1789403542.702707:0:23518:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff90a144165800 10000000:01000000:1.0:1789403542.702710:0:23518:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff90a144165800 10000000:01000000:1.0:1789403542.702714:0:23518:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1789403542.702720:0:23518:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff90a144165800 from 1 10000000:01000000:1.0:1789403542.702722:0:23518:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1789403542.702756:0:23518:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.143@tcp lock: ffff90a144062400/0x5fb08b1e5b7626ed lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 23518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403542.702764:0:23518:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.143@tcp lock: ffff90a144062400/0x5fb08b1e5b7626ed lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 23518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403542.702781:0:23518:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.143@tcp lock: ffff90a144062400/0x5fb08b1e5b7626ed lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 23518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789403542.702805:0:23518:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a141aafb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7ccb4038-daf9-4dcd-9b85-da9390181204:23518:1876325050839936:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1789403542.703426:0:23518:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789403542.703474:0:22778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050839936 00000100:00100000:1.0:1789403542.703481:0:22778:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050839936 00000100:00100000:1.0:1789403542.703646:0:22778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1789403542.703656:0:22778:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a27c941050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7ccb4038-daf9-4dcd-9b85-da9390181204+17:23518:x1876325050839936:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1789403542.703670:0:22778:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789403542.703684:0:22778:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90a144062000/0x5fb08b1e5b7626f4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x5fb08b1e5b7626ed expref: -99 pid: 22778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403542.703707:0:22778:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90a144062000/0x5fb08b1e5b7626f4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5fb08b1e5b7626ed expref: 18 pid: 22778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403542.703718:0:22778:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90a144062000/0x5fb08b1e5b7626f4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5fb08b1e5b7626ed expref: 18 pid: 22778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403542.703727:0:22778:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a144062000, rc 0) 00000100:00100000:1.0:1789403542.703761:0:22778:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a27c941050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7ccb4038-daf9-4dcd-9b85-da9390181204+18:23518:x1876325050839936:12345-0@lo:101:mount.lustre.0 Request processed in 106us (336us total) trans 0 rc 0/0 00000100:00100000:1.0:1789403542.703767:0:22778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1789403542.703808:0:23518:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a27a5266c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789403542.703829:0:23518:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a141aafb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7ccb4038-daf9-4dcd-9b85-da9390181204:23518:1876325050839936:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1789403542.704493:0:23518:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.143@tcp lock: ffff90a144062400/0x5fb08b1e5b7626ed lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb08b1e5b7626f4 expref: -99 pid: 23518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403542.704619:0:23518:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.143@tcp lock: ffff90a144062400/0x5fb08b1e5b7626ed lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x5fb08b1e5b7626f4 expref: -99 pid: 23518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1789403542.708148:0:23518:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xc:0x0] index 52 count 51 00000040:00080000:0.0:1789403542.708446:0:23518:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1789403542.708646:0:23518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].1, 224 off8416 00000040:00080000:0.0:1789403542.708671:0:23518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].2, 120 off8536 00000040:00080000:0.0:1789403542.708686:0:23518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].3, 168 off8704 00000040:00080000:0.0:1789403542.708701:0:23518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].4, 224 off8928 00000040:00080000:0.0:1789403542.708714:0:23518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].5, 224 off9152 00000040:00080000:0.0:1789403542.708728:0:23518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].6, 120 off9272 00000040:00080000:0.0:1789403542.708751:0:23518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].7, 168 off9440 00000040:00080000:0.0:1789403542.708763:0:23518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].8, 224 off9664 00000040:00080000:0.0:1789403542.708773:0:23518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].9, 224 off9888 00000040:00080000:0.0:1789403542.708784:0:23518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].10, 120 off10008 00000040:00080000:0.0:1789403542.708795:0:23518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].11, 224 off10232 00000040:00080000:0.0:1789403542.708806:0:23518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].12, 224 off10456 00000040:00080000:0.0:1789403542.708816:0:23518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].13, 88 off10544 00000040:00080000:0.0:1789403542.709958:0:23518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].14, 128 off10672 00000040:00080000:0.0:1789403542.709984:0:23518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].15, 144 off10816 00000040:00080000:0.0:1789403542.709997:0:23518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].16, 160 off10976 00000040:00080000:0.0:1789403542.710009:0:23518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].17, 224 off11200 00000040:00080000:0.0:1789403542.710035:0:23518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].18, 224 off11424 00000040:00080000:0.0:1789403542.710048:0:23518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].19, 80 off11504 00000040:00080000:0.0:1789403542.710232:0:23518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].20, 224 off11728 00000040:00080000:0.0:1789403542.710249:0:23518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].21, 224 off11952 00000040:00080000:0.0:1789403542.710263:0:23518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].22, 88 off12040 00000040:00080000:0.0:1789403542.710290:0:23518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].23, 128 off12168 00000040:00080000:0.0:1789403542.710306:0:23518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].24, 144 off12312 00000040:00080000:0.0:1789403542.710321:0:23518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].25, 160 off12472 00000040:00080000:0.0:1789403542.710334:0:23518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].26, 224 off12696 00000040:00080000:0.0:1789403542.710347:0:23518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].27, 224 off12920 00000040:00080000:0.0:1789403542.710361:0:23518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].28, 80 off13000 00000040:00080000:0.0:1789403542.710374:0:23518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].29, 224 off13224 00000040:00080000:0.0:1789403542.710411:0:23518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].30, 224 off13448 00000040:00080000:0.0:1789403542.710429:0:23518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].31, 88 off13536 00000040:00080000:0.0:1789403542.710444:0:23518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].32, 128 off13664 00000040:00080000:0.0:1789403542.710457:0:23518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].33, 144 off13808 00000040:00080000:0.0:1789403542.710472:0:23518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].34, 128 off13936 00000040:00080000:0.0:1789403542.710485:0:23518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].35, 224 off14160 00000040:00080000:0.0:1789403542.710499:0:23518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].36, 224 off14384 00000040:00080000:0.0:1789403542.710527:0:23518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].37, 80 off14464 00000040:00080000:0.0:1789403542.710544:0:23518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].38, 224 off14688 00000040:00080000:0.0:1789403542.710570:0:23518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].39, 224 off14912 00000040:00080000:0.0:1789403542.710586:0:23518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].40, 88 off15000 00000040:00080000:0.0:1789403542.710600:0:23518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].41, 128 off15128 00000040:00080000:0.0:1789403542.710614:0:23518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].42, 144 off15272 00000040:00080000:0.0:1789403542.710627:0:23518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].43, 128 off15400 00000040:00080000:0.0:1789403542.710639:0:23518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].44, 224 off15624 00000040:00080000:0.0:1789403542.710651:0:23518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].45, 224 off15848 00000040:00080000:0.0:1789403542.710663:0:23518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].46, 80 off15928 00000040:00080000:0.0:1789403542.710677:0:23518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].47, 224 off16152 00000040:00080000:0.0:1789403542.710691:0:23518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].48, 232 off16384 00000040:00080000:0.0:1789403542.712142:0:23518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].49, 224 off16608 00000040:00080000:0.0:1789403542.712190:0:23518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].50, 120 off16728 00000040:00080000:0.0:1789403542.712227:0:23518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x11:0x0].51, 224 off16952 00000040:00080000:0.0:1789403542.712233:0:23518:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xc:0x0] index 51 count 51 00000100:00100000:0.0:1789403542.712333:0:23518:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a144beca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7ccb4038-daf9-4dcd-9b85-da9390181204:23518:1876325050840064:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789403542.712913:0:23518:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789403542.713004:0:23518:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a277b00cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1789403542.715380:0:22780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050840064 00000100:00100000:1.0:1789403542.715407:0:22780:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050840064 00000100:00100000:1.0:1789403542.715526:0:22780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1789403542.715537:0:22780:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a27c941c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7ccb4038-daf9-4dcd-9b85-da9390181204+18:23518:x1876325050840064:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789403542.715700:0:22780:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a27c941c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7ccb4038-daf9-4dcd-9b85-da9390181204+18:23518:x1876325050840064:12345-0@lo:501:mount.lustre.0 Request processed in 165us (2788us total) trans 0 rc 0/0 00000100:00100000:1.0:1789403542.715708:0:22780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1789403542.715788:0:23518:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a144beca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7ccb4038-daf9-4dcd-9b85-da9390181204:23518:1876325050840064:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789403542.717590:0:23518:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a144beca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7ccb4038-daf9-4dcd-9b85-da9390181204:23518:1876325050840192:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1789403542.717656:0:23518:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789403542.717694:0:22781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050840192 00000100:00100000:0.0:1789403542.717701:0:22781:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050840192 00000100:00100000:0.0:1789403542.717740:0:22781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1789403542.717749:0:22781:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a27c943050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7ccb4038-daf9-4dcd-9b85-da9390181204+18:23518:x1876325050840192:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1789403542.717924:0:22781:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a27c943050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7ccb4038-daf9-4dcd-9b85-da9390181204+18:23518:x1876325050840192:12345-0@lo:503:mount.lustre.0 Request processed in 175us (267us total) trans 0 rc 0/0 00000100:00100000:0.0:1789403542.717932:0:22781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1789403542.717984:0:23518:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a277b00cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1789403542.718002:0:23518:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a144beca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7ccb4038-daf9-4dcd-9b85-da9390181204:23518:1876325050840192:0@lo:503:mount.lustre.0 00000040:00080000:0.0:1789403542.718488:0:23518:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1789403542.718914:0:23518:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a144beca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7ccb4038-daf9-4dcd-9b85-da9390181204:23518:1876325050840320:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1789403542.718953:0:23518:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789403542.718978:0:22781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050840320 00000100:00100000:0.0:1789403542.718983:0:22781:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050840320 00000100:00100000:0.0:1789403542.719007:0:22781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1789403542.719014:0:22781:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a27c942050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7ccb4038-daf9-4dcd-9b85-da9390181204+18:23518:x1876325050840320:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1789403542.719170:0:22781:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a27c942050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7ccb4038-daf9-4dcd-9b85-da9390181204+18:23518:x1876325050840320:12345-0@lo:502:mount.lustre.0 Request processed in 155us (215us total) trans 0 rc 0/0 00000100:00100000:0.0:1789403542.719184:0:22781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1789403542.719227:0:23518:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a14359c780 going to sleep for 11 seconds 00000100:00100000:0.0:1789403542.719243:0:23518:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a144beca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7ccb4038-daf9-4dcd-9b85-da9390181204:23518:1876325050840320:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1789403542.720344:0:23518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].1, 224 off8416 00000040:00080000:0.0:1789403542.720381:0:23518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].2, 120 off8536 00000040:00080000:0.0:1789403542.720415:0:23518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].3, 168 off8704 00000040:00080000:0.0:1789403542.720431:0:23518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].4, 224 off8928 00000040:00080000:0.0:1789403542.720443:0:23518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].5, 224 off9152 00000040:00080000:0.0:1789403542.720459:0:23518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].6, 120 off9272 00000040:00080000:0.0:1789403542.720472:0:23518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].7, 168 off9440 00000040:00080000:0.0:1789403542.720485:0:23518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].8, 224 off9664 00000040:00080000:0.0:1789403542.720497:0:23518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].9, 224 off9888 00000040:00080000:0.0:1789403542.720511:0:23518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].10, 120 off10008 00000040:00080000:0.0:1789403542.720525:0:23518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].11, 224 off10232 00000040:00080000:0.0:1789403542.720538:0:23518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].12, 224 off10456 00000040:00080000:0.0:1789403542.720550:0:23518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].13, 88 off10544 00000040:00080000:0.0:1789403542.720564:0:23518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].14, 128 off10672 00000040:00080000:0.0:1789403542.720578:0:23518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].15, 144 off10816 00000040:00080000:0.0:1789403542.720605:0:23518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].16, 160 off10976 00000040:00080000:0.0:1789403542.720621:0:23518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].17, 224 off11200 00000040:00080000:0.0:1789403542.720634:0:23518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].18, 224 off11424 00000040:00080000:0.0:1789403542.720647:0:23518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].19, 80 off11504 00000040:00080000:0.0:1789403542.720661:0:23518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].20, 224 off11728 00000040:00080000:0.0:1789403542.720689:0:23518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].21, 224 off11952 00000040:00080000:0.0:1789403542.720702:0:23518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].22, 88 off12040 00000040:00080000:0.0:1789403542.720714:0:23518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].23, 128 off12168 00000040:00080000:0.0:1789403542.720727:0:23518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].24, 144 off12312 00000040:00080000:0.0:1789403542.720741:0:23518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].25, 160 off12472 00000040:00080000:0.0:1789403542.720754:0:23518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].26, 224 off12696 00000040:00080000:0.0:1789403542.720769:0:23518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].27, 224 off12920 00000040:00080000:0.0:1789403542.720792:0:23518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].28, 80 off13000 00000040:00080000:0.0:1789403542.720806:0:23518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].29, 224 off13224 00000040:00080000:0.0:1789403542.720888:0:23518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].30, 224 off13448 00000040:00080000:0.0:1789403542.720909:0:23518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].31, 88 off13536 00000040:00080000:0.0:1789403542.720938:0:23518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].32, 128 off13664 00000040:00080000:0.0:1789403542.720955:0:23518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].33, 144 off13808 00000040:00080000:0.0:1789403542.720967:0:23518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].34, 128 off13936 00000040:00080000:0.0:1789403542.720979:0:23518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].35, 224 off14160 00000040:00080000:0.0:1789403542.720991:0:23518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].36, 224 off14384 00000040:00080000:0.0:1789403542.721004:0:23518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].37, 80 off14464 00000040:00080000:0.0:1789403542.721014:0:23518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].38, 224 off14688 00000040:00080000:0.0:1789403542.721027:0:23518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].39, 224 off14912 00000040:00080000:0.0:1789403542.721040:0:23518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].40, 88 off15000 00000040:00080000:0.0:1789403542.721054:0:23518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].41, 128 off15128 00000040:00080000:0.0:1789403542.721148:0:23518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].42, 144 off15272 00000040:00080000:0.0:1789403542.721163:0:23518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].43, 128 off15400 00000040:00080000:0.0:1789403542.721175:0:23518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].44, 224 off15624 00000040:00080000:0.0:1789403542.721186:0:23518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].45, 224 off15848 00000040:00080000:0.0:1789403542.721197:0:23518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].46, 80 off15928 00000040:00080000:0.0:1789403542.721207:0:23518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].47, 224 off16152 00000040:00080000:0.0:1789403542.721232:0:23518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].48, 232 off16384 00000100:00100000:0.0:1789403542.721279:0:23518:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a144beca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7ccb4038-daf9-4dcd-9b85-da9390181204:23518:1876325050840448:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1789403542.721337:0:23518:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789403542.721376:0:22781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050840448 00000100:00100000:0.0:1789403542.721383:0:22781:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050840448 00000100:00100000:0.0:1789403542.721438:0:22781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1789403542.721446:0:22781:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a27c940850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7ccb4038-daf9-4dcd-9b85-da9390181204+18:23518:x1876325050840448:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1789403542.721536:0:22781:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a27c940850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7ccb4038-daf9-4dcd-9b85-da9390181204+18:23518:x1876325050840448:12345-0@lo:502:mount.lustre.0 Request processed in 90us (198us total) trans 0 rc 0/0 00000100:00100000:0.0:1789403542.721544:0:22781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1789403542.721599:0:23518:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a14359c780 going to sleep for 11 seconds 00000100:00100000:0.0:1789403542.721617:0:23518:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a144beca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7ccb4038-daf9-4dcd-9b85-da9390181204:23518:1876325050840448:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1789403542.721781:0:23518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].49, 224 off16608 00000040:00080000:0.0:1789403542.721803:0:23518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].50, 120 off16728 00000100:00100000:0.0:1789403542.722214:0:23518:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a144beca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7ccb4038-daf9-4dcd-9b85-da9390181204:23518:1876325050840576:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1789403542.722256:0:23518:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789403542.722291:0:23518:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a14359c780 going to sleep for 11 seconds 00000100:00100000:1.0:1789403542.722347:0:22781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050840576 00000100:00100000:1.0:1789403542.722353:0:22781:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050840576 00000100:00100000:1.0:1789403542.722414:0:22781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1789403542.722423:0:22781:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a27c941450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7ccb4038-daf9-4dcd-9b85-da9390181204+18:23518:x1876325050840576:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1789403542.722500:0:22781:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a27c941450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7ccb4038-daf9-4dcd-9b85-da9390181204+18:23518:x1876325050840576:12345-0@lo:502:mount.lustre.0 Request processed in 79us (244us total) trans 0 rc 0/0 00000100:00100000:1.0:1789403542.722507:0:22781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1789403542.722628:0:23518:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a144beca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7ccb4038-daf9-4dcd-9b85-da9390181204:23518:1876325050840576:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1789403542.722671:0:23518:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x12:0x0].51, 224 off16952 00000040:00080000:0.0:1789403542.722679:0:23518:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 51 count 51 00000020:01000004:1.0:1789403542.726809:0:23536:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0001 (typ=lwp) 00000020:00000080:1.0:1789403542.726895:0:23536:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0001 (ffff90a281873380) 00000020:00000080:1.0:1789403542.726917:0:23536:0:(obd_config.c:720:class_attach_name()) OBD: dev 19 attached type lwp with refcount 2 00000020:01000004:1.0:1789403542.727007:0:23536:0:(tgt_mount.c:153:server_get_mount()) get mount ffff90a144165800 from lustre-MDT0001, refs=3 00000020:01000004:1.0:1789403542.727011:0:23536:0:(tgt_mount.c:187:server_put_mount()) put mount ffff90a144165800 from lustre-MDT0001, refs=3 00000020:01000004:1.0:1789403542.727014:0:23536:0:(obd_mount.c:710:lustre_put_lsi()) put ffff90a144165800 3 00010000:00080000:1.0:1789403542.727043:0:23536:0:(ldlm_lib.c:102:import_set_conn()) imp ffff90a2669be800@lustre-MDT0000-lwp-MDT0001: add connection 192.168.203.143@tcp at head 00010000:00010000:1.0:1789403542.729535:0:23536:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0001-8 is initialized 00000020:00000080:1.0:1789403542.729783:0:23536:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0001 (uuid lustre-MDT0000-lwp-MDT0001_UUID) 00000010:01000000:1.0:1789403542.729845:0:23536:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1789403542.729857:0:23536:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-MDT0001, cookie 0x5fb08b1e5b762702 00000100:00080000:1.0:1789403542.729867:0:23536:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1789403542.729877:0:23536:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff90a2669be800 using connection 192.168.203.143@tcp/0@lo 00000100:00100000:1.0:1789403542.729911:0:23536:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff90a141aafb80 x1876325050840704/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1789403542.729940:0:23536:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID 00000100:00080000:1.0:1789403542.729966:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789403542.729971:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1789403542.729973:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789403542.729976:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1789403542.730218:0:3625:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a141aafb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3625:1876325050840704:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1789403542.730281:0:3625:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789403542.730376:0:22788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050840704 00000100:00100000:1.0:1789403542.730384:0:22788:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050840704 00000100:00100000:1.0:1789403542.730445:0:22788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1789403542.730452:0:22788:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a27a64df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3625:x1876325050840704:12345-0@lo:38:llog_process_th.0 00010000:00080000:1.0:1789403542.730474:0:22788:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0001_UUID@0@lo t0 exp 0000000000000000 cur 588 last 0 00000020:00000080:1.0:1789403542.730509:0:22788:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-MDT0001_UUID, cookie 0x5fb08b1e5b762709 00000004:00100000:1.0:1789403542.730523:0:22788:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1789403542.730550:0:22788:0:(import.c:65:import_set_state_nolock()) ffff90a2669b8800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1789403542.730598:0:22788:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a27a64df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3625:x1876325050840704:12345-0@lo:38:llog_process_th.0 Request processed in 145us (317us total) trans 0 rc 0/0 00000100:00100000:1.0:1789403542.730606:0:22788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:2.0:1789403542.730754:0:3625:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff90a141aafb80 x1876325050840704/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1789403552 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789403542.730764:0:3625:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:2.0:1789403542.730771:0:3625:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0001: connect to target with instance 3 00000100:00080000:2.0:1789403542.730777:0:3625:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0001: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:2.0:1789403542.730780:0:3625:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1789403542.730782:0:3625:0:(import.c:65:import_set_state_nolock()) ffff90a2669be800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1789403542.730787:0:3625:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a141aafb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3625:1876325050840704:0@lo:38:llog_process_th.0 00000040:00080000:1.0:1789403542.731248:0:23536:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x12:0x0] index 52 count 51 00000020:01000000:0.0:1789403542.731690:0:23518:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:0.0:1789403542.731717:0:23518:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.143@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1789403542.731732:0:23518:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.143@tcp lock: ffff90a144062400/0x5fb08b1e5b7626ed lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb08b1e5b7626f4 expref: -99 pid: 23518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403542.731742:0:23518:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.143@tcp lock: ffff90a144062400/0x5fb08b1e5b7626ed lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb08b1e5b7626f4 expref: -99 pid: 23518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1789403542.731795:0:23518:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:0.0:1789403542.731797:0:23518:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:0.0:1789403542.731798:0:23518:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789403542.731800:0:23518:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789403542.731801:0:23518:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789403542.731802:0:23518:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789403542.731803:0:23518:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1789403542.731805:0:23518:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789403542.731807:0:23518:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1789403542.731811:0:23518:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0001 0x40020001 00000020:01000004:0.0:1789403542.731813:0:23518:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1789403542.731814:0:23518:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:0.0:1789403542.731815:0:23518:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789403542.732929:0:23518:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789403542.732930:0:23518:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789403542.732932:0:23518:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789403542.732933:0:23518:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1789403542.732935:0:23518:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789403542.732936:0:23518:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1789403542.733121:0:23518:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0001 00000100:00100000:0.0:1789403542.733141:0:23518:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a144beca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7ccb4038-daf9-4dcd-9b85-da9390181204:23518:1876325050840832:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1789403542.733199:0:23518:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789403542.733242:0:23518:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a14359c780 going to sleep for 11 seconds 00000100:00100000:1.0:1789403542.733297:0:22780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050840832 00000100:00100000:1.0:1789403542.733305:0:22780:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050840832 00000100:00100000:1.0:1789403542.733384:0:22780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1789403542.733420:0:22780:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a27c940050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7ccb4038-daf9-4dcd-9b85-da9390181204+18:23518:x1876325050840832:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1789403542.733445:0:22780:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:1.0:1789403542.733456:0:22780:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000001:00100000:0.0:1789403542.737813:0:22766:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 20000000:01000000:1.0:1789403542.737982:0:22780:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:1.0:1789403542.737997:0:22780:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0001, index=1, rc=0 00000100:00100000:1.0:1789403542.738333:0:22780:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a27c940050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7ccb4038-daf9-4dcd-9b85-da9390181204+18:23518:x1876325050840832:12345-0@lo:253:mount.lustre.0 Request processed in 4910us (5128us total) trans 0 rc 0/0 00000100:00100000:1.0:1789403542.738344:0:22780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 20000000:01000000:1.0:1789403542.738426:0:22802:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:1.0:1789403542.738430:0:22802:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:1.0:1789403542.738449:0:22802:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff90a144063000/0x5fb08b1e5b762710 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 22802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403542.738465:0:22802:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff90a270184c00/0x5fb08b1e5b762614 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5fb08b1e5b76260d expref: 17 pid: 22780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403542.738473:0:22802:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff90a248af1c00/0x5fb08b1e5b7626d8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5fb08b1e5b7626d1 expref: 17 pid: 22778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403542.738481:0:22802:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff90a144063000/0x5fb08b1e5b762710 lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 22802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403542.738514:0:22802:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff90a248af1c00/0x5fb08b1e5b7626d8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5fb08b1e5b7626d1 expref: 17 pid: 22778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403542.738529:0:22802:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff90a248af1c00/0x5fb08b1e5b7626d8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5fb08b1e5b7626d1 expref: 17 pid: 22778 timeout: 688 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789403542.738543:0:22802:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a141aad180 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22802:1876325050840960:0@lo:104: 00000100:00100000:1.0:1789403542.738576:0:22802:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1789403542.738629:0:22802:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff90a270184c00/0x5fb08b1e5b762614 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5fb08b1e5b76260d expref: 17 pid: 22780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403542.738638:0:22802:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff90a270184c00/0x5fb08b1e5b762614 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5fb08b1e5b76260d expref: 17 pid: 22780 timeout: 688 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789403542.738647:0:22802:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a141aadf80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22802:1876325050841088:0@lo:104: 00000100:00100000:1.0:1789403542.738668:0:22802:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789403542.738688:0:22802:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a27a526000 going to sleep for 11 seconds 00000100:00100000:1.0:1789403542.738704:0:22769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050840960 00000100:00100000:1.0:1789403542.738711:0:22769:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050840960 00000100:00100000:1.0:1789403542.738737:0:22769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050841088 00000100:00100000:1.0:1789403542.738740:0:22769:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050841088 00000100:00100000:1.0:1789403542.738751:0:22769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1789403542.738758:0:22769:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a141aadc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:7ccb4038-daf9-4dcd-9b85-da9390181204+4:22802:x1876325050840960:12345-0@lo:104: 00010000:00010000:1.0:1789403542.738769:0:22769:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.143@tcp lock: ffff90a259946800/0x5fb08b1e5b7626d1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x5fb08b1e5b7626d8 expref: -99 pid: 23518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403542.738816:0:22769:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1789403542.738821:0:22769:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a141aadc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:7ccb4038-daf9-4dcd-9b85-da9390181204+4:22802:x1876325050840960:12345-0@lo:104: Request processed in 65us (246us total) trans 0 rc 0/0 00010000:00010000:3.0:1789403542.738824:0:22775:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000100:00100000:1.0:1789403542.738840:0:22769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1789403542.738854:0:22769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1789403542.738860:0:22769:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a141aaf800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:7ccb4038-daf9-4dcd-9b85-da9390181204+3:22802:x1876325050841088:12345-0@lo:104: 00010000:00010000:1.0:1789403542.738867:0:22769:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.143@tcp lock: ffff90a248af0600/0x5fb08b1e5b76260d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x5fb08b1e5b762614 expref: -99 pid: 22783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403542.738901:0:22769:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1789403542.738907:0:22769:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a141aaf800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:7ccb4038-daf9-4dcd-9b85-da9390181204+3:22802:x1876325050841088:12345-0@lo:104: Request processed in 48us (238us total) trans 0 rc 0/0 00000100:00100000:1.0:1789403542.738918:0:22769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1789403542.738950:0:22802:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a141aad180 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22802:1876325050840960:0@lo:104: 00000100:00100000:1.0:1789403542.738959:0:22802:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a141aadf80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22802:1876325050841088:0@lo:104: 00010000:00010000:1.0:1789403542.738975:0:22802:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff90a144063000/0x5fb08b1e5b762710 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 22802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403542.739017:0:22775:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.143@tcp lock: ffff90a259946800/0x5fb08b1e5b7626d1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x5fb08b1e5b7626d8 expref: -99 pid: 23518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403542.739026:0:22775:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a259946800 already unused, calling callback (ffffffffc120dc20) 10000000:00010000:3.0:1789403542.739030:0:22775:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.143@tcp lock: ffff90a259946800/0x5fb08b1e5b7626d1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x5fb08b1e5b7626d8 expref: -99 pid: 23518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403542.739038:0:22775:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.143@tcp lock: ffff90a259946800/0x5fb08b1e5b7626d1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x5fb08b1e5b7626d8 expref: -99 pid: 23518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789403542.739056:0:22775:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.143@tcp lock: ffff90a259946800/0x5fb08b1e5b7626d1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x5fb08b1e5b7626d8 expref: -99 pid: 23518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789403542.739062:0:22775:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1789403542.739098:0:22775:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.143@tcp lock: ffff90a259946800/0x5fb08b1e5b7626d1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5fb08b1e5b7626d8 expref: -99 pid: 23518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403542.739104:0:22775:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789403542.739133:0:22775:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.143@tcp lock: ffff90a259946800/0x5fb08b1e5b7626d1 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5fb08b1e5b7626d8 expref: -99 pid: 23518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403542.739140:0:22775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.143@tcp lock: ffff90a259946800/0x5fb08b1e5b7626d1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5fb08b1e5b7626d8 expref: -99 pid: 23518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403542.739151:0:22775:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789403542.739154:0:22775:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.143@tcp lock: ffff90a248af0600/0x5fb08b1e5b76260d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x5fb08b1e5b762614 expref: -99 pid: 22783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403542.739159:0:22775:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a248af0600 already unused, calling callback (ffffffffc120dc20) 10000000:00010000:3.0:1789403542.739162:0:22775:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.143@tcp lock: ffff90a248af0600/0x5fb08b1e5b76260d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x5fb08b1e5b762614 expref: -99 pid: 22783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403542.739168:0:22775:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.143@tcp lock: ffff90a248af0600/0x5fb08b1e5b76260d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x5fb08b1e5b762614 expref: -99 pid: 22783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789403542.739173:0:22775:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.143@tcp lock: ffff90a248af0600/0x5fb08b1e5b76260d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x5fb08b1e5b762614 expref: -99 pid: 22783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789403542.739178:0:22775:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1789403542.739197:0:22775:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.143@tcp lock: ffff90a248af0600/0x5fb08b1e5b76260d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5fb08b1e5b762614 expref: -99 pid: 22783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403542.739203:0:22775:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789403542.739209:0:22775:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.143@tcp lock: ffff90a248af0600/0x5fb08b1e5b76260d lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5fb08b1e5b762614 expref: -99 pid: 22783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403542.739216:0:22775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.143@tcp lock: ffff90a248af0600/0x5fb08b1e5b76260d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5fb08b1e5b762614 expref: -99 pid: 22783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403542.739228:0:22775:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789403542.739230:0:22775:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789403542.739231:0:22775:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789403542.739242:0:3628:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a144b2a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7ccb4038-daf9-4dcd-9b85-da9390181204:3628:1876325050841216:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789403542.739270:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789403542.739292:0:3628:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789403542.739345:0:23518:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a144beca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7ccb4038-daf9-4dcd-9b85-da9390181204:23518:1876325050840832:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1789403542.740146:0:3628:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a144b2a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7ccb4038-daf9-4dcd-9b85-da9390181204:3628:1876325050841344:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789403542.740448:0:22774:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1789403542.741482:0:23518:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0001 got index = 1 00000020:01000004:0.0:1789403542.741487:0:23518:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1789403542.741489:0:23518:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:0.0:1789403542.741491:0:23518:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789403542.741492:0:23518:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789403542.741493:0:23518:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789403542.741494:0:23518:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789403542.741495:0:23518:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1789403542.741497:0:23518:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789403542.741498:0:23518:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:0.0:1789403542.741514:0:23518:0:(tgt_mount.c:2694:server_calc_timeout()) lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 00000100:00100000:0.0:1789403542.741540:0:22771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050841216 00000100:00100000:0.0:1789403542.741547:0:22771:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050841216 00010000:00010000:0.0:1789403542.741581:0:22771:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff90a248af1c00/0x5fb08b1e5b7626d8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5fb08b1e5b7626d1 expref: 18 pid: 22778 timeout: 688 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789403542.741656:0:22771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1789403542.741666:0:22771:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a144b2bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7ccb4038-daf9-4dcd-9b85-da9390181204+18:3628:x1876325050841216:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789403542.741680:0:22771:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789403542.741686:0:22771:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff90a248af1c00/0x5fb08b1e5b7626d8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5fb08b1e5b7626d1 expref: 18 pid: 22778 timeout: 688 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403542.741708:0:22771:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff90a248af1c00/0x5fb08b1e5b7626d8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5fb08b1e5b7626d1 expref: 18 pid: 22778 timeout: 688 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403542.741724:0:22771:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90a248af1c00/0x5fb08b1e5b7626d8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5fb08b1e5b7626d1 expref: 18 pid: 22778 timeout: 688 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403542.741736:0:22771:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789403542.741792:0:22771:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a144b2bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7ccb4038-daf9-4dcd-9b85-da9390181204+17:3628:x1876325050841216:12345-0@lo:103:ldlm_bl.0 Request processed in 128us (2520us total) trans 0 rc 0/0 00000100:00100000:0.0:1789403542.741800:0:22771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1789403542.743036:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789403542.743065:0:22773:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050841344 00000100:00100000:0.0:1789403542.743072:0:22773:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050841344 00000100:00100000:3.0:1789403542.743086:0:3628:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a144b2a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7ccb4038-daf9-4dcd-9b85-da9390181204:3628:1876325050841216:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789403542.743095:0:22773:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff90a270184c00/0x5fb08b1e5b762614 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5fb08b1e5b76260d expref: 17 pid: 22780 timeout: 688 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789403542.743129:0:22773:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1789403542.743137:0:22773:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a144b28380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7ccb4038-daf9-4dcd-9b85-da9390181204+17:3628:x1876325050841344:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789403542.743149:0:22773:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789403542.743154:0:22773:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff90a270184c00/0x5fb08b1e5b762614 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5fb08b1e5b76260d expref: 17 pid: 22780 timeout: 688 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403542.743164:0:22773:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff90a270184c00/0x5fb08b1e5b762614 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5fb08b1e5b76260d expref: 17 pid: 22780 timeout: 688 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403542.743177:0:22773:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90a270184c00/0x5fb08b1e5b762614 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5fb08b1e5b76260d expref: 17 pid: 22780 timeout: 688 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403542.743191:0:22773:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff90a144063000/0x5fb08b1e5b762710 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 22802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403542.743213:0:22773:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90a144063000/0x5fb08b1e5b762710 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 22802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1789403542.743227:0:22773:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.008683331s 00010000:00010000:0.0:1789403542.743232:0:22773:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff90a144063000/0x5fb08b1e5b762710 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 22802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403542.743239:0:22773:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff90a144063000/0x5fb08b1e5b762710 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 22802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403542.743246:0:22773:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff90a144063000/0x5fb08b1e5b762710 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 22802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403542.743252:0:22773:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff90a144063000/0x5fb08b1e5b762710 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 22802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403542.743257:0:22773:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a144063000 already unused, calling callback (ffffffffc0c0b8b0) 00010000:00010000:0.0:1789403542.743261:0:22773:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff90a144063000/0x5fb08b1e5b762710 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 22802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403542.743268:0:22773:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff90a144063000/0x5fb08b1e5b762710 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 22802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403542.743283:0:22773:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff90a144063000/0x5fb08b1e5b762710 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403542.743292:0:22773:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789403542.743328:0:22773:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a144b28380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7ccb4038-daf9-4dcd-9b85-da9390181204+16:3628:x1876325050841344:12345-0@lo:103:ldlm_bl.0 Request processed in 191us (294us total) trans 0 rc 0/0 00000100:00100000:0.0:1789403542.743346:0:22773:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00010000:0.0:1789403542.743377:0:22802:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff90a144063000/0x5fb08b1e5b762710 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789403542.743382:0:3628:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a144b2a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7ccb4038-daf9-4dcd-9b85-da9390181204:3628:1876325050841344:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789403542.743405:0:22802:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff90a144063000/0x5fb08b1e5b762710 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403542.743413:0:22802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90a144063000/0x5fb08b1e5b762710 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:01000000:2.0:1789403542.751728:0:23518:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0001-osd ctxt 16 is initialized 00000020:00080000:0.0:1789403542.751794:0:23542:0:(update_trans.c:1538:distribute_txn_commit_thread()) lustre-MDT0001: start commit thread committed batchid 0 00000020:00080000:0.0:1789403542.751799:0:23542:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 0 00000040:01000000:0.0:1789403542.752485:0:23543:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:2.0:1789403542.752517:0:23518:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osp-MDT0001 ctxt 16 is initialized 00000100:00100000:0.0:1789403542.753746:0:23544:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a144beca80 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:23544:1876325050841472:0@lo:1000:lod0001_rec0000.0 00000040:01000000:2.0:1789403542.753801:0:23518:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 12 is initialized 00000100:00100000:0.0:1789403542.753811:0:23544:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000040:00080000:2.0:1789403542.753865:0:23518:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:2.0:1789403542.754286:0:23518:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:2.0:1789403542.754293:0:23518:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 14 is initialized 00000040:00080000:2.0:1789403542.754328:0:23518:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1789403542.755317:0:23518:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:2.0:1789403542.755881:0:23518:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:2.0:1789403542.755910:0:23518:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 15 is initialized 00000040:00080000:2.0:1789403542.756004:0:23518:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00080000:10000000:2.0:1789403542.756493:0:23518:0:(osd_handler.c:5580:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x30:0x0] (8/32) registered 00000100:00100000:1.0:1789403542.756856:0:22791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050841472 00000100:00100000:1.0:1789403542.756865:0:22791:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050841472 00000100:00100000:1.0:1789403542.756913:0:22791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1789403542.756922:0:22791:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a144bec000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:23544:x1876325050841472:12345-0@lo:1000:lod0001_rec0000.0 00000100:00100000:1.0:1789403542.757531:0:22791:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a144bec000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:23544:x1876325050841472:12345-0@lo:1000:lod0001_rec0000.0 Request processed in 609us (3718us total) trans 0 rc 0/0 00000100:00100000:1.0:1789403542.757589:0:22791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000001:00000004:2.0:1789403542.759201:0:23518:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 3, last_transno is 12884901888 00000001:00080000:2.0:1789403542.760667:0:23518:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0001: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:2.0:1789403542.760697:0:23518:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0001: cmd=c00866e6 len=0 karg=ffffbb21c1993988 00100000:10000000:2.0:1789403542.760705:0:23518:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0001-osd: start master thread 00000040:00080000:3.0:1789403542.761696:0:23543:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000020:01000004:2.0:1789403542.761741:0:23518:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:2.0:1789403542.761766:0:23518:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.143@tcp: cl_mgc_mutex unlock 00000020:01000004:2.0:1789403542.761782:0:23518:0:(tgt_mount.c:2460:server_fill_super_common()) Server sb, dev=48 00000080:00000004:2.0:1789403542.761796:0:23518:0:(super25.c:182:lustre_fill_super()) /dev/mapper/mds2_flakey: Mount complete 00000100:00100000:0.0:1789403542.762784:0:23544:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a1434f2540 going to sleep for 11 seconds 00000100:00100000:0.0:1789403542.762822:0:23544:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a144beca80 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:23544:1876325050841472:0@lo:1000:lod0001_rec0000.0 00000040:01000000:0.0:1789403542.764682:0:23544:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000100:00100000:0.0:1789403542.764732:0:23544:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a144beca80 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:23544:1876325050841600:0@lo:1000:lod0001_rec0000.0 00000100:00100000:0.0:1789403542.764798:0:23544:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789403542.764854:0:22791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050841600 00000100:00100000:0.0:1789403542.764861:0:22791:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050841600 00000100:00100000:0.0:1789403542.764903:0:22791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1789403542.764912:0:22791:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a144bedf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:23544:x1876325050841600:12345-0@lo:1000:lod0001_rec0000.0 00000100:00100000:0.0:1789403542.765022:0:22791:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a144bedf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:23544:x1876325050841600:12345-0@lo:1000:lod0001_rec0000.0 Request processed in 110us (223us total) trans 0 rc 0/0 00000100:00100000:0.0:1789403542.765029:0:22791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1789403542.765053:0:23544:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a2513dacc0 going to sleep for 11 seconds 00000100:00100000:0.0:1789403542.765072:0:23544:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a144beca80 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:23544:1876325050841600:0@lo:1000:lod0001_rec0000.0 00000100:00100000:0.0:1789403542.765150:0:23544:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a144beca80 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0000-lwp-MDT0001_UUID:23544:1876325050841728:0@lo:900:lod0001_rec0000.0 00000100:00100000:0.0:1789403542.765177:0:23544:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789403542.765199:0:23544:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a2513da780 going to sleep for 11 seconds 00000100:00100000:1.0:1789403542.766138:0:22797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050841728 00000100:00100000:1.0:1789403542.766145:0:22797:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050841728 00000100:00100000:1.0:1789403542.766234:0:22797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1789403542.766242:0:22797:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a144bee680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:23544:x1876325050841728:12345-0@lo:900:lod0001_rec0000.0 00000100:00100000:1.0:1789403542.766292:0:22797:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a144bee680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:23544:x1876325050841728:12345-0@lo:900:lod0001_rec0000.0 Request processed in 51us (1114us total) trans 0 rc 0/0 00000100:00100000:1.0:1789403542.766298:0:22797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000040:00080000:3.0:1789403542.766933:0:23543:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x240000400:0x1:0x0] index 261376 count 1 00000004:00080000:3.0:1789403542.766991:0:23543:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0001-osd retrieved update log, duration 0, retries 0 00010000:00080000:0.0:1789403542.767233:0:23544:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff90a144beca80 x1876325050841728/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1789403558 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'lod0001_rec0000.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789403542.767247:0:23544:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a144beca80 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0000-lwp-MDT0001_UUID:23544:1876325050841728:0@lo:900:lod0001_rec0000.0 00000100:00100000:0.0:1789403542.767306:0:23544:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a144beca80 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:23544:1876325050841856:0@lo:1000:lod0001_rec0000.0 00000100:00100000:0.0:1789403542.767343:0:23544:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789403542.767369:0:22791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050841856 00000100:00100000:0.0:1789403542.767374:0:22791:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050841856 00000100:00100000:0.0:1789403542.767421:0:22791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1789403542.767429:0:22791:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a144bece00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:23544:x1876325050841856:12345-0@lo:1000:lod0001_rec0000.0 00000100:00100000:0.0:1789403542.767584:0:22791:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a144bece00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:23544:x1876325050841856:12345-0@lo:1000:lod0001_rec0000.0 Request processed in 155us (239us total) trans 0 rc 0/0 00000100:00100000:0.0:1789403542.767591:0:22791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1789403542.767612:0:23544:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a2513dacc0 going to sleep for 11 seconds 00000100:00100000:0.0:1789403542.767624:0:23544:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a144beca80 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:23544:1876325050841856:0@lo:1000:lod0001_rec0000.0 00000040:00080000:0.0:1789403542.767664:0:23544:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000020:00000004:3.0:1789403542.773898:0:23518:0:(tgt_mount.c:2346:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1789403542.774134:0:23518:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00000040:00080000:0.0:1789403542.775002:0:23544:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000401:0x1:0x0] index 261376 count 1 00000004:00080000:0.0:1789403542.775072:0:23544:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osp-MDT0001 retrieved update log, duration 0, retries 0 00000004:00080000:0.0:1789403542.775077:0:23544:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0001 got update logs from all MDTs. 00000100:00100000:0.0:1789403542.833433:0:22827:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a2413700c0 going to sleep for 0 seconds 00010000:00010000:2.0:1789403543.284153:0:22775:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1789403543.795378:0:23539:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:2.0:1789403543.858563:0:22827:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a2413700c0 going to sleep for 0 seconds 10000000:01000000:1.0:1789403544.242680:0:22783:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1789403544.242687:0:22783:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff90a144165800 from 12 10000000:01000000:1.0:1789403544.242692:0:22783:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1789403544.242736:0:22783:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.143@tcp lock: ffff90a144063200/0x5fb08b1e5b762717 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403544.242774:0:22783:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.143@tcp lock: ffff90a144063200/0x5fb08b1e5b762717 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403544.242786:0:22783:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.143@tcp lock: ffff90a144063200/0x5fb08b1e5b762717 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789403544.242809:0:22783:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a141aadf80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7ccb4038-daf9-4dcd-9b85-da9390181204:22783:1876325050841984:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1789403544.242883:0:22783:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789403544.242973:0:22783:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a141b50f00 going to sleep for 11 seconds 00000100:00100000:0.0:1789403544.245887:0:22778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050841984 00000100:00100000:0.0:1789403544.245900:0:22778:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050841984 00000100:00100000:0.0:1789403544.245948:0:22778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1789403544.246473:0:22778:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a27c942850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7ccb4038-daf9-4dcd-9b85-da9390181204+16:22783:x1876325050841984:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789403544.246489:0:22778:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789403544.246507:0:22778:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90a248af1800/0x5fb08b1e5b76271e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x5fb08b1e5b762717 expref: -99 pid: 22778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403544.246533:0:22778:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90a248af1800/0x5fb08b1e5b76271e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5fb08b1e5b762717 expref: 17 pid: 22778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403544.246545:0:22778:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90a248af1800/0x5fb08b1e5b76271e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5fb08b1e5b762717 expref: 17 pid: 22778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403544.246554:0:22778:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a248af1800, rc 0) 00000100:00100000:0.0:1789403544.246626:0:22778:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a27c942850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7ccb4038-daf9-4dcd-9b85-da9390181204+17:22783:x1876325050841984:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 157us (3743us total) trans 0 rc 0/0 00000100:00100000:1.0:1789403544.251440:0:22783:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a141aadf80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7ccb4038-daf9-4dcd-9b85-da9390181204:22783:1876325050841984:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789403544.251468:0:22783:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.143@tcp lock: ffff90a144063200/0x5fb08b1e5b762717 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb08b1e5b76271e expref: -99 pid: 22783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403544.251480:0:22783:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.143@tcp lock: ffff90a144063200/0x5fb08b1e5b762717 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x5fb08b1e5b76271e expref: -99 pid: 22783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789403544.251743:0:22783:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a141aadf80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7ccb4038-daf9-4dcd-9b85-da9390181204:22783:1876325050842112:0@lo:256:ll_cfg_requeue.0 00000100:00100000:1.0:1789403544.251802:0:22783:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789403544.251837:0:22783:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a141b50f00 going to sleep for 11 seconds 00000100:00100000:1.0:1789403544.251860:0:22780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050842112 00000100:00100000:1.0:1789403544.251866:0:22780:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050842112 00000100:00100000:1.0:1789403544.251904:0:22780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1789403544.251912:0:22780:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a27c755c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7ccb4038-daf9-4dcd-9b85-da9390181204+18:22783:x1876325050842112:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:1.0:1789403544.251931:0:22780:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1789403544.251956:0:22780:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1789403544.251959:0:22780:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 12 00000100:00100000:1.0:1789403544.252038:0:22780:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a27c755c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7ccb4038-daf9-4dcd-9b85-da9390181204+18:22783:x1876325050842112:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 126us (234us total) trans 0 rc 0/0 00000100:00100000:1.0:1789403544.252046:0:22780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1789403544.252081:0:22783:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a141aadf80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7ccb4038-daf9-4dcd-9b85-da9390181204:22783:1876325050842112:0@lo:256:ll_cfg_requeue.0 10000000:01000000:1.0:1789403544.252534:0:22783:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.143@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1789403544.252543:0:22783:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.143@tcp lock: ffff90a144063200/0x5fb08b1e5b762717 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb08b1e5b76271e expref: -99 pid: 22783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403544.252553:0:22783:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.143@tcp lock: ffff90a144063200/0x5fb08b1e5b762717 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb08b1e5b76271e expref: -99 pid: 22783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789403544.252563:0:22783:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1789403544.252565:0:22783:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff90a144559800 from 12 10000000:01000000:1.0:1789403544.252568:0:22783:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1789403544.252847:0:22783:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.143@tcp lock: ffff90a144063c00/0x5fb08b1e5b762725 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403544.252856:0:22783:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.143@tcp lock: ffff90a144063c00/0x5fb08b1e5b762725 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403544.252866:0:22783:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.143@tcp lock: ffff90a144063c00/0x5fb08b1e5b762725 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789403544.252882:0:22783:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a141aadf80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7ccb4038-daf9-4dcd-9b85-da9390181204:22783:1876325050842240:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1789403544.252917:0:22783:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789403544.252937:0:22778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1789403544.252959:0:22783:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a141b50f00 going to sleep for 11 seconds 00000100:00100000:1.0:1789403544.252978:0:22780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050842240 00000100:00100000:1.0:1789403544.252983:0:22780:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050842240 00000100:00100000:1.0:1789403544.253010:0:22780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1789403544.253017:0:22780:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a27c757050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7ccb4038-daf9-4dcd-9b85-da9390181204+17:22783:x1876325050842240:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789403544.253035:0:22780:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789403544.253048:0:22780:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90a144063600/0x5fb08b1e5b76272c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x5fb08b1e5b762725 expref: -99 pid: 22780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403544.253068:0:22780:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90a144063600/0x5fb08b1e5b76272c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5fb08b1e5b762725 expref: 18 pid: 22780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403544.253077:0:22780:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90a144063600/0x5fb08b1e5b76272c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5fb08b1e5b762725 expref: 18 pid: 22780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403544.253084:0:22780:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a144063600, rc 0) 00000100:00100000:1.0:1789403544.253125:0:22780:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a27c757050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7ccb4038-daf9-4dcd-9b85-da9390181204+18:22783:x1876325050842240:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 109us (208us total) trans 0 rc 0/0 00000100:00100000:1.0:1789403544.253131:0:22780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1789403544.253164:0:22783:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a141aadf80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7ccb4038-daf9-4dcd-9b85-da9390181204:22783:1876325050842240:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789403544.253175:0:22783:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.143@tcp lock: ffff90a144063c00/0x5fb08b1e5b762725 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb08b1e5b76272c expref: -99 pid: 22783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403544.253182:0:22783:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.143@tcp lock: ffff90a144063c00/0x5fb08b1e5b762725 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x5fb08b1e5b76272c expref: -99 pid: 22783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789403544.253229:0:22783:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a141aadf80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7ccb4038-daf9-4dcd-9b85-da9390181204:22783:1876325050842368:0@lo:256:ll_cfg_requeue.0 00000100:00100000:1.0:1789403544.253256:0:22783:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789403544.253269:0:22783:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a141b50f00 going to sleep for 11 seconds 00000100:00100000:1.0:1789403544.253282:0:22780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050842368 00000100:00100000:1.0:1789403544.253286:0:22780:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050842368 00000100:00100000:1.0:1789403544.253306:0:22780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1789403544.253311:0:22780:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a27c754c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7ccb4038-daf9-4dcd-9b85-da9390181204+18:22783:x1876325050842368:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:1.0:1789403544.253329:0:22780:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1789403544.253341:0:22780:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1789403544.253344:0:22780:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 12 00000100:00100000:1.0:1789403544.253910:0:22780:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a27c754c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7ccb4038-daf9-4dcd-9b85-da9390181204+18:22783:x1876325050842368:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 597us (652us total) trans 0 rc 0/0 00000100:00100000:1.0:1789403544.253917:0:22780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1789403544.254013:0:22783:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a141aadf80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7ccb4038-daf9-4dcd-9b85-da9390181204:22783:1876325050842368:0@lo:256:ll_cfg_requeue.0 10000000:01000000:1.0:1789403544.254055:0:22783:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.143@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1789403544.254062:0:22783:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.143@tcp lock: ffff90a144063c00/0x5fb08b1e5b762725 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb08b1e5b76272c expref: -99 pid: 22783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403544.254071:0:22783:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.143@tcp lock: ffff90a144063c00/0x5fb08b1e5b762725 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb08b1e5b76272c expref: -99 pid: 22783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403544.306519:0:22774:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1789403544.823499:0:23539:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:0.0:1789403544.885784:0:22827:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a2413700c0 going to sleep for 0 seconds 00010000:00010000:3.0:1789403545.330685:0:22775:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789403545.905916:0:22827:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a2413700c0 going to sleep for 0 seconds 00010000:00010000:3.0:1789403546.356063:0:22774:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1789403546.529700:0:23787:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg343-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000100:00100000:0.0:1789403546.929762:0:22827:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a2413700c0 going to sleep for 0 seconds 00000020:00000004:3.0:1789403547.266971:0:23839:0:(tgt_mount.c:2346:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1789403547.267161:0:23839:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1789403547.380778:0:22775:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789403547.890539:0:3627:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1789403547.890560:0:3627:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a141aadf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3627:1876325050842496:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1789403547.890623:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789403547.890786:0:22791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050842496 00000100:00100000:0.0:1789403547.890794:0:22791:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050842496 00000100:00100000:0.0:1789403547.890838:0:22791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00080000:2.0:1789403547.890845:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00100000:0.0:1789403547.890847:0:22791:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a141aad180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3627:x1876325050842496:12345-0@lo:41:osp-pre-0-1.0 00000100:00080000:2.0:1789403547.890849:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:2.0:1789403547.890852:0:37:0:(import.c:65:import_set_state_nolock()) ffff90a27dbdd800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1789403547.890861:0:37:0:(import.c:666:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff90a27dbdd800 using connection 192.168.203.143@tcp/0@lo 00000004:00000024:0.0:1789403547.890876:0:22791:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446309888 avail 1300070400 00000100:00100000:2.0:1789403547.890879:0:37:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff90a27a64f100 x1876325050842752/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1789403547.890909:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1789403547.890913:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1789403547.890915:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00100000:0.0:1789403547.890919:0:22791:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a141aad180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3627:x1876325050842496:12345-0@lo:41:osp-pre-0-1.0 Request processed in 74us (296us total) trans 0 rc 0/0 00000100:00080000:2.0:1789403547.890930:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1789403547.890934:0:22791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00080000:2.0:1789403547.890951:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1789403547.890954:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1789403547.890957:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1789403547.890960:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1789403547.890988:0:3626:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789403547.890996:0:3626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a27a64c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7ccb4038-daf9-4dcd-9b85-da9390181204:3626:1876325050842624:0@lo:400:kworker.0 00000100:00100000:2.0:1789403547.891028:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789403547.891071:0:3628:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a27a64dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3628:1876325050842880:0@lo:400:kworker.0 00000100:00100000:2.0:1789403547.891107:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789403547.891126:0:3628:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789403547.891131:0:3628:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a27a64d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3628:1876325050843008:0@lo:400:kworker.0 00000100:00100000:2.0:1789403547.891151:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789403547.891194:0:22787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050842880 00000100:00100000:2.0:1789403547.891199:0:22787:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050842880 00000100:00100000:2.0:1789403547.891225:0:22787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050843008 00000100:00100000:2.0:1789403547.891228:0:22787:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050843008 00000100:00100000:2.0:1789403547.891240:0:22787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1789403547.891245:0:22787:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a27a64f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3628:x1876325050842880:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789403547.891280:0:22787:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a27a64f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3628:x1876325050842880:12345-0@lo:400:kworker.0 Request processed in 35us (173us total) trans 0 rc 0/0 00000100:00100000:2.0:1789403547.891286:0:22787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1789403547.891297:0:22787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1789403547.891303:0:22787:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a27a64f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3628:x1876325050843008:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789403547.891326:0:22787:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a27a64f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3628:x1876325050843008:12345-0@lo:400:kworker.0 Request processed in 23us (173us total) trans 0 rc 0/0 00000100:00100000:2.0:1789403547.891357:0:22787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1789403547.891407:0:3625:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a27a64f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3625:1876325050842752:0@lo:38:kworker.0 00000100:00100000:2.0:1789403547.891434:0:3625:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:2.0:1789403547.891472:0:3628:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff90a27a64d180 x1876325050843008/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789403563 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789403547.891484:0:3628:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a27a64d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3628:1876325050843008:0@lo:400:kworker.0 00010000:00080000:2.0:1789403547.891494:0:3628:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff90a27a64dc00 x1876325050842880/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789403563 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789403547.891502:0:3628:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a27a64dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3628:1876325050842880:0@lo:400:kworker.0 00000100:00100000:2.0:1789403547.891533:0:3627:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a141aadf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3627:1876325050842496:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1789403547.891551:0:22791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050842752 00000100:00100000:2.0:1789403547.891554:0:22791:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050842752 00000100:00100000:2.0:1789403547.891570:0:22791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1789403547.891574:0:22791:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a27a64ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3625:x1876325050842752:12345-0@lo:38:kworker.0 00010000:00080000:2.0:1789403547.891593:0:22791:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 593 last 0 00000020:00000080:2.0:1789403547.891622:0:22791:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x5fb08b1e5b762733 00000004:00100000:2.0:1789403547.891633:0:22791:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000001:00000004:2.0:1789403547.891638:0:22791:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 3, last_transno is 12884901888 00000100:00100000:0.0:1789403547.892303:0:22780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050842624 00000100:00100000:0.0:1789403547.892310:0:22780:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050842624 00000100:00100000:0.0:1789403547.892350:0:22780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1789403547.892358:0:22780:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a27c755450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7ccb4038-daf9-4dcd-9b85-da9390181204+18:3626:x1876325050842624:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789403547.892417:0:22780:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a27c755450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7ccb4038-daf9-4dcd-9b85-da9390181204+18:3626:x1876325050842624:12345-0@lo:400:kworker.0 Request processed in 60us (1387us total) trans 0 rc 0/0 00000100:00100000:0.0:1789403547.892422:0:22780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1789403547.893125:0:3626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a27a64c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7ccb4038-daf9-4dcd-9b85-da9390181204:3626:1876325050842624:0@lo:400:kworker.0 00000100:00080000:2.0:1789403547.902605:0:22791:0:(import.c:65:import_set_state_nolock()) ffff90a266ad9800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1789403547.902708:0:22791:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a27a64ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3625:x1876325050842752:12345-0@lo:38:kworker.0 Request processed in 11130us (11270us total) trans 0 rc 0/0 00000100:00100000:2.0:1789403547.902718:0:22791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00080000:0.0:1789403547.902746:0:3625:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0001-osp-MDT0000: connect to target with instance 3 00000100:00080000:0.0:1789403547.902755:0:3625:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0001-osp-MDT0000: Resetting ns_connect_flags to server flags: 0xa2400010450010a0 00000100:00080000:0.0:1789403547.902761:0:3625:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:0.0:1789403547.902763:0:3625:0:(import.c:65:import_set_state_nolock()) ffff90a27dbdd800 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00080000:0.0:1789403547.902782:0:3625:0:(recover.c:191:ptlrpc_wake_delayed()) @@@ waking (set 000000003d9009fb): req@ffff90a27a64ca80 x1876325050835712/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 304/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'lod0000_rec0001.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789403547.902805:0:3625:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a27a64f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3625:1876325050842752:0@lo:38:kworker.0 00000100:00100000:2.0:1789403547.902889:0:22827:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789403547.902905:0:3626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a144b2a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3626:1876325050843136:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1789403547.902909:0:22827:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a2413700c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789403547.902923:0:22792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050835712 00000100:00100000:2.0:1789403547.902930:0:22792:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050835712 00000100:00100000:0.0:1789403547.902943:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789403547.902954:0:22792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050843136 00000100:00100000:2.0:1789403547.902957:0:22792:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050843136 00000100:00100000:2.0:1789403547.902970:0:22792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1789403547.902977:0:22792:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a27a64c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:22827:x1876325050835712:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:2.0:1789403547.903038:0:22792:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a27a64c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:22827:x1876325050835712:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 61us (150us total) trans 0 rc 0/0 00000100:00100000:2.0:1789403547.903045:0:22792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1789403547.903061:0:22792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1789403547.903066:0:22792:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a144beca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3626:x1876325050843136:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1789403547.903094:0:22792:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:2.0:1789403547.906491:0:22792:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a144beca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3626:x1876325050843136:12345-0@lo:41:osp-pre-1-0.0 Request processed in 3417us (3540us total) trans 0 rc 0/0 00000100:00100000:2.0:1789403547.906503:0:22792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1789403547.906562:0:22827:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a27a64ca80 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:22827:1876325050835712:0@lo:1000:lod0000_rec0001.0 00000040:01000000:2.0:1789403547.906598:0:22827:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000100:00100000:2.0:1789403547.906637:0:22827:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a27a64ca80 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:22827:1876325050843264:0@lo:1000:lod0000_rec0001.0 00000100:00100000:2.0:1789403547.906684:0:22827:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789403547.906713:0:22827:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a2484ccc00 going to sleep for 11 seconds 00000100:00100000:2.0:1789403547.906726:0:22791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050843264 00000100:00100000:2.0:1789403547.906731:0:22791:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050843264 00000100:00100000:2.0:1789403547.906762:0:22792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1789403547.906769:0:22792:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a27a64dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:22827:x1876325050843264:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:2.0:1789403547.906880:0:22792:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a27a64dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:22827:x1876325050843264:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 111us (194us total) trans 0 rc 0/0 00000100:00100000:2.0:1789403547.906894:0:22792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1789403547.906921:0:22827:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a27a64ca80 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:22827:1876325050843264:0@lo:1000:lod0000_rec0001.0 00000100:00100000:0.0:1789403547.906944:0:3626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a144b2a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3626:1876325050843136:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1789403547.906982:0:22827:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a27a64ca80 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:22827:1876325050843392:0@lo:1000:lod0000_rec0001.0 00000100:00100000:2.0:1789403547.907008:0:22827:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789403547.907031:0:22827:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a2413700c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789403547.907046:0:22791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050843392 00000100:00100000:2.0:1789403547.907050:0:22791:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050843392 00000100:00100000:2.0:1789403547.907068:0:22791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1789403547.907085:0:22791:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a27a64d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:22827:x1876325050843392:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:2.0:1789403547.907133:0:22791:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a27a64d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:22827:x1876325050843392:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 59us (124us total) trans 0 rc 0/0 00000100:00100000:2.0:1789403547.907139:0:22791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1789403547.907162:0:22827:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a27a64ca80 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:22827:1876325050843392:0@lo:1000:lod0000_rec0001.0 00000040:00080000:2.0:1789403547.908129:0:22827:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1789403547.912167:0:22827:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x240000401:0x1:0x0] index 261376 count 1 00000004:00080000:2.0:1789403547.912648:0:22827:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0001-osp-MDT0000 retrieved update log, duration 18, retries 0 00000004:00080000:2.0:1789403547.912654:0:22827:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00000020:00000004:3.0:1789403548.018693:0:23889:0:(tgt_mount.c:2346:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1789403548.018895:0:23889:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1789403548.406003:0:22774:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1789403549.046332:0:23937:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffdc5127320 20000000:00000080:2.0:1789403549.046358:0:23937:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff90a266989800 uarg=0000000000000000 20000000:01000000:2.0:1789403549.046442:0:23937:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:2.0:1789403549.046453:0:23937:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:2.0:1789403549.046461:0:23937:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:3.0:1789403549.047467:0:23938:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 2 count 13 20000000:00000400:2.0:1789403549.047836:0:23937:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/debug_raw_pointers=Y (mode = 0) failed: rc = -17 10000000:01000000:2.0:1789403549.059958:0:23937:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:2.0:1789403549.060003:0:23937:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff90a270184e00/0x5fb08b1e5b76273a lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 23937 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403549.060051:0:23937:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff90a259947800/0x5fb08b1e5b7625e3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5fb08b1e5b7625dc expref: 17 pid: 22780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403549.060059:0:23937:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff90a248af0800/0x5fb08b1e5b7626e6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5fb08b1e5b7626df expref: 17 pid: 22778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403549.060079:0:23937:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff90a270184e00/0x5fb08b1e5b76273a lrc: 5/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 23937 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403549.060141:0:23937:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff90a248af0800/0x5fb08b1e5b7626e6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5fb08b1e5b7626df expref: 17 pid: 22778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403549.060163:0:23937:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff90a248af0800/0x5fb08b1e5b7626e6 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5fb08b1e5b7626df expref: 17 pid: 22778 timeout: 695 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789403549.060181:0:23937:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a27a64ca80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:23937:1876325050843520:0@lo:104: 00000100:00100000:2.0:1789403549.060267:0:23937:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1789403549.060339:0:23937:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff90a259947800/0x5fb08b1e5b7625e3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5fb08b1e5b7625dc expref: 17 pid: 22780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403549.060348:0:23937:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff90a259947800/0x5fb08b1e5b7625e3 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5fb08b1e5b7625dc expref: 17 pid: 22780 timeout: 695 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789403549.060357:0:23937:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a27a64c380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:23937:1876325050843648:0@lo:104: 00000100:00100000:2.0:1789403549.060380:0:23937:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789403549.060441:0:23937:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a25ecdf540 going to sleep for 11 seconds 00000100:00100000:3.0:1789403549.060470:0:22769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050843520 00000100:00100000:3.0:1789403549.060481:0:22769:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050843520 00000100:00100000:3.0:1789403549.060528:0:22769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050843648 00000100:00100000:3.0:1789403549.060531:0:22769:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050843648 00000100:00100000:3.0:1789403549.060547:0:22769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1789403549.060557:0:22769:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a27a64ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:7ccb4038-daf9-4dcd-9b85-da9390181204+4:23937:x1876325050843520:12345-0@lo:104: 00010000:00010000:3.0:1789403549.060572:0:22769:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.143@tcp lock: ffff90a259946600/0x5fb08b1e5b7626df lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x5fb08b1e5b7626e6 expref: -99 pid: 23518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403549.060639:0:22769:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1789403549.060646:0:22769:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a27a64ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:7ccb4038-daf9-4dcd-9b85-da9390181204+4:23937:x1876325050843520:12345-0@lo:104: Request processed in 91us (380us total) trans 0 rc 0/0 00000100:00100000:3.0:1789403549.060654:0:22769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1789403549.060674:0:23937:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a27a64ca80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:23937:1876325050843520:0@lo:104: 00000100:00100000:3.0:1789403549.060679:0:22769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1789403549.060687:0:22769:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a27a64d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:7ccb4038-daf9-4dcd-9b85-da9390181204+3:23937:x1876325050843648:12345-0@lo:104: 00010000:00010000:3.0:1789403549.060695:0:22769:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.143@tcp lock: ffff90a248af1600/0x5fb08b1e5b7625dc lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x5fb08b1e5b7625e3 expref: -99 pid: 22765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403549.060740:0:22769:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1789403549.060746:0:22769:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a27a64d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:7ccb4038-daf9-4dcd-9b85-da9390181204+3:23937:x1876325050843648:12345-0@lo:104: Request processed in 60us (364us total) trans 0 rc 0/0 00000100:00100000:3.0:1789403549.060751:0:22769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00010000:3.0:1789403549.060769:0:22774:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1789403549.060776:0:22774:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.143@tcp lock: ffff90a259946600/0x5fb08b1e5b7626df lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x5fb08b1e5b7626e6 expref: -99 pid: 23518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403549.060809:0:22774:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a259946600 already unused, calling callback (ffffffffc120dc20) 10000000:00010000:3.0:1789403549.060814:0:22774:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.143@tcp lock: ffff90a259946600/0x5fb08b1e5b7626df lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x5fb08b1e5b7626e6 expref: -99 pid: 23518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403549.060823:0:22774:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.143@tcp lock: ffff90a259946600/0x5fb08b1e5b7626df lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x5fb08b1e5b7626e6 expref: -99 pid: 23518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789403549.060831:0:22774:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.143@tcp lock: ffff90a259946600/0x5fb08b1e5b7626df lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x5fb08b1e5b7626e6 expref: -99 pid: 23518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789403549.060838:0:22774:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1789403549.060872:0:22774:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.143@tcp lock: ffff90a259946600/0x5fb08b1e5b7626df lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5fb08b1e5b7626e6 expref: -99 pid: 23518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403549.060878:0:22774:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789403549.060899:0:22774:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.143@tcp lock: ffff90a259946600/0x5fb08b1e5b7626df lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5fb08b1e5b7626e6 expref: -99 pid: 23518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403549.060906:0:22774:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.143@tcp lock: ffff90a259946600/0x5fb08b1e5b7626df lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5fb08b1e5b7626e6 expref: -99 pid: 23518 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403549.060921:0:22774:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789403549.060924:0:22774:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.143@tcp lock: ffff90a248af1600/0x5fb08b1e5b7625dc lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x5fb08b1e5b7625e3 expref: -99 pid: 22765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403549.060930:0:22774:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a248af1600 already unused, calling callback (ffffffffc120dc20) 10000000:00010000:3.0:1789403549.060932:0:22774:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.143@tcp lock: ffff90a248af1600/0x5fb08b1e5b7625dc lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x5fb08b1e5b7625e3 expref: -99 pid: 22765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403549.060950:0:22774:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.143@tcp lock: ffff90a248af1600/0x5fb08b1e5b7625dc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x5fb08b1e5b7625e3 expref: -99 pid: 22765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789403549.060957:0:22774:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.143@tcp lock: ffff90a248af1600/0x5fb08b1e5b7625dc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x5fb08b1e5b7625e3 expref: -99 pid: 22765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789403549.060963:0:22774:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00000100:00100000:2.0:1789403549.060969:0:23937:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a27a64c380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:23937:1876325050843648:0@lo:104: 00010000:00010000:3.0:1789403549.060978:0:22774:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.143@tcp lock: ffff90a248af1600/0x5fb08b1e5b7625dc lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5fb08b1e5b7625e3 expref: -99 pid: 22765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403549.060986:0:22774:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789403549.060998:0:23937:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff90a270184e00/0x5fb08b1e5b76273a lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 23937 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403549.061006:0:22774:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.143@tcp lock: ffff90a248af1600/0x5fb08b1e5b7625dc lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5fb08b1e5b7625e3 expref: -99 pid: 22765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403549.061023:0:22774:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.143@tcp lock: ffff90a248af1600/0x5fb08b1e5b7625dc lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5fb08b1e5b7625e3 expref: -99 pid: 22765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403549.061038:0:22774:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789403549.061040:0:22774:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789403549.061042:0:22774:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789403549.061058:0:3628:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a144b2b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7ccb4038-daf9-4dcd-9b85-da9390181204:3628:1876325050843904:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789403549.061060:0:3627:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a144b2a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7ccb4038-daf9-4dcd-9b85-da9390181204:3627:1876325050843776:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789403549.061116:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789403549.061162:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1789403549.061490:0:22775:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789403549.061509:0:22773:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050843776 00000100:00100000:0.0:1789403549.061514:0:22773:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050843776 00010000:00010000:0.0:1789403549.061545:0:22773:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff90a248af0800/0x5fb08b1e5b7626e6 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5fb08b1e5b7626df expref: 18 pid: 22778 timeout: 695 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789403549.061581:0:22773:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050843904 00000100:00100000:0.0:1789403549.061591:0:22773:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050843904 00010000:00010000:0.0:1789403549.061604:0:22773:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff90a259947800/0x5fb08b1e5b7625e3 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5fb08b1e5b7625dc expref: 19 pid: 22780 timeout: 695 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789403549.061616:0:22773:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1789403549.061622:0:22773:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a27a64c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7ccb4038-daf9-4dcd-9b85-da9390181204+19:3627:x1876325050843776:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789403549.061634:0:22773:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789403549.061640:0:22773:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff90a248af0800/0x5fb08b1e5b7626e6 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5fb08b1e5b7626df expref: 19 pid: 22778 timeout: 695 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403549.061650:0:22773:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff90a248af0800/0x5fb08b1e5b7626e6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5fb08b1e5b7626df expref: 19 pid: 22778 timeout: 695 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403549.061664:0:22773:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90a248af0800/0x5fb08b1e5b7626e6 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5fb08b1e5b7626df expref: 19 pid: 22778 timeout: 695 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403549.061676:0:22773:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789403549.061709:0:22771:0:(service.c:3467:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:3.0:1789403549.061720:0:22771:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'ldlm_cn00_003' 00000100:00100000:0.0:1789403549.061722:0:22773:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a27a64c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7ccb4038-daf9-4dcd-9b85-da9390181204+18:3627:x1876325050843776:12345-0@lo:103:ldlm_bl.0 Request processed in 98us (604us total) trans 0 rc 0/0 00000100:00100000:0.0:1789403549.061730:0:22773:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1789403549.061747:0:22773:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1789403549.061753:0:22773:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a144b2a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7ccb4038-daf9-4dcd-9b85-da9390181204+17:3628:x1876325050843904:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789403549.061760:0:22773:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789403549.061764:0:22773:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff90a259947800/0x5fb08b1e5b7625e3 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5fb08b1e5b7625dc expref: 17 pid: 22780 timeout: 695 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403549.061788:0:22773:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff90a259947800/0x5fb08b1e5b7625e3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5fb08b1e5b7625dc expref: 17 pid: 22780 timeout: 695 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403549.061799:0:22773:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90a259947800/0x5fb08b1e5b7625e3 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5fb08b1e5b7625dc expref: 17 pid: 22780 timeout: 695 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403549.061827:0:22773:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff90a270184e00/0x5fb08b1e5b76273a lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 23937 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403549.061844:0:22773:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90a270184e00/0x5fb08b1e5b76273a lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 23937 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403549.061861:0:22773:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff90a270184e00/0x5fb08b1e5b76273a lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 23937 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403549.061868:0:22773:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff90a270184e00/0x5fb08b1e5b76273a lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 23937 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403549.061876:0:22773:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff90a270184e00/0x5fb08b1e5b76273a lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 23937 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789403549.062100:0:3627:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a144b2a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7ccb4038-daf9-4dcd-9b85-da9390181204:3627:1876325050843776:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789403549.062472:0:22773:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff90a270184e00/0x5fb08b1e5b76273a lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 23937 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403549.062480:0:22773:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a270184e00 already unused, calling callback (ffffffffc0c0b8b0) 00010000:00010000:0.0:1789403549.062486:0:22773:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff90a270184e00/0x5fb08b1e5b76273a lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 23937 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403549.062496:0:22773:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff90a270184e00/0x5fb08b1e5b76273a lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 23937 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403549.062515:0:22773:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff90a270184e00/0x5fb08b1e5b76273a lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 23937 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403549.062529:0:22773:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789403549.062603:0:23937:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff90a270184e00/0x5fb08b1e5b76273a lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 23937 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403549.062613:0:23937:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff90a270184e00/0x5fb08b1e5b76273a lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 23937 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403549.062620:0:23937:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90a270184e00/0x5fb08b1e5b76273a lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 23937 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789403549.063077:0:22773:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a144b2a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:7ccb4038-daf9-4dcd-9b85-da9390181204+16:3628:x1876325050843904:12345-0@lo:103:ldlm_bl.0 Request processed in 1322us (1913us total) trans 0 rc 0/0 00000100:00100000:1.0:1789403549.063086:0:22773:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1789403549.063249:0:3628:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a144b2b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7ccb4038-daf9-4dcd-9b85-da9390181204:3628:1876325050843904:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789403549.427925:0:22774:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789403550.449642:0:22775:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1789403551.027003:0:22826:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 10000000:01000000:1.0:1789403551.028487:0:22783:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1789403551.028492:0:22783:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff90a144165800 from 13 10000000:01000000:1.0:1789403551.028496:0:22783:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1789403551.028542:0:22783:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.143@tcp lock: ffff90a144063800/0x5fb08b1e5b762741 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403551.028562:0:22783:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.143@tcp lock: ffff90a144063800/0x5fb08b1e5b762741 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403551.028577:0:22783:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.143@tcp lock: ffff90a144063800/0x5fb08b1e5b762741 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789403551.028602:0:22783:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a141aaea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7ccb4038-daf9-4dcd-9b85-da9390181204:22783:1876325050844032:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1789403551.028706:0:22783:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789403551.028743:0:22783:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a142630e40 going to sleep for 11 seconds 00000100:00100000:1.0:1789403551.028779:0:22778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050844032 00000100:00100000:1.0:1789403551.028787:0:22778:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050844032 00000100:00100000:1.0:1789403551.028832:0:22778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1789403551.028842:0:22778:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a27c755850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7ccb4038-daf9-4dcd-9b85-da9390181204+16:22783:x1876325050844032:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789403551.028854:0:22778:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789403551.028867:0:22778:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90a144062200/0x5fb08b1e5b762748 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x5fb08b1e5b762741 expref: -99 pid: 22778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403551.028889:0:22778:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90a144062200/0x5fb08b1e5b762748 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5fb08b1e5b762741 expref: 17 pid: 22778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403551.028899:0:22778:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90a144062200/0x5fb08b1e5b762748 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5fb08b1e5b762741 expref: 17 pid: 22778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403551.028915:0:22778:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a144062200, rc 0) 00000100:00100000:1.0:1789403551.028951:0:22778:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a27c755850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7ccb4038-daf9-4dcd-9b85-da9390181204+17:22783:x1876325050844032:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 111us (245us total) trans 0 rc 0/0 00000100:00100000:1.0:1789403551.028957:0:22778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1789403551.029014:0:22783:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a141aaea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7ccb4038-daf9-4dcd-9b85-da9390181204:22783:1876325050844032:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789403551.029029:0:22783:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.143@tcp lock: ffff90a144063800/0x5fb08b1e5b762741 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb08b1e5b762748 expref: -99 pid: 22783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403551.029037:0:22783:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.143@tcp lock: ffff90a144063800/0x5fb08b1e5b762741 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x5fb08b1e5b762748 expref: -99 pid: 22783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789403551.029103:0:22783:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a141aaea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7ccb4038-daf9-4dcd-9b85-da9390181204:22783:1876325050844160:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789403551.029127:0:22783:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789403551.029140:0:22783:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a142630e40 going to sleep for 11 seconds 00000100:00100000:1.0:1789403551.029155:0:22781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050844160 00000100:00100000:1.0:1789403551.029158:0:22781:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050844160 00000100:00100000:1.0:1789403551.029180:0:22781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1789403551.029185:0:22781:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a27c755050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7ccb4038-daf9-4dcd-9b85-da9390181204+17:22783:x1876325050844160:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789403551.029522:0:22781:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a27c755050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7ccb4038-daf9-4dcd-9b85-da9390181204+17:22783:x1876325050844160:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 335us (394us total) trans 0 rc 0/0 00000100:00100000:1.0:1789403551.029530:0:22781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1789403551.029562:0:22783:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a141aaea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7ccb4038-daf9-4dcd-9b85-da9390181204:22783:1876325050844160:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789403551.029588:0:22783:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a141aaea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7ccb4038-daf9-4dcd-9b85-da9390181204:22783:1876325050844288:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789403551.029626:0:22783:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789403551.029640:0:22783:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a142630e40 going to sleep for 11 seconds 00000100:00100000:1.0:1789403551.029653:0:22780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050844288 00000100:00100000:1.0:1789403551.029656:0:22780:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050844288 00000100:00100000:1.0:1789403551.029679:0:22780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1789403551.029685:0:22780:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a27c757850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7ccb4038-daf9-4dcd-9b85-da9390181204+17:22783:x1876325050844288:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789403551.029790:0:22780:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a27c757850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7ccb4038-daf9-4dcd-9b85-da9390181204+17:22783:x1876325050844288:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 104us (162us total) trans 0 rc 0/0 00000100:00100000:1.0:1789403551.029803:0:22780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1789403551.029913:0:22783:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a141aaea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7ccb4038-daf9-4dcd-9b85-da9390181204:22783:1876325050844288:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1789403551.033004:0:24021:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:3.0:1789403551.033187:0:22783:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:3.0:1789403551.033210:0:22783:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.143@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1789403551.033220:0:22783:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.143@tcp lock: ffff90a144063800/0x5fb08b1e5b762741 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb08b1e5b762748 expref: -99 pid: 22783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403551.033312:0:22783:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.143@tcp lock: ffff90a144063800/0x5fb08b1e5b762741 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb08b1e5b762748 expref: -99 pid: 22783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789403551.033322:0:22783:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1789403551.033325:0:22783:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff90a144559800 from 13 10000000:01000000:3.0:1789403551.033328:0:22783:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1789403551.033360:0:22783:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.143@tcp lock: ffff90a259946600/0x5fb08b1e5b76274f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403551.033368:0:22783:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.143@tcp lock: ffff90a259946600/0x5fb08b1e5b76274f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403551.033577:0:22783:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.143@tcp lock: ffff90a259946600/0x5fb08b1e5b76274f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789403551.033602:0:22783:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a144b29180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7ccb4038-daf9-4dcd-9b85-da9390181204:22783:1876325050844416:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1789403551.033664:0:22783:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789403551.033708:0:22783:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a270148c00 going to sleep for 11 seconds 00000100:00100000:1.0:1789403551.033767:0:22778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050844416 00000100:00100000:1.0:1789403551.033774:0:22778:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050844416 00000100:00100000:1.0:1789403551.033821:0:22778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1789403551.033830:0:22778:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a27c756450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7ccb4038-daf9-4dcd-9b85-da9390181204+17:22783:x1876325050844416:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789403551.033844:0:22778:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789403551.033854:0:22778:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90a144063000/0x5fb08b1e5b762756 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x5fb08b1e5b76274f expref: -99 pid: 22778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403551.033875:0:22778:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90a144063000/0x5fb08b1e5b762756 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5fb08b1e5b76274f expref: 18 pid: 22778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403551.033885:0:22778:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90a144063000/0x5fb08b1e5b762756 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5fb08b1e5b76274f expref: 18 pid: 22778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403551.033893:0:22778:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a144063000, rc 0) 00000100:00100000:1.0:1789403551.033932:0:22778:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a27c756450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7ccb4038-daf9-4dcd-9b85-da9390181204+18:22783:x1876325050844416:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 104us (268us total) trans 0 rc 0/0 00000100:00100000:1.0:1789403551.033939:0:22778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1789403551.033982:0:22783:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a144b29180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7ccb4038-daf9-4dcd-9b85-da9390181204:22783:1876325050844416:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789403551.033996:0:22783:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.143@tcp lock: ffff90a259946600/0x5fb08b1e5b76274f lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb08b1e5b762756 expref: -99 pid: 22783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403551.034004:0:22783:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.143@tcp lock: ffff90a259946600/0x5fb08b1e5b76274f lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x5fb08b1e5b762756 expref: -99 pid: 22783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789403551.034074:0:22783:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a141aaea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7ccb4038-daf9-4dcd-9b85-da9390181204:22783:1876325050844544:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789403551.034100:0:22783:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789403551.034113:0:22783:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a142630b40 going to sleep for 11 seconds 00000100:00100000:1.0:1789403551.034126:0:22781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050844544 00000100:00100000:1.0:1789403551.034130:0:22781:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050844544 00000100:00100000:1.0:1789403551.034151:0:22781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1789403551.034157:0:22781:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a27c754450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7ccb4038-daf9-4dcd-9b85-da9390181204+18:22783:x1876325050844544:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789403551.034267:0:22781:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a27c754450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7ccb4038-daf9-4dcd-9b85-da9390181204+18:22783:x1876325050844544:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 110us (166us total) trans 0 rc 0/0 00000100:00100000:1.0:1789403551.034274:0:22781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1789403551.034305:0:22783:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a141aaea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7ccb4038-daf9-4dcd-9b85-da9390181204:22783:1876325050844544:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789403551.034332:0:22783:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a141aaea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7ccb4038-daf9-4dcd-9b85-da9390181204:22783:1876325050844672:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789403551.034369:0:22783:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789403551.034418:0:22783:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a142630b40 going to sleep for 11 seconds 00000100:00100000:1.0:1789403551.034431:0:22781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050844672 00000100:00100000:1.0:1789403551.034434:0:22781:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050844672 00000100:00100000:1.0:1789403551.034455:0:22781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1789403551.034461:0:22781:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a27c756c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7ccb4038-daf9-4dcd-9b85-da9390181204+18:22783:x1876325050844672:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789403551.034531:0:22781:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a27c756c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7ccb4038-daf9-4dcd-9b85-da9390181204+18:22783:x1876325050844672:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 69us (160us total) trans 0 rc 0/0 00000100:00100000:1.0:1789403551.034538:0:22781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1789403551.034573:0:22783:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a141aaea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7ccb4038-daf9-4dcd-9b85-da9390181204:22783:1876325050844672:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1789403551.035173:0:24022:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:1.0:1789403551.035225:0:22783:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:1.0:1789403551.035241:0:22783:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.143@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1789403551.035249:0:22783:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.143@tcp lock: ffff90a259946600/0x5fb08b1e5b76274f lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb08b1e5b762756 expref: -99 pid: 22783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403551.035258:0:22783:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.143@tcp lock: ffff90a259946600/0x5fb08b1e5b76274f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb08b1e5b762756 expref: -99 pid: 22783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403551.477270:0:22774:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789403552.497762:0:22775:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789403553.010687:0:3625:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789403542/real 1789403542] req@ffff90a144b29f80 x1876325050838912/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789403552 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789403553.010718:0:3625:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff90a144b29f80 x1876325050838912/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789403552 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789403553.010729:0:3625:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789403542/real 1789403542] req@ffff90a141aac700 x1876325050838656/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789403552 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789403553.010739:0:3625:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff90a141aac700 x1876325050838656/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789403552 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1789403553.010757:0:3625:0:(import.c:65:import_set_state_nolock()) ffff90a26d291800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1789403553.010765:0:3625:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:2.0:1789403553.010769:0:3625:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a144b29f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3625:1876325050838912:0@lo:8:llog_process_th.0 00000100:00080000:2.0:1789403553.010774:0:3625:0:(import.c:65:import_set_state_nolock()) ffff90a14249e000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1789403553.010778:0:3625:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:2.0:1789403553.010790:0:3625:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a141aac700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3625:1876325050838656:0@lo:8:llog_process_th.0 00000100:00080000:3.0:1789403553.012697:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1789403553.012702:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1789403553.012706:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1789403553.012708:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1789403553.012723:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1789403553.012726:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:3.0:1789403553.012729:0:36:0:(import.c:65:import_set_state_nolock()) ffff90a14249e000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1789403553.012741:0:36:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 588 00000100:00080000:3.0:1789403553.012747:0:36:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1789403553.012758:0:36:0:(import.c:666:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff90a14249e000 using connection 192.168.203.143@tcp/0@lo 00000100:00100000:3.0:1789403553.012778:0:36:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff90a144b29500 x1876325050845312/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1789403553.012793:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1789403553.012796:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1789403553.012798:0:36:0:(import.c:65:import_set_state_nolock()) ffff90a26d291800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1789403553.012801:0:36:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 588 00000100:00080000:3.0:1789403553.012803:0:36:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1789403553.012807:0:36:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff90a26d291800 using connection 192.168.203.143@tcp/0@lo 00000100:00100000:3.0:1789403553.012817:0:36:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff90a144b28700 x1876325050845440/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1789403553.012850:0:3629:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a144b2b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:7ccb4038-daf9-4dcd-9b85-da9390181204:3629:1876325050844800:0@lo:400:kworker.0 00000100:00100000:3.0:1789403553.012907:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789403553.012943:0:3629:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a144b29f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3629:1876325050845568:0@lo:400:kworker.0 00000100:00100000:3.0:1789403553.012972:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789403553.012992:0:3629:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789403553.012997:0:3629:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a144b2ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3629:1876325050845184:0@lo:400:kworker.0 00000100:00100000:3.0:1789403553.013017:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789403553.013060:0:3626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a144b2aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3626:1876325050844928:0@lo:400:kworker.0 00000100:00100000:3.0:1789403553.013082:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789403553.013100:0:3626:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789403553.013106:0:3626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a144b29c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3626:1876325050845056:0@lo:400:kworker.0 00000100:00100000:3.0:1789403553.013125:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789403553.013162:0:22792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050845184 00000100:00100000:3.0:1789403553.013171:0:22792:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050845184 00000100:00100000:3.0:1789403553.013202:0:22792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050844928 00000100:00100000:3.0:1789403553.013204:0:22792:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050844928 00000100:00100000:3.0:1789403553.013217:0:22792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1789403553.013223:0:22792:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a144b2b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3629:x1876325050845184:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789403553.013278:0:22792:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a144b2b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3629:x1876325050845184:12345-0@lo:400:kworker.0 Request processed in 55us (260us total) trans 0 rc 0/0 00000100:00100000:3.0:1789403553.013285:0:22792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1789403553.013299:0:22792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1789403553.013304:0:22792:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a144b2a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3626:x1876325050844928:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789403553.013326:0:22792:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a144b2a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3626:x1876325050844928:12345-0@lo:400:kworker.0 Request processed in 22us (243us total) trans 0 rc 0/0 00000100:00100000:3.0:1789403553.013331:0:22792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1789403553.013361:0:3626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a144b2aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3626:1876325050844928:0@lo:400:kworker.0 00000100:00100000:3.0:1789403553.013378:0:3629:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a144b2ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3629:1876325050845184:0@lo:400:kworker.0 00000100:00100000:2.0:1789403553.013988:0:3625:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a144b29500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3625:1876325050845312:0@lo:8:kworker.0 00000400:00000100:2.0:1789403553.014017:0:3625:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1876325050845312 offset 0 length 520: 4 00000100:00100000:2.0:1789403553.014032:0:3625:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a144b28700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3625:1876325050845440:0@lo:8:kworker.0 00000400:00000100:2.0:1789403553.014058:0:3625:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1876325050845440 offset 0 length 520: 4 00000100:00100000:2.0:1789403553.014081:0:22787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050845568 00000100:00100000:2.0:1789403553.014085:0:22787:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050845568 00000100:00100000:2.0:1789403553.014113:0:22787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050845056 00000100:00100000:2.0:1789403553.014116:0:22787:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050845056 00000100:00100000:2.0:1789403553.014129:0:22787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1789403553.014135:0:22787:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a144b29180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3629:x1876325050845568:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789403553.014174:0:22787:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a144b29180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3629:x1876325050845568:12345-0@lo:400:kworker.0 Request processed in 38us (1201us total) trans 0 rc 0/0 00000100:00100000:2.0:1789403553.014180:0:22787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1789403553.014193:0:22787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1789403553.014199:0:22787:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a1443e5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3626:x1876325050845056:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789403553.014223:0:22787:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a1443e5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3626:x1876325050845056:12345-0@lo:400:kworker.0 Request processed in 25us (1096us total) trans 0 rc 0/0 00000100:00100000:2.0:1789403553.014238:0:22787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:2.0:1789403553.014269:0:3629:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff90a144b29f80 x1876325050845568/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789403569 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789403553.014281:0:3629:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a144b29f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3629:1876325050845568:0@lo:400:kworker.0 00000100:00100000:0.0:1789403553.014385:0:3626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a27a64ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3626:1876325050845696:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1789403553.014493:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:0.0:1789403553.014525:0:3626:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff90a144b29c00 x1876325050845056/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789403569 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789403553.014535:0:3626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a144b29c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3626:1876325050845056:0@lo:400:kworker.0 00000100:00100000:2.0:1789403553.014943:0:22792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050845696 00000100:00100000:2.0:1789403553.014949:0:22792:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050845696 00000100:00100000:2.0:1789403553.014986:0:22792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1789403553.015002:0:22792:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a144bef100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3626:x1876325050845696:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1789403553.015028:0:22792:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:2.0:1789403553.015077:0:22792:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a144bef100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3626:x1876325050845696:12345-0@lo:41:osp-pre-1-0.0 Request processed in 77us (584us total) trans 0 rc 0/0 00000100:00100000:2.0:1789403553.015083:0:22792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1789403553.015375:0:3626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a27a64ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3626:1876325050845696:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1789403553.016523:0:3626:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789403553.016583:0:22781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050844800 00000100:00100000:1.0:1789403553.016590:0:22781:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050844800 00000100:00100000:1.0:1789403553.016638:0:22781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1789403553.016656:0:22781:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a27c757c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7ccb4038-daf9-4dcd-9b85-da9390181204+18:3629:x1876325050844800:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789403553.016725:0:22781:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a27c757c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7ccb4038-daf9-4dcd-9b85-da9390181204+18:3629:x1876325050844800:12345-0@lo:400:kworker.0 Request processed in 79us (3817us total) trans 0 rc 0/0 00000100:00100000:1.0:1789403553.016732:0:22781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1789403553.016778:0:3629:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a144b2b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:7ccb4038-daf9-4dcd-9b85-da9390181204:3629:1876325050844800:0@lo:400:kworker.0 00000100:00100000:0.0:1789403553.021639:0:3626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a141aaea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3626:1876325050845824:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1789403553.021808:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789403553.023001:0:22792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050845824 00000100:00100000:3.0:1789403553.023012:0:22792:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050845824 00000100:00100000:3.0:1789403553.023098:0:22792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1789403553.023109:0:22792:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a144bec380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3626:x1876325050845824:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1789403553.023143:0:22792:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446309888 avail 1300070400 00000100:00100000:3.0:1789403553.023211:0:22792:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a144bec380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3626:x1876325050845824:12345-0@lo:41:osp-pre-0-1.0 Request processed in 105us (1403us total) trans 0 rc 0/0 00000100:00100000:3.0:1789403553.023218:0:22792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1789403553.023335:0:3626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a141aaea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3626:1876325050845824:0@lo:41:osp-pre-0-1.0 00010000:00010000:1.0:1789403553.522862:0:22774:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789403554.033476:0:3625:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789403539/real 1789403539] req@ffff90a141aaf480 x1876325050836864/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789403554 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789403554.033507:0:3625:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff90a141aaf480 x1876325050836864/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789403554 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789403554.033518:0:3625:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789403539/real 1789403539] req@ffff90a141aaf100 x1876325050836992/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789403554 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789403554.033532:0:3625:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff90a141aaf100 x1876325050836992/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789403554 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1789403554.033551:0:3625:0:(import.c:65:import_set_state_nolock()) ffff90a143719000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1789403554.033581:0:3625:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:2.0:1789403554.033586:0:3625:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a141aaf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3625:1876325050836864:0@lo:8:kworker.0 00000100:00080000:2.0:1789403554.033594:0:3625:0:(import.c:65:import_set_state_nolock()) ffff90a2488fd000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1789403554.033599:0:3625:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:2.0:1789403554.033603:0:3625:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a141aaf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3625:1876325050836992:0@lo:8:kworker.0 00000100:00100000:2.0:1789403554.033792:0:3628:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a141aace00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7ccb4038-daf9-4dcd-9b85-da9390181204:3628:1876325050845952:0@lo:400:kworker.0 00000100:00100000:2.0:1789403554.033864:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789403554.034950:0:3628:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789403554.034970:0:3628:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a141aac000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3628:1876325050846080:0@lo:400:kworker.0 00000100:00100000:2.0:1789403554.035010:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1789403554.035430:0:17331:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789403554.035436:0:17331:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:1.0:1789403554.035449:0:17331:0:(import.c:65:import_set_state_nolock()) ffff90a143719000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1789403554.035455:0:17331:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 585 00000100:00080000:1.0:1789403554.035460:0:17331:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:1.0:1789403554.035469:0:17331:0:(import.c:666:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff90a143719000 using connection 192.168.203.143@tcp/0@lo 00000100:00100000:1.0:1789403554.035496:0:17331:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff90a141aad880 x1876325050846208/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1789403554.035514:0:17331:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789403554.035525:0:17331:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1789403554.035527:0:17331:0:(import.c:65:import_set_state_nolock()) ffff90a2488fd000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1789403554.035531:0:17331:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 585 00000100:00080000:1.0:1789403554.035534:0:17331:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:1.0:1789403554.035539:0:17331:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff90a2488fd000 using connection 192.168.203.143@tcp/0@lo 00000100:00100000:1.0:1789403554.035552:0:17331:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff90a141aac380 x1876325050846336/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1789403554.035585:0:17331:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789403554.035589:0:17331:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1789403554.035591:0:17331:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789403554.035594:0:17331:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1789403554.035618:0:3629:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789403554.035627:0:3629:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a141aad500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3629:1876325050846720:0@lo:400:kworker.0 00000100:00100000:1.0:1789403554.035667:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789403554.035700:0:22791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050846080 00000100:00100000:1.0:1789403554.035708:0:22791:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050846080 00000100:00100000:1.0:1789403554.035765:0:22791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1789403554.035777:0:22791:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a27a64ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3628:x1876325050846080:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789403554.035873:0:22780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050845952 00000100:00100000:3.0:1789403554.035878:0:22780:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050845952 00000100:00100000:3.0:1789403554.035912:0:22780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1789403554.035927:0:22780:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a27c754850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7ccb4038-daf9-4dcd-9b85-da9390181204+18:3628:x1876325050845952:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789403554.035966:0:22780:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a27c754850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7ccb4038-daf9-4dcd-9b85-da9390181204+18:3628:x1876325050845952:12345-0@lo:400:kworker.0 Request processed in 41us (2102us total) trans 0 rc 0/0 00000100:00100000:3.0:1789403554.035973:0:22780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1789403554.036008:0:22791:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a27a64ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3628:x1876325050846080:12345-0@lo:400:kworker.0 Request processed in 232us (995us total) trans 0 rc 0/0 00000100:00100000:1.0:1789403554.036016:0:22791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1789403554.036062:0:3626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a141aaed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3626:1876325050846464:0@lo:400:kworker.0 00000100:00100000:1.0:1789403554.036094:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789403554.036119:0:3626:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789403554.036125:0:3626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a141aae680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3626:1876325050846592:0@lo:400:kworker.0 00000100:00100000:1.0:1789403554.036172:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789403554.036204:0:22787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050846720 00000100:00100000:1.0:1789403554.036208:0:22787:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050846720 00000100:00100000:1.0:1789403554.036238:0:22787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050846464 00000100:00100000:1.0:1789403554.036242:0:22787:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050846464 00000100:00100000:1.0:1789403554.036257:0:22787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1789403554.036263:0:22787:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a141aaf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3629:x1876325050846720:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789403554.036317:0:22787:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a141aaf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3629:x1876325050846720:12345-0@lo:400:kworker.0 Request processed in 52us (648us total) trans 0 rc 0/0 00000100:00100000:1.0:1789403554.036323:0:22787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1789403554.036337:0:22787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1789403554.036345:0:22787:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a141aaf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3626:x1876325050846464:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789403554.036375:0:22787:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a141aaf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3626:x1876325050846464:12345-0@lo:400:kworker.0 Request processed in 33us (284us total) trans 0 rc 0/0 00000100:00100000:1.0:1789403554.036382:0:22787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:1.0:1789403554.036623:0:3629:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff90a141aad500 x1876325050846720/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789403570 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789403554.036639:0:3629:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a141aad500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3629:1876325050846720:0@lo:400:kworker.0 00010000:00080000:1.0:1789403554.036672:0:3626:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff90a141aaed80 x1876325050846464/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789403570 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789403554.036680:0:3626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a141aaed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3626:1876325050846464:0@lo:400:kworker.0 00000100:00100000:1.0:1789403554.036703:0:3628:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a141aac000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3628:1876325050846080:0@lo:400:kworker.0 00000100:00100000:1.0:1789403554.036712:0:3628:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a141aace00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7ccb4038-daf9-4dcd-9b85-da9390181204:3628:1876325050845952:0@lo:400:kworker.0 00000100:00100000:1.0:1789403554.036730:0:3625:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a141aad880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3625:1876325050846208:0@lo:8:kworker.0 00000400:00000100:1.0:1789403554.036887:0:3625:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1876325050846208 offset 0 length 520: 4 00000100:00100000:1.0:1789403554.036915:0:3625:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a141aac380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3625:1876325050846336:0@lo:8:kworker.0 00000400:00000100:1.0:1789403554.036931:0:3625:0:(lib-move.c:4350:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1876325050846336 offset 0 length 520: 4 00000040:00080000:3.0:1789403554.038070:0:23539:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:3.0:1789403554.038577:0:22792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050846592 00000001:00100000:2.0:1789403554.038585:0:23519:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:3.0:1789403554.038587:0:22792:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050846592 00000100:00100000:3.0:1789403554.038633:0:22792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1789403554.038644:0:22792:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a141aaea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3626:x1876325050846592:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789403554.038720:0:22792:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a141aaea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3626:x1876325050846592:12345-0@lo:400:kworker.0 Request processed in 78us (2547us total) trans 0 rc 0/0 00000100:00100000:3.0:1789403554.038727:0:22792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1789403554.038836:0:3626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a141aae680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3626:1876325050846592:0@lo:400:kworker.0 00010000:00010000:3.0:1789403554.545566:0:22775:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789403555.570333:0:22774:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:1.0:1789403555.591382:0:24286:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:1.0:1789403555.591424:0:24286:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/ost1_flakey 00000020:01000004:1.0:1789403555.591427:0:24286:0:(obd_mount.c:929:lmd_print()) options: errors=remount-ro 00000080:01200004:1.0:1789403555.591557:0:24286:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff90a2669be000 00000020:01000004:1.0:1789403555.591576:0:24286:0:(tgt_mount.c:2502:osd_start()) Attempting to start lustre-OST0000, type=osd-ldiskfs, lsifl=200002, mountfl=0 00000020:01000004:1.0:1789403555.591595:0:24286:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-ldiskfs) 00000020:00000080:1.0:1789403555.591638:0:24286:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (ffff90a27cee8000) 00000020:00000080:1.0:1789403555.593217:0:24286:0:(obd_config.c:720:class_attach_name()) OBD: dev 20 attached type osd-ldiskfs with refcount 2 00100000:10000000:3.0:1789403555.663427:0:24286:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:3.0:1789403555.666256:0:24286:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000003:0x4:0x0] (8/32) registered 00100000:10000000:3.0:1789403555.666914:0:24286:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:3.0:1789403555.672215:0:24286:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:3.0:1789403555.672928:0:24286:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/32) registered 00100000:10000000:3.0:1789403555.673209:0:24286:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/32) registered 00100000:10000000:3.0:1789403555.673566:0:24286:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8) registered 00080000:01000000:2.0:1789403555.680850:0:24286:0:(osd_lproc.c:911:osd_procfs_init()) lustre-OST0000: register osd-ldiskfs tunable parameters 00000020:00000080:2.0:1789403555.681134:0:24286:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:2.0:1789403555.681152:0:24286:0:(osd_handler.c:8924:osd_obd_connect()) connect #0 00000020:00000080:2.0:1789403555.681167:0:24286:0:(genops.c:1384:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x5fb08b1e5b762764 00000020:01000004:2.0:1789403555.681180:0:24286:0:(tgt_mount.c:2587:server_fill_super()) Found service lustre-OST0000 on device /dev/mapper/ost1_flakey 00000020:01000004:2.0:1789403555.681208:0:24286:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.203.143@tcp:Set MGC reconnect 1 10000000:01000000:2.0:1789403555.681213:0:24286:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.203.143@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:2.0:1789403555.681219:0:24286:0:(tgt_mount.c:1808:server_start_targets()) starting target lustre-OST0000 00000020:01000004:2.0:1789403555.681224:0:24286:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:2.0:1789403555.681266:0:24286:0:(genops.c:413:class_newdev()) Allocate new device OSS (ffff90a2668b3380) 00000020:00000080:2.0:1789403555.681280:0:24286:0:(obd_config.c:720:class_attach_name()) OBD: dev 21 attached type ost with refcount 2 00000100:00100000:2.0:1789403555.686310:0:24286:0:(service.c:155:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1789403555.686701:0:24286:0:(service.c:3467:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:2.0:1789403555.686709:0:24286:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:1.0:1789403555.692877:0:24286:0:(service.c:3467:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:1.0:1789403555.692899:0:24286:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:0.0:1789403555.698947:0:24286:0:(service.c:3467:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:1.0:1789403555.699182:0:24286:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:1.0:1789403555.712255:0:24286:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1789403555.713520:0:24286:0:(service.c:3467:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:1.0:1789403555.713531:0:24286:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:2.0:1789403555.716896:0:24286:0:(service.c:3467:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:2.0:1789403555.716917:0:24286:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00000100:00100000:0.0:1789403555.735642:0:24286:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1789403555.735983:0:24286:0:(service.c:3467:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:0.0:1789403555.735990:0:24286:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:0.0:1789403555.737217:0:24286:0:(service.c:3467:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:0.0:1789403555.737228:0:24286:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:0.0:1789403555.738055:0:24286:0:(service.c:3467:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:0.0:1789403555.738063:0:24286:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:1.0:1789403555.739721:0:24286:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1789403555.739932:0:24286:0:(service.c:3467:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:1.0:1789403555.739938:0:24286:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:0.0:1789403555.740538:0:24286:0:(service.c:3467:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:0.0:1789403555.740545:0:24286:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00000100:00100000:0.0:1789403555.766653:0:24286:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1789403555.766951:0:24286:0:(service.c:3467:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:0.0:1789403555.766958:0:24286:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:0.0:1789403555.768140:0:24286:0:(service.c:3467:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:0.0:1789403555.768150:0:24286:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:0.0:1789403555.768607:0:24286:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:0.0:1789403555.768633:0:24286:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/ost1_flakey 10000000:01000000:0.0:1789403555.768640:0:24286:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.143@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000040:01000000:1.0:1789403555.803535:0:24286:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.143@tcp ctxt 0 is initialized 00000020:01000004:1.0:1789403555.803588:0:24286:0:(tgt_mount.c:1416:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.203.143@tcp, index=0000, flags=0x20002 00000020:01000004:1.0:1789403555.803593:0:24286:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:1.0:1789403555.803595:0:24286:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1789403555.803597:0:24286:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1789403555.803598:0:24286:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1789403555.803600:0:24286:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1789403555.803601:0:24286:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1789403555.803602:0:24286:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1789403555.803608:0:24286:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1789403555.803610:0:24286:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1789403555.803615:0:24286:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020002 00000020:01000004:1.0:1789403555.803616:0:24286:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1789403555.803618:0:24286:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1789403555.803619:0:24286:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1789403555.803620:0:24286:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1789403555.803620:0:24286:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1789403555.803621:0:24286:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1789403555.803632:0:24286:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1789403555.803633:0:24286:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1789403555.803634:0:24286:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1789403555.803669:0:24286:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:1.0:1789403555.803695:0:24286:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a141aae680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7ccb4038-daf9-4dcd-9b85-da9390181204:24286:1876325050846848:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1789403555.806056:0:24286:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789403555.806187:0:24286:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a270011480 going to sleep for 11 seconds 00000100:00100000:1.0:1789403555.806383:0:22778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050846848 00000100:00100000:1.0:1789403555.806596:0:22778:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050846848 00000100:00100000:1.0:1789403555.806690:0:22778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1789403555.806702:0:22778:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a277f41850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7ccb4038-daf9-4dcd-9b85-da9390181204+18:24286:x1876325050846848:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1789403555.806740:0:22778:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:1.0:1789403555.806744:0:22778:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0000 is running on 0@lo 20000000:01000000:1.0:1789403555.806749:0:22778:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:1.0:1789403555.807282:0:22778:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a277f41850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7ccb4038-daf9-4dcd-9b85-da9390181204+18:24286:x1876325050846848:12345-0@lo:253:mount.lustre.0 Request processed in 580us (1231us total) trans 0 rc 0/0 00000100:00100000:1.0:1789403555.807296:0:22778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1789403555.807412:0:24286:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a141aae680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7ccb4038-daf9-4dcd-9b85-da9390181204:24286:1876325050846848:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1789403555.807441:0:24286:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:2.0:1789403555.807444:0:24286:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1789403555.807446:0:24286:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1789403555.807447:0:24286:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789403555.807448:0:24286:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789403555.807450:0:24286:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789403555.807451:0:24286:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789403555.807452:0:24286:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1789403555.807453:0:24286:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789403555.807454:0:24286:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1789403555.807473:0:24286:0:(tgt_mount.c:101:server_register_mount()) register mount ffff90a2669be000 from lustre-OST0000 10000000:01000000:2.0:1789403555.807523:0:24286:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:2.0:1789403555.807526:0:24286:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:2.0:1789403555.807535:0:24286:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff90a27e00b380 local copy 00010000:00010000:2.0:1789403555.807544:0:24286:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.143@tcp lock: ffff90a144063400/0x5fb08b1e5b76251f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb08b1e5b762526 expref: -99 pid: 22765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789403555.807663:0:24286:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a27a64d500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7ccb4038-daf9-4dcd-9b85-da9390181204:24286:1876325050846976:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789403555.807697:0:24286:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789403555.807963:0:24286:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a245ca7180 going to sleep for 11 seconds 00000100:00100000:0.0:1789403555.808225:0:22780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050846976 00000100:00100000:0.0:1789403555.808232:0:22780:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050846976 00000100:00100000:0.0:1789403555.808281:0:22780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1789403555.808291:0:22780:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a277f43050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7ccb4038-daf9-4dcd-9b85-da9390181204+18:24286:x1876325050846976:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789403555.808577:0:22780:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a277f43050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7ccb4038-daf9-4dcd-9b85-da9390181204+18:24286:x1876325050846976:12345-0@lo:501:mount.lustre.0 Request processed in 287us (878us total) trans 0 rc -2/-2 00000100:00100000:0.0:1789403555.808586:0:22780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1789403555.808654:0:24286:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a27a64d500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7ccb4038-daf9-4dcd-9b85-da9390181204:24286:1876325050846976:0@lo:501:mount.lustre.0 10000000:01000000:2.0:1789403555.808669:0:24286:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.203.143@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:2.0:1789403555.808692:0:24286:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.203.143@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:2.0:1789403555.808699:0:24286:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.143@tcp lock: ffff90a144063400/0x5fb08b1e5b76251f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb08b1e5b762526 expref: -99 pid: 22765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403555.808710:0:24286:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.143@tcp lock: ffff90a144063400/0x5fb08b1e5b76251f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb08b1e5b762526 expref: -99 pid: 22765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789403555.808797:0:24286:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff90a2669be000 10000000:01000000:2.0:1789403555.808803:0:24286:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:2.0:1789403555.808808:0:24286:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:2.0:1789403555.808810:0:24286:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1789403555.808814:0:24286:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:2.0:1789403555.808817:0:24286:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:2.0:1789403555.808840:0:24286:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.143@tcp lock: ffff90a270185400/0x5fb08b1e5b762772 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 24286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403555.808848:0:24286:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.143@tcp lock: ffff90a270185400/0x5fb08b1e5b762772 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 24286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403555.808868:0:24286:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.143@tcp lock: ffff90a270185400/0x5fb08b1e5b762772 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 24286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789403555.808889:0:24286:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a27a64d500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7ccb4038-daf9-4dcd-9b85-da9390181204:24286:1876325050847104:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1789403555.808923:0:24286:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789403555.808946:0:24286:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a245ca7180 going to sleep for 11 seconds 00000100:00100000:0.0:1789403555.809003:0:22780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050847104 00000100:00100000:0.0:1789403555.809009:0:22780:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050847104 00000100:00100000:0.0:1789403555.809219:0:22780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1789403555.809233:0:22780:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a277f43c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7ccb4038-daf9-4dcd-9b85-da9390181204+18:24286:x1876325050847104:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1789403555.809243:0:22780:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789403555.809260:0:22780:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90a248af1c00/0x5fb08b1e5b762779 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x5fb08b1e5b762772 expref: -99 pid: 22780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403555.809281:0:22780:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90a248af1c00/0x5fb08b1e5b762779 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5fb08b1e5b762772 expref: 19 pid: 22780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403555.809290:0:22780:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90a248af1c00/0x5fb08b1e5b762779 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5fb08b1e5b762772 expref: 19 pid: 22780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403555.809298:0:22780:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a248af1c00, rc 0) 00000100:00100000:0.0:1789403555.809386:0:22780:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a277f43c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7ccb4038-daf9-4dcd-9b85-da9390181204+19:24286:x1876325050847104:12345-0@lo:101:mount.lustre.0 Request processed in 157us (461us total) trans 0 rc 0/0 00000100:00100000:0.0:1789403555.809417:0:22780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1789403555.811024:0:24286:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a27a64d500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7ccb4038-daf9-4dcd-9b85-da9390181204:24286:1876325050847104:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1789403555.811209:0:24286:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.143@tcp lock: ffff90a270185400/0x5fb08b1e5b762772 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb08b1e5b762779 expref: -99 pid: 24286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403555.811223:0:24286:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.143@tcp lock: ffff90a270185400/0x5fb08b1e5b762772 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x5fb08b1e5b762779 expref: -99 pid: 24286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1789403555.813026:0:24286:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 14 count 14 00000040:00080000:2.0:1789403555.813950:0:24286:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1789403555.819233:0:24286:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].1, 224 off8416 00000040:00080000:2.0:1789403555.819291:0:24286:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].2, 128 off8544 00000040:00080000:2.0:1789403555.819385:0:24286:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].3, 112 off8656 00000040:00080000:2.0:1789403555.820701:0:24286:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].4, 224 off8880 00000040:00080000:2.0:1789403555.820724:0:24286:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].5, 224 off9104 00000040:00080000:2.0:1789403555.821002:0:24286:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].6, 80 off9184 00000040:00080000:2.0:1789403555.821034:0:24286:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].7, 224 off9408 00000040:00080000:2.0:1789403555.821048:0:24286:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].8, 224 off9632 00000040:00080000:2.0:1789403555.821061:0:24286:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].9, 80 off9712 00000040:00080000:2.0:1789403555.821072:0:24286:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].10, 224 off9936 00000040:00080000:2.0:1789403555.821085:0:24286:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].11, 224 off10160 00000040:00080000:2.0:1789403555.821098:0:24286:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].12, 120 off10280 00000040:00080000:2.0:1789403555.821124:0:24286:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].13, 224 off10504 00000040:00080000:2.0:1789403555.821131:0:24286:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 13 count 14 00000100:00100000:2.0:1789403555.821249:0:24286:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a27a64d500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7ccb4038-daf9-4dcd-9b85-da9390181204:24286:1876325050847232:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789403555.821325:0:24286:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789403555.821378:0:24286:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a245ca7c00 going to sleep for 11 seconds 00000100:00100000:0.0:1789403555.821504:0:22780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050847232 00000100:00100000:0.0:1789403555.821512:0:22780:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050847232 00000100:00100000:0.0:1789403555.821560:0:22780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1789403555.821569:0:22780:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a277f40c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7ccb4038-daf9-4dcd-9b85-da9390181204+19:24286:x1876325050847232:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789403555.821734:0:22780:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a277f40c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7ccb4038-daf9-4dcd-9b85-da9390181204+19:24286:x1876325050847232:12345-0@lo:501:mount.lustre.0 Request processed in 165us (407us total) trans 0 rc 0/0 00000100:00100000:0.0:1789403555.821747:0:22780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1789403555.822095:0:24286:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a27a64d500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7ccb4038-daf9-4dcd-9b85-da9390181204:24286:1876325050847232:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789403555.822133:0:24286:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a27a64d500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7ccb4038-daf9-4dcd-9b85-da9390181204:24286:1876325050847360:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1789403555.822180:0:24286:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789403555.822227:0:24286:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a245ca7c00 going to sleep for 11 seconds 00000100:00100000:3.0:1789403555.822302:0:22781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050847360 00000100:00100000:3.0:1789403555.822308:0:22781:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050847360 00000100:00100000:3.0:1789403555.822350:0:22781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1789403555.822360:0:22781:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a277f42850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7ccb4038-daf9-4dcd-9b85-da9390181204+19:24286:x1876325050847360:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1789403555.823479:0:22781:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a277f42850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7ccb4038-daf9-4dcd-9b85-da9390181204+19:24286:x1876325050847360:12345-0@lo:503:mount.lustre.0 Request processed in 1116us (1292us total) trans 0 rc 0/0 00000100:00100000:3.0:1789403555.823499:0:22781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1789403555.825582:0:24286:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a27a64d500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7ccb4038-daf9-4dcd-9b85-da9390181204:24286:1876325050847360:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1789403555.827357:0:24286:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1789403555.827539:0:24286:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a27a64d500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7ccb4038-daf9-4dcd-9b85-da9390181204:24286:1876325050847488:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1789403555.827625:0:24286:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789403555.827675:0:24286:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a245ca7180 going to sleep for 11 seconds 00000100:00100000:1.0:1789403555.827834:0:22778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050847488 00000100:00100000:1.0:1789403555.827842:0:22778:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050847488 00000100:00100000:1.0:1789403555.827947:0:22778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1789403555.827958:0:22778:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a26c7fd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7ccb4038-daf9-4dcd-9b85-da9390181204+19:24286:x1876325050847488:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1789403555.828478:0:22778:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a26c7fd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7ccb4038-daf9-4dcd-9b85-da9390181204+19:24286:x1876325050847488:12345-0@lo:502:mount.lustre.0 Request processed in 520us (850us total) trans 0 rc 0/0 00000100:00100000:1.0:1789403555.828486:0:22778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1789403555.828600:0:24286:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a27a64d500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7ccb4038-daf9-4dcd-9b85-da9390181204:24286:1876325050847488:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1789403555.828811:0:24286:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].1, 224 off8416 00000040:00080000:2.0:1789403555.828841:0:24286:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].2, 128 off8544 00000040:00080000:2.0:1789403555.828855:0:24286:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].3, 112 off8656 00000040:00080000:2.0:1789403555.828867:0:24286:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].4, 224 off8880 00000040:00080000:2.0:1789403555.828881:0:24286:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].5, 224 off9104 00000040:00080000:2.0:1789403555.828895:0:24286:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].6, 80 off9184 00000040:00080000:2.0:1789403555.828937:0:24286:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].7, 224 off9408 00000040:00080000:2.0:1789403555.828953:0:24286:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].8, 224 off9632 00000040:00080000:2.0:1789403555.828965:0:24286:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].9, 80 off9712 00000040:00080000:2.0:1789403555.828978:0:24286:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].10, 224 off9936 00000040:00080000:2.0:1789403555.828989:0:24286:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].11, 224 off10160 00000040:00080000:2.0:1789403555.829001:0:24286:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].12, 120 off10280 00000100:00100000:2.0:1789403555.829039:0:24286:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a27a64d500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7ccb4038-daf9-4dcd-9b85-da9390181204:24286:1876325050847616:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1789403555.829098:0:24286:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789403555.829491:0:24286:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a245ca7180 going to sleep for 11 seconds 00000100:00100000:1.0:1789403555.829581:0:22778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050847616 00000100:00100000:1.0:1789403555.829588:0:22778:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050847616 00000100:00100000:1.0:1789403555.829618:0:22778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1789403555.829624:0:22778:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a26c7ff050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7ccb4038-daf9-4dcd-9b85-da9390181204+19:24286:x1876325050847616:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1789403555.829766:0:22778:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a26c7ff050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7ccb4038-daf9-4dcd-9b85-da9390181204+19:24286:x1876325050847616:12345-0@lo:502:mount.lustre.0 Request processed in 142us (667us total) trans 0 rc 0/0 00000100:00100000:1.0:1789403555.829773:0:22778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1789403555.831195:0:24286:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a27a64d500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7ccb4038-daf9-4dcd-9b85-da9390181204:24286:1876325050847616:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1789403555.831341:0:24286:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].13, 224 off10504 00000040:00080000:2.0:1789403555.831353:0:24286:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 13 count 14 00000020:01000000:2.0:1789403555.832845:0:24303:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1789403555.832854:0:24303:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/ost1_flakey 00000020:00000080:2.0:1789403555.832859:0:24303:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789403555.832860:0:24303:0:(obd_config.c:1563:class_process_config()) marker 21 (0x1) lustre-OST0000 add ost 00000020:00000080:2.0:1789403555.832865:0:24303:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1789403555.832877:0:24303:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (ffff90a2668b4d40) 00000020:00000080:2.0:1789403555.832898:0:24303:0:(obd_config.c:720:class_attach_name()) OBD: dev 22 attached type obdfilter with refcount 2 00000020:00000080:2.0:1789403555.832901:0:24303:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:2.0:1789403555.833032:0:24303:0:(tgt_mount.c:153:server_get_mount()) get mount ffff90a2669be000 from lustre-OST0000, refs=2 00080000:01000000:2.0:1789403555.833040:0:24303:0:(osd_handler.c:8924:osd_obd_connect()) connect #1 00000020:00000080:2.0:1789403555.833113:0:24303:0:(genops.c:1384:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x5fb08b1e5b762787 00010000:00010000:2.0:1789403555.839009:0:24303:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-3 is initialized 00000001:00000004:3.0:1789403555.839710:0:24303:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 3, last_transno is 8589934600 00080000:10000000:3.0:1789403555.841966:0:24303:0:(osd_handler.c:5580:osd_index_try()) lustre-OST0000: index object [0x200000003:0xb:0x0] (8/32) registered 00000020:00000080:1.0:1789403555.845327:0:24303:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:1.0:1789403555.845339:0:24303:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789403555.845346:0:24303:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789403555.845348:0:24303:0:(obd_config.c:1563:class_process_config()) marker 21 (0x2) lustre-OST0000 add ost 00000020:01000000:1.0:1789403555.845351:0:24303:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:1.0:1789403555.845354:0:24303:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #26 00000020:01000000:1.0:1789403555.845356:0:24303:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1789403555.845357:0:24303:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1789403555.845359:0:24303:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:1.0:1789403555.845361:0:24303:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789403555.845363:0:24303:0:(obd_config.c:1563:class_process_config()) marker 26 (0x6) lustre sys.timeout 00000020:01000000:1.0:1789403555.845365:0:24303:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789403555.845368:0:24303:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789403555.845370:0:24303:0:(obd_config.c:1563:class_process_config()) marker 34 (0x1) lustre sys.timeout 00000020:00000080:1.0:1789403555.845373:0:24303:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1789403555.845374:0:24303:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:1.0:1789403555.845377:0:24303:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789403555.845379:0:24303:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789403555.845380:0:24303:0:(obd_config.c:1563:class_process_config()) marker 34 (0x2) lustre sys.timeout 00000020:01000000:1.0:1789403555.845383:0:24303:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789403555.845385:0:24303:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789403555.845386:0:24303:0:(obd_config.c:1563:class_process_config()) marker 39 (0x1) lustre sys.jobid_var 00000020:00000080:1.0:1789403555.845441:0:24303:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:1.0:1789403555.845471:0:24303:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789403555.845474:0:24303:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789403555.845476:0:24303:0:(obd_config.c:1563:class_process_config()) marker 39 (0x2) lustre sys.jobid_var 00000040:00080000:1.0:1789403555.845484:0:24303:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xc:0x0] index 14 count 14 00000020:01000000:0.0:1789403555.849538:0:24286:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-13 (rc=0) 10000000:01000000:0.0:1789403555.849601:0:24286:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.143@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:0.0:1789403555.849624:0:24286:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.143@tcp lock: ffff90a270185400/0x5fb08b1e5b762772 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb08b1e5b762779 expref: -99 pid: 24286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403555.849637:0:24286:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.143@tcp lock: ffff90a270185400/0x5fb08b1e5b762772 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb08b1e5b762779 expref: -99 pid: 24286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789403555.849646:0:24286:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff90a2669be000 from 1 10000000:01000000:0.0:1789403555.849649:0:24286:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1789403555.849697:0:24286:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.143@tcp lock: ffff90a248af0600/0x5fb08b1e5b76278e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 24286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403555.849705:0:24286:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.143@tcp lock: ffff90a248af0600/0x5fb08b1e5b76278e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 24286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403555.849716:0:24286:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.143@tcp lock: ffff90a248af0600/0x5fb08b1e5b76278e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 24286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789403555.849739:0:24286:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a144bed880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7ccb4038-daf9-4dcd-9b85-da9390181204:24286:1876325050847744:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1789403555.849822:0:24286:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789403555.849869:0:24286:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a274c8c240 going to sleep for 11 seconds 00000100:00100000:3.0:1789403555.854893:0:22778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050847744 00000100:00100000:3.0:1789403555.854908:0:22778:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050847744 00000100:00100000:3.0:1789403555.854966:0:22778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1789403555.854979:0:22778:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a26c7fc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7ccb4038-daf9-4dcd-9b85-da9390181204+19:24286:x1876325050847744:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1789403555.854996:0:22778:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789403555.855021:0:22778:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90a259947400/0x5fb08b1e5b762795 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x5fb08b1e5b76278e expref: -99 pid: 22778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403555.855050:0:22778:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90a259947400/0x5fb08b1e5b762795 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5fb08b1e5b76278e expref: 20 pid: 22778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403555.855061:0:22778:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90a259947400/0x5fb08b1e5b762795 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5fb08b1e5b76278e expref: 20 pid: 22778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403555.855070:0:22778:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a259947400, rc 0) 00000100:00100000:3.0:1789403555.855144:0:22778:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a26c7fc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7ccb4038-daf9-4dcd-9b85-da9390181204+20:24286:x1876325050847744:12345-0@lo:101:mount.lustre.0 Request processed in 169us (5324us total) trans 0 rc 0/0 00000100:00100000:3.0:1789403555.855150:0:22778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1789403555.855250:0:24286:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a144bed880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7ccb4038-daf9-4dcd-9b85-da9390181204:24286:1876325050847744:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1789403555.855272:0:24286:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.143@tcp lock: ffff90a248af0600/0x5fb08b1e5b76278e lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb08b1e5b762795 expref: -99 pid: 24286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403555.855284:0:24286:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.143@tcp lock: ffff90a248af0600/0x5fb08b1e5b76278e lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x5fb08b1e5b762795 expref: -99 pid: 24286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1789403555.857228:0:24286:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 13 count 13 00000040:00080000:0.0:1789403555.857626:0:24286:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1789403555.858161:0:24286:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].1, 224 off8416 00000040:00080000:0.0:1789403555.858185:0:24286:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].2, 112 off8528 00000040:00080000:0.0:1789403555.858209:0:24286:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].3, 224 off8752 00000040:00080000:0.0:1789403555.858222:0:24286:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].4, 224 off8976 00000040:00080000:0.0:1789403555.858657:0:24286:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].5, 112 off9088 00000040:00080000:0.0:1789403555.858685:0:24286:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].6, 224 off9312 00000040:00080000:0.0:1789403555.858702:0:24286:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].7, 224 off9536 00000040:00080000:0.0:1789403555.858717:0:24286:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].8, 128 off9664 00000040:00080000:0.0:1789403555.858734:0:24286:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].9, 224 off9888 00000040:00080000:0.0:1789403555.858871:0:24286:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].10, 224 off10112 00000040:00080000:0.0:1789403555.858887:0:24286:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].11, 128 off10240 00000040:00080000:0.0:1789403555.858908:0:24286:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].12, 224 off10464 00000040:00080000:0.0:1789403555.858915:0:24286:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 12 count 13 00000100:00100000:0.0:1789403555.859087:0:24286:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a144bed500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7ccb4038-daf9-4dcd-9b85-da9390181204:24286:1876325050847872:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789403555.859217:0:24286:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789403555.859376:0:24286:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a274c8c600 going to sleep for 11 seconds 00000100:00100000:3.0:1789403555.859542:0:22781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050847872 00000100:00100000:3.0:1789403555.859550:0:22781:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050847872 00000100:00100000:3.0:1789403555.859591:0:22781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1789403555.859599:0:22781:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a26c7fe050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7ccb4038-daf9-4dcd-9b85-da9390181204+20:24286:x1876325050847872:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789403555.859766:0:22781:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a26c7fe050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7ccb4038-daf9-4dcd-9b85-da9390181204+20:24286:x1876325050847872:12345-0@lo:501:mount.lustre.0 Request processed in 159us (541us total) trans 0 rc 0/0 00000100:00100000:3.0:1789403555.859787:0:22781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1789403555.860008:0:24286:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a144bed500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7ccb4038-daf9-4dcd-9b85-da9390181204:24286:1876325050847872:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789403555.860055:0:24286:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a144bed500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7ccb4038-daf9-4dcd-9b85-da9390181204:24286:1876325050848000:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1789403555.860095:0:24286:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789403555.860162:0:24286:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a274c8c600 going to sleep for 11 seconds 00000100:00100000:3.0:1789403555.860308:0:22780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050848000 00000100:00100000:3.0:1789403555.860312:0:22780:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050848000 00000100:00100000:3.0:1789403555.860343:0:22780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1789403555.860350:0:22780:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a26c7fe450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7ccb4038-daf9-4dcd-9b85-da9390181204+20:24286:x1876325050848000:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1789403555.860679:0:22780:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a26c7fe450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7ccb4038-daf9-4dcd-9b85-da9390181204+20:24286:x1876325050848000:12345-0@lo:503:mount.lustre.0 Request processed in 328us (582us total) trans 0 rc 0/0 00000100:00100000:3.0:1789403555.860687:0:22780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1789403555.860854:0:24286:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a144bed500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7ccb4038-daf9-4dcd-9b85-da9390181204:24286:1876325050848000:0@lo:503:mount.lustre.0 00000040:00080000:0.0:1789403555.861531:0:24286:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1789403555.861600:0:24286:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a144bed500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7ccb4038-daf9-4dcd-9b85-da9390181204:24286:1876325050848128:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1789403555.861651:0:24286:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789403555.861724:0:24286:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a274c8c600 going to sleep for 11 seconds 00000100:00100000:3.0:1789403555.861873:0:22778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050848128 00000100:00100000:3.0:1789403555.861879:0:22778:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050848128 00000100:00100000:3.0:1789403555.861914:0:22778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1789403555.861986:0:22778:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a26c7fe850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7ccb4038-daf9-4dcd-9b85-da9390181204+20:24286:x1876325050848128:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789403555.862115:0:22778:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a26c7fe850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7ccb4038-daf9-4dcd-9b85-da9390181204+20:24286:x1876325050848128:12345-0@lo:502:mount.lustre.0 Request processed in 193us (463us total) trans 0 rc 0/0 00000100:00100000:3.0:1789403555.862121:0:22778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1789403555.862284:0:24286:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a144bed500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7ccb4038-daf9-4dcd-9b85-da9390181204:24286:1876325050848128:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1789403555.862516:0:24286:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].1, 224 off8416 00000040:00080000:0.0:1789403555.862538:0:24286:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].2, 112 off8528 00000040:00080000:0.0:1789403555.862548:0:24286:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].3, 224 off8752 00000040:00080000:0.0:1789403555.862567:0:24286:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].4, 224 off8976 00000040:00080000:0.0:1789403555.862583:0:24286:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].5, 112 off9088 00000040:00080000:0.0:1789403555.862598:0:24286:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].6, 224 off9312 00000040:00080000:0.0:1789403555.862609:0:24286:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].7, 224 off9536 00000040:00080000:0.0:1789403555.862619:0:24286:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].8, 128 off9664 00000040:00080000:0.0:1789403555.862629:0:24286:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].9, 224 off9888 00000040:00080000:0.0:1789403555.862640:0:24286:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].10, 224 off10112 00000040:00080000:0.0:1789403555.862650:0:24286:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].11, 128 off10240 00000100:00100000:0.0:1789403555.862671:0:24286:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a144bed500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7ccb4038-daf9-4dcd-9b85-da9390181204:24286:1876325050848256:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1789403555.862706:0:24286:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789403555.862803:0:24286:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a274c8c600 going to sleep for 11 seconds 00000100:00100000:3.0:1789403555.862911:0:22780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050848256 00000100:00100000:3.0:1789403555.862916:0:22780:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050848256 00000100:00100000:3.0:1789403555.863050:0:22780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1789403555.863059:0:22780:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a26c7fdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7ccb4038-daf9-4dcd-9b85-da9390181204+20:24286:x1876325050848256:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789403555.863143:0:22780:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a26c7fdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7ccb4038-daf9-4dcd-9b85-da9390181204+20:24286:x1876325050848256:12345-0@lo:502:mount.lustre.0 Request processed in 75us (425us total) trans 0 rc 0/0 00000100:00100000:3.0:1789403555.863151:0:22780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1789403555.863313:0:24286:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a144bed500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7ccb4038-daf9-4dcd-9b85-da9390181204:24286:1876325050848256:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1789403555.863354:0:24286:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].12, 224 off10464 00000040:00080000:0.0:1789403555.863362:0:24286:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 12 count 13 00000020:01000000:0.0:1789403555.864202:0:24307:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789403555.864213:0:24307:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789403555.864215:0:24307:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:0.0:1789403555.864222:0:24307:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff90a2669be000 00000020:00000080:0.0:1789403555.864224:0:24307:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1789403555.864351:0:24307:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789403555.864356:0:24307:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789403555.864358:0:24307:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:0.0:1789403555.864361:0:24307:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789403555.864364:0:24307:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789403555.864365:0:24307:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:0.0:1789403555.864368:0:24307:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff90a2669be000 00000020:00000080:0.0:1789403555.864371:0:24307:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1789403555.864465:0:24307:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789403555.864470:0:24307:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789403555.864471:0:24307:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:0.0:1789403555.864474:0:24307:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789403555.864483:0:24307:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789403555.864485:0:24307:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1789403555.864489:0:24307:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff90a2669be000 00000020:00000080:0.0:1789403555.864491:0:24307:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1789403555.864512:0:24307:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789403555.864515:0:24307:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789403555.864516:0:24307:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1789403555.864518:0:24307:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789403555.864520:0:24307:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789403555.864521:0:24307:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:0.0:1789403555.864525:0:24307:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff90a2669be000 00000020:00000080:0.0:1789403555.864527:0:24307:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1789403555.864550:0:24307:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789403555.864553:0:24307:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789403555.864555:0:24307:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:0.0:1789403555.864558:0:24307:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xe:0x0] index 13 count 13 00000020:01000000:2.0:1789403555.867163:0:24286:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:2.0:1789403555.867206:0:24286:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.143@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1789403555.867227:0:24286:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.143@tcp lock: ffff90a248af0600/0x5fb08b1e5b76278e lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb08b1e5b762795 expref: -99 pid: 24286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403555.867240:0:24286:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.143@tcp lock: ffff90a248af0600/0x5fb08b1e5b76278e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb08b1e5b762795 expref: -99 pid: 24286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789403555.867304:0:24286:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:2.0:1789403555.867307:0:24286:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff90a2669be000 10000000:01000000:2.0:1789403555.867309:0:24286:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff90a2669be000 10000000:01000000:2.0:1789403555.867313:0:24286:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1789403555.867318:0:24286:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff90a2669be000 from 1 10000000:01000000:2.0:1789403555.867320:0:24286:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1789403555.867354:0:24286:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.143@tcp lock: ffff90a270185600/0x5fb08b1e5b76279c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 24286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403555.867370:0:24286:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.143@tcp lock: ffff90a270185600/0x5fb08b1e5b76279c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 24286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403555.867382:0:24286:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.143@tcp lock: ffff90a270185600/0x5fb08b1e5b76279c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 24286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789403555.867427:0:24286:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a27a64d500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7ccb4038-daf9-4dcd-9b85-da9390181204:24286:1876325050848384:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1789403555.867557:0:24286:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789403555.867603:0:24286:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a245ca7d80 going to sleep for 11 seconds 00000100:00100000:0.0:1789403555.868382:0:22780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050848384 00000100:00100000:0.0:1789403555.868406:0:22780:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050848384 00000100:00100000:0.0:1789403555.868454:0:22780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1789403555.868462:0:22780:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a26c7fec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7ccb4038-daf9-4dcd-9b85-da9390181204+20:24286:x1876325050848384:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1789403555.868475:0:22780:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789403555.868488:0:22780:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90a248af0400/0x5fb08b1e5b7627a3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x5fb08b1e5b76279c expref: -99 pid: 22780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403555.868513:0:22780:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90a248af0400/0x5fb08b1e5b7627a3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5fb08b1e5b76279c expref: 21 pid: 22780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403555.868523:0:22780:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90a248af0400/0x5fb08b1e5b7627a3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5fb08b1e5b76279c expref: 21 pid: 22780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403555.868531:0:22780:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a248af0400, rc 0) 00000100:00100000:0.0:1789403555.868599:0:22780:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a26c7fec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7ccb4038-daf9-4dcd-9b85-da9390181204+21:24286:x1876325050848384:12345-0@lo:101:mount.lustre.0 Request processed in 137us (1041us total) trans 0 rc 0/0 00000100:00100000:0.0:1789403555.868606:0:22780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1789403555.868819:0:24286:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a27a64d500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7ccb4038-daf9-4dcd-9b85-da9390181204:24286:1876325050848384:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1789403555.868835:0:24286:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.143@tcp lock: ffff90a270185600/0x5fb08b1e5b76279c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb08b1e5b7627a3 expref: -99 pid: 24286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403555.868844:0:24286:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.143@tcp lock: ffff90a270185600/0x5fb08b1e5b76279c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x5fb08b1e5b7627a3 expref: -99 pid: 24286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1789403555.881943:0:24286:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 52 count 51 00000040:00080000:3.0:1789403555.882254:0:24286:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1789403555.882460:0:24286:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].1, 224 off8416 00000040:00080000:3.0:1789403555.882484:0:24286:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].2, 120 off8536 00000040:00080000:3.0:1789403555.882507:0:24286:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].3, 168 off8704 00000040:00080000:3.0:1789403555.882521:0:24286:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].4, 224 off8928 00000040:00080000:3.0:1789403555.882534:0:24286:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].5, 224 off9152 00000040:00080000:3.0:1789403555.882548:0:24286:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].6, 120 off9272 00000040:00080000:3.0:1789403555.882561:0:24286:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].7, 168 off9440 00000040:00080000:3.0:1789403555.882574:0:24286:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].8, 224 off9664 00000040:00080000:3.0:1789403555.882587:0:24286:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].9, 224 off9888 00000040:00080000:3.0:1789403555.882600:0:24286:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].10, 120 off10008 00000040:00080000:3.0:1789403555.882613:0:24286:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].11, 224 off10232 00000040:00080000:3.0:1789403555.882620:0:24286:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].12, 224 off10456 00000040:00080000:3.0:1789403555.882627:0:24286:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].13, 88 off10544 00000040:00080000:3.0:1789403555.882633:0:24286:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].14, 128 off10672 00000040:00080000:3.0:1789403555.882640:0:24286:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].15, 144 off10816 00000040:00080000:3.0:1789403555.882647:0:24286:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].16, 160 off10976 00000040:00080000:3.0:1789403555.882654:0:24286:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].17, 224 off11200 00000040:00080000:3.0:1789403555.882661:0:24286:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].18, 224 off11424 00000040:00080000:3.0:1789403555.882668:0:24286:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].19, 80 off11504 00000040:00080000:3.0:1789403555.882674:0:24286:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].20, 224 off11728 00000040:00080000:3.0:1789403555.882693:0:24286:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].21, 224 off11952 00000040:00080000:3.0:1789403555.882702:0:24286:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].22, 88 off12040 00000040:00080000:3.0:1789403555.882708:0:24286:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].23, 128 off12168 00000040:00080000:3.0:1789403555.882715:0:24286:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].24, 144 off12312 00000040:00080000:3.0:1789403555.882722:0:24286:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].25, 160 off12472 00000040:00080000:3.0:1789403555.882742:0:24286:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].26, 224 off12696 00000040:00080000:3.0:1789403555.882749:0:24286:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].27, 224 off12920 00000040:00080000:3.0:1789403555.882756:0:24286:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].28, 80 off13000 00000040:00080000:3.0:1789403555.882763:0:24286:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].29, 224 off13224 00000040:00080000:3.0:1789403555.882770:0:24286:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].30, 224 off13448 00000040:00080000:3.0:1789403555.882777:0:24286:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].31, 88 off13536 00000040:00080000:3.0:1789403555.882783:0:24286:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].32, 128 off13664 00000040:00080000:3.0:1789403555.882790:0:24286:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].33, 144 off13808 00000040:00080000:3.0:1789403555.882797:0:24286:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].34, 128 off13936 00000040:00080000:3.0:1789403555.882803:0:24286:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].35, 224 off14160 00000040:00080000:3.0:1789403555.882818:0:24286:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].36, 224 off14384 00000040:00080000:3.0:1789403555.882833:0:24286:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].37, 80 off14464 00000040:00080000:3.0:1789403555.882841:0:24286:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].38, 224 off14688 00000040:00080000:3.0:1789403555.882848:0:24286:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].39, 224 off14912 00000040:00080000:3.0:1789403555.882855:0:24286:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].40, 88 off15000 00000040:00080000:3.0:1789403555.882862:0:24286:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].41, 128 off15128 00000040:00080000:3.0:1789403555.882869:0:24286:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].42, 144 off15272 00000040:00080000:3.0:1789403555.882876:0:24286:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].43, 128 off15400 00000040:00080000:3.0:1789403555.882890:0:24286:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].44, 224 off15624 00000040:00080000:3.0:1789403555.882901:0:24286:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].45, 224 off15848 00000040:00080000:3.0:1789403555.882917:0:24286:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].46, 80 off15928 00000040:00080000:3.0:1789403555.882934:0:24286:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].47, 224 off16152 00000040:00080000:3.0:1789403555.882947:0:24286:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].48, 232 off16384 00000040:00080000:3.0:1789403555.883080:0:24286:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].49, 224 off16608 00000040:00080000:3.0:1789403555.883104:0:24286:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].50, 120 off16728 00000040:00080000:3.0:1789403555.883124:0:24286:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].51, 224 off16952 00000040:00080000:3.0:1789403555.883130:0:24286:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 51 count 51 00000100:00100000:3.0:1789403555.883213:0:24286:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a1443e6680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7ccb4038-daf9-4dcd-9b85-da9390181204:24286:1876325050848512:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789403555.883275:0:24286:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789403555.883323:0:24286:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a281abe240 going to sleep for 11 seconds 00000100:00100000:3.0:1789403555.883844:0:22781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050848512 00000100:00100000:3.0:1789403555.883853:0:22781:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050848512 00000100:00100000:3.0:1789403555.883900:0:22781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:3.0:1789403555.885592:0:22781:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a26c7ffc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7ccb4038-daf9-4dcd-9b85-da9390181204+21:24286:x1876325050848512:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789403555.885754:0:22781:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a26c7ffc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7ccb4038-daf9-4dcd-9b85-da9390181204+21:24286:x1876325050848512:12345-0@lo:501:mount.lustre.0 Request processed in 171us (2478us total) trans 0 rc 0/0 00000100:00100000:3.0:1789403555.889818:0:22781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:3.0:1789403555.889938:0:24286:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a1443e6680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7ccb4038-daf9-4dcd-9b85-da9390181204:24286:1876325050848512:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789403555.889995:0:24286:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a1443e6680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7ccb4038-daf9-4dcd-9b85-da9390181204:24286:1876325050848640:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1789403555.890077:0:24286:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789403555.890122:0:24286:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a281abe240 going to sleep for 11 seconds 00000100:00100000:2.0:1789403555.891609:0:22778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050848640 00000100:00100000:2.0:1789403555.891619:0:22778:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050848640 00000100:00100000:2.0:1789403555.891693:0:22778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:2.0:1789403555.891704:0:22778:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a26c7fc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7ccb4038-daf9-4dcd-9b85-da9390181204+21:24286:x1876325050848640:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1789403555.891845:0:22778:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a26c7fc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7ccb4038-daf9-4dcd-9b85-da9390181204+21:24286:x1876325050848640:12345-0@lo:503:mount.lustre.0 Request processed in 143us (1767us total) trans 0 rc 0/0 00000100:00100000:2.0:1789403555.891852:0:22778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:3.0:1789403555.892026:0:24286:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a1443e6680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7ccb4038-daf9-4dcd-9b85-da9390181204:24286:1876325050848640:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1789403555.893334:0:24286:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1789403555.894062:0:24286:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a1443e6680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7ccb4038-daf9-4dcd-9b85-da9390181204:24286:1876325050848768:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789403555.894132:0:24286:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789403555.894168:0:24286:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a281abe240 going to sleep for 11 seconds 00000100:00100000:3.0:1789403555.894195:0:22781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050848768 00000100:00100000:3.0:1789403555.894202:0:22781:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050848768 00000100:00100000:3.0:1789403555.894288:0:22781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:3.0:1789403555.894299:0:22781:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a26c7fcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7ccb4038-daf9-4dcd-9b85-da9390181204+21:24286:x1876325050848768:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789403555.894504:0:22781:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a26c7fcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7ccb4038-daf9-4dcd-9b85-da9390181204+21:24286:x1876325050848768:12345-0@lo:502:mount.lustre.0 Request processed in 206us (372us total) trans 0 rc 0/0 00000100:00100000:3.0:1789403555.894512:0:22781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:3.0:1789403555.894563:0:24286:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a1443e6680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7ccb4038-daf9-4dcd-9b85-da9390181204:24286:1876325050848768:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1789403555.894747:0:24286:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].1, 224 off8416 00000040:00080000:3.0:1789403555.894779:0:24286:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].2, 120 off8536 00000040:00080000:3.0:1789403555.894800:0:24286:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].3, 168 off8704 00000040:00080000:3.0:1789403555.894818:0:24286:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].4, 224 off8928 00000040:00080000:3.0:1789403555.894838:0:24286:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].5, 224 off9152 00000040:00080000:3.0:1789403555.894856:0:24286:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].6, 120 off9272 00000040:00080000:3.0:1789403555.894880:0:24286:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].7, 168 off9440 00000040:00080000:3.0:1789403555.894897:0:24286:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].8, 224 off9664 00000040:00080000:3.0:1789403555.894912:0:24286:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].9, 224 off9888 00000040:00080000:3.0:1789403555.894931:0:24286:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].10, 120 off10008 00000040:00080000:3.0:1789403555.894950:0:24286:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].11, 224 off10232 00000040:00080000:3.0:1789403555.894969:0:24286:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].12, 224 off10456 00000040:00080000:3.0:1789403555.894998:0:24286:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].13, 88 off10544 00000040:00080000:3.0:1789403555.895042:0:24286:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].14, 128 off10672 00000040:00080000:3.0:1789403555.895064:0:24286:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].15, 144 off10816 00000040:00080000:3.0:1789403555.895080:0:24286:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].16, 160 off10976 00000040:00080000:3.0:1789403555.895096:0:24286:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].17, 224 off11200 00000040:00080000:3.0:1789403555.895112:0:24286:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].18, 224 off11424 00000040:00080000:3.0:1789403555.895128:0:24286:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].19, 80 off11504 00000040:00080000:3.0:1789403555.895141:0:24286:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].20, 224 off11728 00000040:00080000:3.0:1789403555.895154:0:24286:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].21, 224 off11952 00000040:00080000:3.0:1789403555.895171:0:24286:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].22, 88 off12040 00000040:00080000:3.0:1789403555.895189:0:24286:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].23, 128 off12168 00000040:00080000:3.0:1789403555.895209:0:24286:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].24, 144 off12312 00000040:00080000:3.0:1789403555.895226:0:24286:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].25, 160 off12472 00000040:00080000:3.0:1789403555.895244:0:24286:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].26, 224 off12696 00000040:00080000:3.0:1789403555.895263:0:24286:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].27, 224 off12920 00000040:00080000:3.0:1789403555.895283:0:24286:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].28, 80 off13000 00000040:00080000:3.0:1789403555.895305:0:24286:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].29, 224 off13224 00000040:00080000:3.0:1789403555.895338:0:24286:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].30, 224 off13448 00000040:00080000:3.0:1789403555.895360:0:24286:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].31, 88 off13536 00000040:00080000:3.0:1789403555.895377:0:24286:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].32, 128 off13664 00000040:00080000:3.0:1789403555.895420:0:24286:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].33, 144 off13808 00000040:00080000:3.0:1789403555.896711:0:24286:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].34, 128 off13936 00000040:00080000:3.0:1789403555.896735:0:24286:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].35, 224 off14160 00000040:00080000:3.0:1789403555.896755:0:24286:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].36, 224 off14384 00000040:00080000:3.0:1789403555.896773:0:24286:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].37, 80 off14464 00000040:00080000:3.0:1789403555.896790:0:24286:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].38, 224 off14688 00000040:00080000:3.0:1789403555.896808:0:24286:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].39, 224 off14912 00000040:00080000:3.0:1789403555.896827:0:24286:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].40, 88 off15000 00000040:00080000:3.0:1789403555.896845:0:24286:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].41, 128 off15128 00000040:00080000:3.0:1789403555.896864:0:24286:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].42, 144 off15272 00000040:00080000:3.0:1789403555.896879:0:24286:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].43, 128 off15400 00000040:00080000:3.0:1789403555.896894:0:24286:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].44, 224 off15624 00000040:00080000:3.0:1789403555.896906:0:24286:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].45, 224 off15848 00000040:00080000:3.0:1789403555.896942:0:24286:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].46, 80 off15928 00000040:00080000:3.0:1789403555.896959:0:24286:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].47, 224 off16152 00000040:00080000:3.0:1789403555.896977:0:24286:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].48, 232 off16384 00000100:00100000:3.0:1789403555.897043:0:24286:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a1443e6680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7ccb4038-daf9-4dcd-9b85-da9390181204:24286:1876325050848896:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789403555.897110:0:24286:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789403555.897155:0:24286:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a281abe240 going to sleep for 11 seconds 00000100:00100000:3.0:1789403555.897205:0:22781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050848896 00000100:00100000:3.0:1789403555.897211:0:22781:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050848896 00000100:00100000:3.0:1789403555.897255:0:22778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:3.0:1789403555.897263:0:22778:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a26c7fc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7ccb4038-daf9-4dcd-9b85-da9390181204+21:24286:x1876325050848896:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789403555.898753:0:22778:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a26c7fc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7ccb4038-daf9-4dcd-9b85-da9390181204+21:24286:x1876325050848896:12345-0@lo:502:mount.lustre.0 Request processed in 1487us (1639us total) trans 0 rc 0/0 00000100:00100000:3.0:1789403555.898766:0:22778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:2.0:1789403555.899327:0:24286:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a1443e6680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7ccb4038-daf9-4dcd-9b85-da9390181204:24286:1876325050848896:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1789403555.899692:0:24286:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].49, 224 off16608 00000040:00080000:2.0:1789403555.899727:0:24286:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].50, 120 off16728 00000100:00100000:2.0:1789403555.899770:0:24286:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a27a64fb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7ccb4038-daf9-4dcd-9b85-da9390181204:24286:1876325050849024:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1789403555.899821:0:24286:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789403555.899860:0:24286:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a245ca7300 going to sleep for 11 seconds 00000100:00100000:3.0:1789403555.900047:0:22780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050849024 00000100:00100000:3.0:1789403555.900055:0:22780:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050849024 00000100:00100000:3.0:1789403555.900141:0:22780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:3.0:1789403555.900152:0:22780:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a26c7ff850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7ccb4038-daf9-4dcd-9b85-da9390181204+21:24286:x1876325050849024:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789403555.900256:0:22780:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a26c7ff850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7ccb4038-daf9-4dcd-9b85-da9390181204+21:24286:x1876325050849024:12345-0@lo:502:mount.lustre.0 Request processed in 107us (435us total) trans 0 rc 0/0 00000100:00100000:3.0:1789403555.900263:0:22780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:2.0:1789403555.900516:0:24286:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a27a64fb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7ccb4038-daf9-4dcd-9b85-da9390181204:24286:1876325050849024:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1789403555.900563:0:24286:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].51, 224 off16952 00000040:00080000:2.0:1789403555.900572:0:24286:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 51 count 51 00000020:01000004:1.0:1789403555.901306:0:24313:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:1.0:1789403555.901321:0:24313:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff90a27cee99c0) 00000020:00000080:1.0:1789403555.901343:0:24313:0:(obd_config.c:720:class_attach_name()) OBD: dev 23 attached type lwp with refcount 2 00000020:01000004:1.0:1789403555.901774:0:24313:0:(tgt_mount.c:153:server_get_mount()) get mount ffff90a2669be000 from lustre-OST0000, refs=3 00000020:01000004:1.0:1789403555.901779:0:24313:0:(tgt_mount.c:187:server_put_mount()) put mount ffff90a2669be000 from lustre-OST0000, refs=3 00000020:01000004:1.0:1789403555.901782:0:24313:0:(obd_mount.c:710:lustre_put_lsi()) put ffff90a2669be000 3 00010000:00080000:1.0:1789403555.901812:0:24313:0:(ldlm_lib.c:102:import_set_conn()) imp ffff90a1436a2800@lustre-MDT0000-lwp-OST0000: add connection 192.168.203.143@tcp at head 00010000:00010000:1.0:1789403555.903786:0:24313:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-9 is initialized 00000020:00000080:1.0:1789403555.904003:0:24313:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:1.0:1789403555.904050:0:24313:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1789403555.904062:0:24313:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0x5fb08b1e5b7627b1 00000100:00080000:1.0:1789403555.904072:0:24313:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1789403555.904082:0:24313:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff90a1436a2800 using connection 192.168.203.143@tcp/0@lo 00000100:00100000:1.0:1789403555.904115:0:24313:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff90a141aace00 x1876325050849152/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1789403555.904149:0:24313:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00080000:1.0:1789403555.904207:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789403555.904211:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1789403555.904214:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789403555.904216:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1789403555.904235:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789403555.904238:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1789403555.904240:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789403555.904242:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1789403555.904275:0:3629:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a141aac000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3629:1876325050849280:0@lo:400:kworker.0 00000100:00100000:1.0:1789403555.904332:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789403555.904362:0:3629:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789403555.904368:0:3629:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a141aac700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3629:1876325050849664:0@lo:400:kworker.0 00000100:00100000:1.0:1789403555.904416:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789403555.904516:0:3626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a141aaed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3626:1876325050849408:0@lo:400:kworker.0 00000100:00100000:1.0:1789403555.904537:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789403555.904551:0:3626:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789403555.904555:0:3626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a141aad500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3626:1876325050849536:0@lo:400:kworker.0 00000100:00100000:1.0:1789403555.904571:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789403555.904599:0:22791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050849280 00000100:00100000:1.0:1789403555.904606:0:22791:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050849280 00000100:00100000:1.0:1789403555.904632:0:22791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050849536 00000100:00100000:1.0:1789403555.904634:0:22791:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050849536 00000100:00100000:1.0:1789403555.904659:0:22791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1789403555.904666:0:22791:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a141aadf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3629:x1876325050849280:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789403555.904718:0:22791:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a141aadf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3629:x1876325050849280:12345-0@lo:400:kworker.0 Request processed in 52us (385us total) trans 0 rc 0/0 00000100:00100000:1.0:1789403555.904725:0:22791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1789403555.905042:0:22791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1789403555.905051:0:22791:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a141aae680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3626:x1876325050849536:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789403555.905102:0:22791:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a141aae680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3626:x1876325050849536:12345-0@lo:400:kworker.0 Request processed in 53us (529us total) trans 0 rc 0/0 00000100:00100000:1.0:1789403555.905109:0:22791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1789403555.905131:0:22787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050849664 00000100:00100000:1.0:1789403555.905135:0:22787:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050849664 00000100:00100000:1.0:1789403555.905155:0:22787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050849408 00000100:00100000:1.0:1789403555.905158:0:22787:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050849408 00000100:00100000:1.0:1789403555.905170:0:22787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1789403555.905176:0:22787:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a141aafb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3629:x1876325050849664:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789403555.905216:0:22787:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a141aafb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3629:x1876325050849664:12345-0@lo:400:kworker.0 Request processed in 40us (827us total) trans 0 rc 0/0 00000100:00100000:1.0:1789403555.905222:0:22787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1789403555.905234:0:22787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1789403555.905240:0:22787:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a141aae300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3626:x1876325050849408:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789403555.905262:0:22787:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a141aae300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3626:x1876325050849408:12345-0@lo:400:kworker.0 Request processed in 23us (724us total) trans 0 rc 0/0 00000100:00100000:1.0:1789403555.905267:0:22787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1789403555.905304:0:3626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a141aad500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3626:1876325050849536:0@lo:400:kworker.0 00010000:00080000:1.0:1789403555.905316:0:3626:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff90a141aaed80 x1876325050849408/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789403571 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789403555.905333:0:3626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a141aaed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3626:1876325050849408:0@lo:400:kworker.0 00010000:00080000:1.0:1789403555.905362:0:3629:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff90a141aac700 x1876325050849664/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789403571 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789403555.905370:0:3629:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a141aac700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3629:1876325050849664:0@lo:400:kworker.0 00000100:00100000:1.0:1789403555.905378:0:3629:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a141aac000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3629:1876325050849280:0@lo:400:kworker.0 00000100:00100000:2.0:1789403555.905709:0:3625:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a141aace00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3625:1876325050849152:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1789403555.905747:0:3625:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789403555.905828:0:22787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050849152 00000100:00100000:1.0:1789403555.905833:0:22787:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050849152 00000100:00100000:1.0:1789403555.905861:0:22787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1789403555.905865:0:22787:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a27a64fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3625:x1876325050849152:12345-0@lo:38:llog_process_th.0 00010000:00080000:1.0:1789403555.905885:0:22787:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 601 last 0 00000020:00000080:1.0:1789403555.905922:0:22787:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0x5fb08b1e5b7627b8 00000004:00100000:1.0:1789403555.905935:0:22787:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1789403555.905965:0:22787:0:(import.c:65:import_set_state_nolock()) ffff90a1436a1800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1789403555.906003:0:22787:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a27a64fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3625:x1876325050849152:12345-0@lo:38:llog_process_th.0 Request processed in 135us (255us total) trans 0 rc 0/0 00000100:00100000:1.0:1789403555.906009:0:22787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:1.0:1789403555.906059:0:3625:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff90a141aace00 x1876325050849152/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1789403565 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789403555.906068:0:3625:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1789403555.906075:0:3625:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 3 00000100:00080000:1.0:1789403555.906082:0:3625:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:1.0:1789403555.906087:0:3625:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:1.0:1789403555.906089:0:3625:0:(import.c:65:import_set_state_nolock()) ffff90a1436a2800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1789403555.906101:0:3625:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a141aace00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3625:1876325050849152:0@lo:38:llog_process_th.0 00000020:01000004:2.0:1789403555.906745:0:24313:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-lwp-OST0000 (typ=lwp) 00000020:00000080:2.0:1789403555.906775:0:24313:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-lwp-OST0000 (ffff90a2668b0000) 00000020:00000080:2.0:1789403555.906794:0:24313:0:(obd_config.c:720:class_attach_name()) OBD: dev 24 attached type lwp with refcount 2 00000020:01000004:2.0:1789403555.906872:0:24313:0:(tgt_mount.c:153:server_get_mount()) get mount ffff90a2669be000 from lustre-OST0000, refs=3 00000020:01000004:2.0:1789403555.906876:0:24313:0:(tgt_mount.c:187:server_put_mount()) put mount ffff90a2669be000 from lustre-OST0000, refs=3 00000020:01000004:2.0:1789403555.906879:0:24313:0:(obd_mount.c:710:lustre_put_lsi()) put ffff90a2669be000 3 00010000:00080000:2.0:1789403555.906904:0:24313:0:(ldlm_lib.c:102:import_set_conn()) imp ffff90a276e13800@lustre-MDT0001-lwp-OST0000: add connection 192.168.203.143@tcp at head 00010000:00010000:3.0:1789403555.910777:0:24313:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-lwp-OST0000-10 is initialized 00000020:00000080:3.0:1789403555.911021:0:24313:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-lwp-OST0000 (uuid lustre-MDT0001-lwp-OST0000_UUID) 00000010:01000000:3.0:1789403555.911074:0:24313:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1789403555.911088:0:24313:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-lwp-OST0000, cookie 0x5fb08b1e5b7627c6 00000100:00080000:3.0:1789403555.911099:0:24313:0:(import.c:545:import_select_connection()) lustre-MDT0001-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1789403555.911111:0:24313:0:(import.c:666:import_select_connection()) lustre-MDT0001-lwp-OST0000: import ffff90a276e13800 using connection 192.168.203.143@tcp/0@lo 00000100:00100000:3.0:1789403555.911148:0:24313:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff90a1443e7100 x1876325050849792/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1789403555.911177:0:24313:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-lwp-OST0000_UUID->lustre-MDT0001_UUID 00000100:00100000:0.0:1789403555.911196:0:3625:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a1443e7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3625:1876325050849792:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1789403555.911261:0:3625:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789403555.911329:0:22786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050849792 00000100:00100000:0.0:1789403555.911336:0:22786:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050849792 00000100:00100000:0.0:1789403555.911367:0:22786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1789403555.911374:0:22786:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a144bed500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3625:x1876325050849792:12345-0@lo:38:llog_process_th.0 00010000:00080000:0.0:1789403555.911421:0:22786:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0001-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 601 last 0 00000020:00000080:0.0:1789403555.911451:0:22786:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-lwp-OST0000_UUID, cookie 0x5fb08b1e5b7627cd 00000004:00100000:0.0:1789403555.911464:0:22786:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1789403555.911492:0:22786:0:(import.c:65:import_set_state_nolock()) ffff90a1434d7800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1789403555.911542:0:22786:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a144bed500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3625:x1876325050849792:12345-0@lo:38:llog_process_th.0 Request processed in 166us (281us total) trans 0 rc 0/0 00000100:00100000:0.0:1789403555.911551:0:22786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:0.0:1789403555.911973:0:3625:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff90a1443e7100 x1876325050849792/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1789403565 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789403555.911984:0:3625:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1789403555.911992:0:3625:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0001-lwp-OST0000: connect to target with instance 3 00000100:00080000:0.0:1789403555.911998:0:3625:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0001-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:0.0:1789403555.912003:0:3625:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:0.0:1789403555.912005:0:3625:0:(import.c:65:import_set_state_nolock()) ffff90a276e13800 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00080000:1.0:1789403555.912021:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00100000:0.0:1789403555.912021:0:3625:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a1443e7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3625:1876325050849792:0@lo:38:llog_process_th.0 00000100:00080000:1.0:1789403555.912030:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1789403555.912033:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789403555.912036:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1789403555.912040:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789403555.912043:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1789403555.912045:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789403555.912048:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000040:00080000:3.0:1789403555.912794:0:24313:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x10:0x0] index 52 count 51 00000020:01000000:2.0:1789403555.913050:0:24286:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:2.0:1789403555.913083:0:24286:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.143@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1789403555.913131:0:24286:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.143@tcp lock: ffff90a270185600/0x5fb08b1e5b76279c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb08b1e5b7627a3 expref: -99 pid: 24286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403555.913142:0:24286:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.143@tcp lock: ffff90a270185600/0x5fb08b1e5b76279c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb08b1e5b7627a3 expref: -99 pid: 24286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1789403555.913186:0:24286:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1789403555.913189:0:24286:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1789403555.913190:0:24286:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789403555.913192:0:24286:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789403555.913193:0:24286:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789403555.913195:0:24286:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789403555.913196:0:24286:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1789403555.913198:0:24286:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789403555.913199:0:24286:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1789403555.913202:0:24286:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020002 00000020:01000004:2.0:1789403555.913205:0:24286:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1789403555.913207:0:24286:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1789403555.913208:0:24286:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789403555.913209:0:24286:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789403555.913210:0:24286:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789403555.913211:0:24286:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789403555.913213:0:24286:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1789403555.913218:0:24286:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789403555.913219:0:24286:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1789403555.913238:0:24286:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:2.0:1789403555.913255:0:24286:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a27a64d500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7ccb4038-daf9-4dcd-9b85-da9390181204:24286:1876325050849920:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1789403555.913309:0:24286:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789403555.915197:0:22781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050849920 00000100:00100000:0.0:1789403555.915215:0:22781:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050849920 00000100:00100000:2.0:1789403555.915216:0:24286:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a245ca7e40 going to sleep for 11 seconds 00000100:00100000:0.0:1789403555.915334:0:22781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:0.0:1789403555.915345:0:22781:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a26c7ff450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7ccb4038-daf9-4dcd-9b85-da9390181204+21:24286:x1876325050849920:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1789403555.915372:0:22781:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:0.0:1789403555.915384:0:22781:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:1.0:1789403555.920503:0:22781:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:1.0:1789403555.920519:0:22781:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 20000000:01000000:0.0:1789403555.920778:0:22802:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1789403555.920783:0:22802:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1789403555.920804:0:22802:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff90a248af1600/0x5fb08b1e5b7627d4 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 22802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403555.920822:0:22802:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff90a248af1800/0x5fb08b1e5b76271e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5fb08b1e5b762717 expref: 21 pid: 22778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403555.920830:0:22802:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff90a144063600/0x5fb08b1e5b76272c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5fb08b1e5b762725 expref: 21 pid: 22780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403555.920839:0:22802:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff90a248af1600/0x5fb08b1e5b7627d4 lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 22802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403555.920876:0:22802:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff90a144063600/0x5fb08b1e5b76272c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5fb08b1e5b762725 expref: 21 pid: 22780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403555.920891:0:22802:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff90a144063600/0x5fb08b1e5b76272c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5fb08b1e5b762725 expref: 21 pid: 22780 timeout: 701 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789403555.920904:0:22802:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a144bedc00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22802:1876325050850048:0@lo:104: 00000100:00100000:0.0:1789403555.920961:0:22802:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1789403555.921007:0:22802:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff90a248af1800/0x5fb08b1e5b76271e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5fb08b1e5b762717 expref: 21 pid: 22778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403555.921026:0:22802:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff90a248af1800/0x5fb08b1e5b76271e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5fb08b1e5b762717 expref: 21 pid: 22778 timeout: 701 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789403555.921045:0:22802:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a144befb80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22802:1876325050850176:0@lo:104: 00000100:00100000:0.0:1789403555.921073:0:22802:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789403555.921097:0:22802:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a274c8c240 going to sleep for 11 seconds 00000100:00100000:2.0:1789403555.921151:0:22769:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:2.0:1789403555.921168:0:22769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050850048 00000100:00100000:2.0:1789403555.921175:0:22769:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050850048 00000100:00100000:2.0:1789403555.921206:0:22769:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050850176 00000100:00100000:2.0:1789403555.921209:0:22769:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050850176 00000100:00100000:2.0:1789403555.921221:0:22769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1789403555.921229:0:22769:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a144beea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:7ccb4038-daf9-4dcd-9b85-da9390181204+4:22802:x1876325050850048:12345-0@lo:104: 00010000:00010000:2.0:1789403555.921241:0:22769:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.143@tcp lock: ffff90a144063c00/0x5fb08b1e5b762725 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x5fb08b1e5b76272c expref: -99 pid: 22783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789403555.921337:0:22802:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a144bedc00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22802:1876325050850048:0@lo:104: 00000100:00100000:0.0:1789403555.921706:0:22781:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a26c7ff450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7ccb4038-daf9-4dcd-9b85-da9390181204+21:24286:x1876325050849920:12345-0@lo:253:mount.lustre.0 Request processed in 6363us (8395us total) trans 0 rc 0/0 00000100:00100000:0.0:1789403555.921714:0:22781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:1.0:1789403555.921843:0:24286:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a27a64d500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7ccb4038-daf9-4dcd-9b85-da9390181204:24286:1876325050849920:0@lo:253:mount.lustre.0 10000000:01000000:1.0:1789403555.921855:0:24286:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:1.0:1789403555.921858:0:24286:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1789403555.921860:0:24286:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1789403555.921861:0:24286:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1789403555.921863:0:24286:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1789403555.921864:0:24286:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1789403555.921865:0:24286:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1789403555.921866:0:24286:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1789403555.921867:0:24286:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1789403555.921868:0:24286:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:1.0:1789403555.921880:0:24286:0:(tgt_mount.c:2694:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 00000001:00000004:0.0:1789403555.923305:0:24286:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 3, last_transno is 12884901888 00010000:00010000:2.0:1789403555.925116:0:22769:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1789403555.925131:0:22769:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a144beea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:7ccb4038-daf9-4dcd-9b85-da9390181204+4:22802:x1876325050850048:12345-0@lo:104: Request processed in 3898us (4165us total) trans 0 rc 0/0 00000100:00100000:2.0:1789403555.925141:0:22769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00010000:2.0:1789403555.925445:0:22775:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789403555.925453:0:22775:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.143@tcp lock: ffff90a144063c00/0x5fb08b1e5b762725 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x5fb08b1e5b76272c expref: -99 pid: 22783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403555.925463:0:22775:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a144063c00 already unused, calling callback (ffffffffc120dc20) 10000000:00010000:2.0:1789403555.925468:0:22775:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.143@tcp lock: ffff90a144063c00/0x5fb08b1e5b762725 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x5fb08b1e5b76272c expref: -99 pid: 22783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403555.925479:0:22775:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.143@tcp lock: ffff90a144063c00/0x5fb08b1e5b762725 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x5fb08b1e5b76272c expref: -99 pid: 22783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789403555.925498:0:22775:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.143@tcp lock: ffff90a144063c00/0x5fb08b1e5b762725 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x5fb08b1e5b76272c expref: -99 pid: 22783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789403555.925503:0:22775:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1789403555.925539:0:22775:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.143@tcp lock: ffff90a144063c00/0x5fb08b1e5b762725 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5fb08b1e5b76272c expref: -99 pid: 22783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403555.925545:0:22775:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789403555.925560:0:22775:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.143@tcp lock: ffff90a144063c00/0x5fb08b1e5b762725 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5fb08b1e5b76272c expref: -99 pid: 22783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403555.925567:0:22775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.143@tcp lock: ffff90a144063c00/0x5fb08b1e5b762725 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5fb08b1e5b76272c expref: -99 pid: 22783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403555.925578:0:22775:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789403555.925580:0:22775:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789403555.925581:0:22775:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789403555.925673:0:3628:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789403555.925688:0:3628:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a27a64ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7ccb4038-daf9-4dcd-9b85-da9390181204:3628:1876325050850304:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789403555.925755:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789403555.925814:0:22769:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1789403555.925829:0:22769:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a1423cc050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:7ccb4038-daf9-4dcd-9b85-da9390181204+3:22802:x1876325050850176:12345-0@lo:104: 00010000:00010000:3.0:1789403555.925842:0:22769:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.143@tcp lock: ffff90a144063200/0x5fb08b1e5b762717 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x5fb08b1e5b76271e expref: -99 pid: 22783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789403555.925893:0:22771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050850304 00000100:00100000:2.0:1789403555.925902:0:22771:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050850304 00010000:00010000:3.0:1789403555.925918:0:22769:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1789403555.925925:0:22769:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a1423cc050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:7ccb4038-daf9-4dcd-9b85-da9390181204+3:22802:x1876325050850176:12345-0@lo:104: Request processed in 102us (4851us total) trans 0 rc 0/0 00010000:00010000:2.0:1789403555.925928:0:22771:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff90a144063600/0x5fb08b1e5b76272c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5fb08b1e5b762725 expref: 21 pid: 22780 timeout: 701 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789403555.925936:0:22769:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1789403555.925960:0:22771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1789403555.925969:0:22771:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a141aace00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7ccb4038-daf9-4dcd-9b85-da9390181204+21:3628:x1876325050850304:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789403555.925980:0:22771:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789403555.925984:0:22774:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789403555.925986:0:22771:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff90a144063600/0x5fb08b1e5b76272c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5fb08b1e5b762725 expref: 21 pid: 22780 timeout: 701 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403555.925992:0:22774:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.143@tcp lock: ffff90a144063200/0x5fb08b1e5b762717 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x5fb08b1e5b76271e expref: -99 pid: 22783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403555.926001:0:22771:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff90a144063600/0x5fb08b1e5b76272c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5fb08b1e5b762725 expref: 21 pid: 22780 timeout: 701 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403555.926003:0:22774:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a144063200 already unused, calling callback (ffffffffc120dc20) 10000000:00010000:3.0:1789403555.926007:0:22774:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.143@tcp lock: ffff90a144063200/0x5fb08b1e5b762717 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x5fb08b1e5b76271e expref: -99 pid: 22783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403555.926033:0:22774:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.143@tcp lock: ffff90a144063200/0x5fb08b1e5b762717 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x5fb08b1e5b76271e expref: -99 pid: 22783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789403555.926043:0:22774:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.143@tcp lock: ffff90a144063200/0x5fb08b1e5b762717 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x5fb08b1e5b76271e expref: -99 pid: 22783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403555.926046:0:22771:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90a144063600/0x5fb08b1e5b76272c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5fb08b1e5b762725 expref: 21 pid: 22780 timeout: 701 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789403555.926054:0:22774:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1789403555.926069:0:22771:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789403555.926083:0:22774:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.143@tcp lock: ffff90a144063200/0x5fb08b1e5b762717 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5fb08b1e5b76271e expref: -99 pid: 22783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403555.926102:0:22774:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:2.0:1789403555.926107:0:22771:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a141aace00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7ccb4038-daf9-4dcd-9b85-da9390181204+20:3628:x1876325050850304:12345-0@lo:103:ldlm_bl.0 Request processed in 139us (351us total) trans 0 rc 0/0 00000100:00100000:2.0:1789403555.926114:0:22771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00010000:3.0:1789403555.926124:0:22774:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.143@tcp lock: ffff90a144063200/0x5fb08b1e5b762717 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5fb08b1e5b76271e expref: -99 pid: 22783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403555.926132:0:22774:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.143@tcp lock: ffff90a144063200/0x5fb08b1e5b762717 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5fb08b1e5b76271e expref: -99 pid: 22783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403555.926148:0:22774:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789403555.926148:0:3628:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a27a64ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7ccb4038-daf9-4dcd-9b85-da9390181204:3628:1876325050850304:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789403555.926151:0:22774:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789403555.926156:0:22774:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789403555.926165:0:3627:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789403555.926176:0:3627:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a1443e7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7ccb4038-daf9-4dcd-9b85-da9390181204:3627:1876325050850432:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789403555.926222:0:22802:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a144befb80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22802:1876325050850176:0@lo:104: 00000100:00100000:3.0:1789403555.926238:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1789403555.926244:0:22802:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff90a248af1600/0x5fb08b1e5b7627d4 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 22802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789403555.926337:0:23939:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050850432 00000100:00100000:2.0:1789403555.926342:0:23939:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050850432 00010000:00010000:2.0:1789403555.926354:0:23939:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff90a248af1800/0x5fb08b1e5b76271e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5fb08b1e5b762717 expref: 20 pid: 22778 timeout: 701 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789403555.926373:0:23939:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1789403555.926378:0:23939:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a248411850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7ccb4038-daf9-4dcd-9b85-da9390181204+20:3627:x1876325050850432:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789403555.926385:0:23939:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789403555.926422:0:23939:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff90a248af1800/0x5fb08b1e5b76271e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5fb08b1e5b762717 expref: 20 pid: 22778 timeout: 701 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403555.926658:0:23939:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff90a248af1800/0x5fb08b1e5b76271e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5fb08b1e5b762717 expref: 20 pid: 22778 timeout: 701 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403555.926668:0:23939:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90a248af1800/0x5fb08b1e5b76271e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5fb08b1e5b762717 expref: 20 pid: 22778 timeout: 701 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403555.926680:0:23939:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff90a248af1600/0x5fb08b1e5b7627d4 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 22802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403555.926698:0:23939:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90a248af1600/0x5fb08b1e5b7627d4 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 22802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1789403555.926710:0:23939:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.008683331s 00010000:00010000:2.0:1789403555.926715:0:23939:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff90a248af1600/0x5fb08b1e5b7627d4 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 22802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403555.926733:0:23939:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff90a248af1600/0x5fb08b1e5b7627d4 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 22802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403555.926740:0:23939:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff90a248af1600/0x5fb08b1e5b7627d4 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 22802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403555.926746:0:23939:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff90a248af1600/0x5fb08b1e5b7627d4 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 22802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403555.926751:0:23939:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a248af1600 already unused, calling callback (ffffffffc0c0b8b0) 00010000:00010000:2.0:1789403555.926755:0:23939:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff90a248af1600/0x5fb08b1e5b7627d4 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 22802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403555.926762:0:23939:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff90a248af1600/0x5fb08b1e5b7627d4 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 22802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403555.926780:0:23939:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff90a248af1600/0x5fb08b1e5b7627d4 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403555.926790:0:23939:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789403555.926826:0:23939:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a248411850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7ccb4038-daf9-4dcd-9b85-da9390181204+19:3627:x1876325050850432:12345-0@lo:103:ldlm_bl.0 Request processed in 446us (599us total) trans 0 rc 0/0 00000100:00100000:2.0:1789403555.926833:0:23939:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00010000:1.0:1789403555.926969:0:22802:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff90a248af1600/0x5fb08b1e5b7627d4 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403555.926978:0:22802:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff90a248af1600/0x5fb08b1e5b7627d4 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403555.926985:0:22802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90a248af1600/0x5fb08b1e5b7627d4 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789403555.927471:0:3627:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a1443e7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7ccb4038-daf9-4dcd-9b85-da9390181204:3627:1876325050850432:0@lo:103:ldlm_bl.0 00002000:00080000:1.0:1789403555.927710:0:24286:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:1.0:1789403555.927715:0:24286:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:1.0:1789403555.927809:0:24286:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:1.0:1789403555.927844:0:24286:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.143@tcp: cl_mgc_mutex unlock 00000020:01000004:1.0:1789403555.927860:0:24286:0:(tgt_mount.c:2460:server_fill_super_common()) Server sb, dev=49 00000080:00000004:1.0:1789403555.927879:0:24286:0:(super25.c:182:lustre_fill_super()) /dev/mapper/ost1_flakey: Mount complete 00000020:00000004:1.0:1789403555.929687:0:24286:0:(tgt_mount.c:2346:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1789403555.932795:0:24286:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:2.0:1789403556.594494:0:22775:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:3.0:1789403556.893199:0:24365:0:(tgt_mount.c:2346:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1789403556.893458:0:24365:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 10000000:01000000:3.0:1789403557.043526:0:22783:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1789403557.043534:0:22783:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff90a144165800 from 13 10000000:01000000:3.0:1789403557.043540:0:22783:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1789403557.043584:0:22783:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.143@tcp lock: ffff90a259947800/0x5fb08b1e5b7627db lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403557.043595:0:22783:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.143@tcp lock: ffff90a259947800/0x5fb08b1e5b7627db lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403557.043607:0:22783:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.143@tcp lock: ffff90a259947800/0x5fb08b1e5b7627db lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789403557.043632:0:22783:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a1443e7480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7ccb4038-daf9-4dcd-9b85-da9390181204:22783:1876325050850560:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1789403557.043702:0:22783:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789403557.043831:0:22783:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a281abe480 going to sleep for 11 seconds 00000100:00100000:0.0:1789403557.043888:0:22780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050850560 00000100:00100000:0.0:1789403557.043895:0:22780:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050850560 00000100:00100000:0.0:1789403557.043950:0:22780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:0.0:1789403557.043959:0:22780:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a24344e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7ccb4038-daf9-4dcd-9b85-da9390181204+19:22783:x1876325050850560:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789403557.043971:0:22780:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789403557.043984:0:22780:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90a248af1600/0x5fb08b1e5b7627e2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x5fb08b1e5b7627db expref: -99 pid: 22780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403557.044016:0:22780:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90a248af1600/0x5fb08b1e5b7627e2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5fb08b1e5b7627db expref: 20 pid: 22780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403557.044028:0:22780:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90a248af1600/0x5fb08b1e5b7627e2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5fb08b1e5b7627db expref: 20 pid: 22780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403557.044038:0:22780:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a248af1600, rc 0) 00000100:00100000:0.0:1789403557.044087:0:22780:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a24344e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7ccb4038-daf9-4dcd-9b85-da9390181204+20:22783:x1876325050850560:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 129us (384us total) trans 0 rc 0/0 00000100:00100000:0.0:1789403557.044094:0:22780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:1.0:1789403557.044180:0:22783:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a1443e7480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7ccb4038-daf9-4dcd-9b85-da9390181204:22783:1876325050850560:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789403557.044196:0:22783:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.143@tcp lock: ffff90a259947800/0x5fb08b1e5b7627db lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb08b1e5b7627e2 expref: -99 pid: 22783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403557.044204:0:22783:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.143@tcp lock: ffff90a259947800/0x5fb08b1e5b7627db lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x5fb08b1e5b7627e2 expref: -99 pid: 22783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789403557.044255:0:22783:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a141aac000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7ccb4038-daf9-4dcd-9b85-da9390181204:22783:1876325050850688:0@lo:256:ll_cfg_requeue.0 00000100:00100000:1.0:1789403557.044289:0:22783:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789403557.044318:0:22783:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a1441aaa80 going to sleep for 11 seconds 00000100:00100000:0.0:1789403557.044358:0:22781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050850688 00000100:00100000:0.0:1789403557.044363:0:22781:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050850688 00000100:00100000:0.0:1789403557.044417:0:22781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:0.0:1789403557.044424:0:22781:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a24344f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7ccb4038-daf9-4dcd-9b85-da9390181204+20:22783:x1876325050850688:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:0.0:1789403557.044436:0:22781:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1789403557.044452:0:22781:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1789403557.044455:0:22781:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 13 00000100:00100000:0.0:1789403557.044530:0:22781:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a24344f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7ccb4038-daf9-4dcd-9b85-da9390181204+20:22783:x1876325050850688:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 106us (239us total) trans 0 rc 0/0 00000100:00100000:0.0:1789403557.044537:0:22781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:0.0:1789403557.044566:0:22783:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a141aac000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7ccb4038-daf9-4dcd-9b85-da9390181204:22783:1876325050850688:0@lo:256:ll_cfg_requeue.0 10000000:01000000:0.0:1789403557.044620:0:22783:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.143@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1789403557.044626:0:22783:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.143@tcp lock: ffff90a259947800/0x5fb08b1e5b7627db lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb08b1e5b7627e2 expref: -99 pid: 22783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403557.044634:0:22783:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.143@tcp lock: ffff90a259947800/0x5fb08b1e5b7627db lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb08b1e5b7627e2 expref: -99 pid: 22783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789403557.044642:0:22783:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1789403557.044644:0:22783:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff90a144559800 from 13 10000000:01000000:0.0:1789403557.044646:0:22783:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1789403557.044661:0:22783:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.143@tcp lock: ffff90a248af1800/0x5fb08b1e5b7627e9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403557.044668:0:22783:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.143@tcp lock: ffff90a248af1800/0x5fb08b1e5b7627e9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403557.044675:0:22783:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.143@tcp lock: ffff90a248af1800/0x5fb08b1e5b7627e9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789403557.044696:0:22783:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a144bed180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7ccb4038-daf9-4dcd-9b85-da9390181204:22783:1876325050850816:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1789403557.044837:0:22783:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789403557.044864:0:22783:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a247d1b480 going to sleep for 11 seconds 00000100:00100000:1.0:1789403557.044899:0:22781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050850816 00000100:00100000:1.0:1789403557.044904:0:22781:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050850816 00000100:00100000:1.0:1789403557.044932:0:22781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:1.0:1789403557.044939:0:22781:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a24344ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7ccb4038-daf9-4dcd-9b85-da9390181204+20:22783:x1876325050850816:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789403557.044946:0:22781:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789403557.044955:0:22781:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90a144063a00/0x5fb08b1e5b7627f0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x5fb08b1e5b7627e9 expref: -99 pid: 22781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403557.044969:0:22781:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90a144063a00/0x5fb08b1e5b7627f0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5fb08b1e5b7627e9 expref: 21 pid: 22781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403557.044977:0:22781:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90a144063a00/0x5fb08b1e5b7627f0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5fb08b1e5b7627e9 expref: 21 pid: 22781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403557.044984:0:22781:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a144063a00, rc 0) 00000100:00100000:1.0:1789403557.045023:0:22781:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a24344ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7ccb4038-daf9-4dcd-9b85-da9390181204+21:22783:x1876325050850816:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 85us (186us total) trans 0 rc 0/0 00000100:00100000:1.0:1789403557.045029:0:22781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:0.0:1789403557.045144:0:22783:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a144bed180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7ccb4038-daf9-4dcd-9b85-da9390181204:22783:1876325050850816:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789403557.045154:0:22783:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.143@tcp lock: ffff90a248af1800/0x5fb08b1e5b7627e9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb08b1e5b7627f0 expref: -99 pid: 22783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403557.045162:0:22783:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.143@tcp lock: ffff90a248af1800/0x5fb08b1e5b7627e9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x5fb08b1e5b7627f0 expref: -99 pid: 22783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789403557.045192:0:22783:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a144bed180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7ccb4038-daf9-4dcd-9b85-da9390181204:22783:1876325050850944:0@lo:256:ll_cfg_requeue.0 00000100:00100000:0.0:1789403557.045219:0:22783:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789403557.045238:0:22783:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a247d1b480 going to sleep for 11 seconds 00000100:00100000:1.0:1789403557.045277:0:22781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050850944 00000100:00100000:1.0:1789403557.045281:0:22781:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050850944 00000100:00100000:1.0:1789403557.045308:0:22781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:1.0:1789403557.045314:0:22781:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a24344d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7ccb4038-daf9-4dcd-9b85-da9390181204+21:22783:x1876325050850944:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:1.0:1789403557.045324:0:22781:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1789403557.045334:0:22781:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1789403557.045337:0:22781:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 13 00000100:00100000:1.0:1789403557.045427:0:22781:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a24344d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7ccb4038-daf9-4dcd-9b85-da9390181204+21:22783:x1876325050850944:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 112us (207us total) trans 0 rc 0/0 00000100:00100000:1.0:1789403557.045434:0:22781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:0.0:1789403557.045707:0:22783:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a144bed180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7ccb4038-daf9-4dcd-9b85-da9390181204:22783:1876325050850944:0@lo:256:ll_cfg_requeue.0 10000000:01000000:0.0:1789403557.045812:0:22783:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.143@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1789403557.045819:0:22783:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.143@tcp lock: ffff90a248af1800/0x5fb08b1e5b7627e9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb08b1e5b7627f0 expref: -99 pid: 22783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403557.045827:0:22783:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.143@tcp lock: ffff90a248af1800/0x5fb08b1e5b7627e9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb08b1e5b7627f0 expref: -99 pid: 22783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403557.619547:0:22774:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789403558.129810:0:3626:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789403558.129834:0:3626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a144bed180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3626:1876325050851072:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1789403558.129910:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789403558.130111:0:22791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050851072 00000100:00100000:0.0:1789403558.130119:0:22791:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050851072 00000100:00100000:0.0:1789403558.130173:0:22791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1789403558.130191:0:22791:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a141aac700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3626:x1876325050851072:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1789403558.130240:0:22791:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:0.0:1789403558.130291:0:22791:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a141aac700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3626:x1876325050851072:12345-0@lo:41:osp-pre-1-0.0 Request processed in 110us (387us total) trans 0 rc 0/0 00000100:00100000:0.0:1789403558.130299:0:22791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1789403558.130343:0:3626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a144bed180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3626:1876325050851072:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1789403558.138132:0:3628:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a141aaed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3628:1876325050851200:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1789403558.138203:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789403558.138317:0:22791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050851200 00000100:00100000:1.0:1789403558.138324:0:22791:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050851200 00000100:00100000:1.0:1789403558.138371:0:22791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1789403558.138379:0:22791:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a1443e6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3628:x1876325050851200:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1789403558.138551:0:22791:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446309888 avail 1300070400 00000100:00100000:1.0:1789403558.141936:0:22791:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a1443e6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3628:x1876325050851200:12345-0@lo:41:osp-pre-0-1.0 Request processed in 3547us (3722us total) trans 0 rc 0/0 00000100:00100000:1.0:1789403558.141951:0:22791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1789403558.142247:0:3628:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a141aaed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3628:1876325050851200:0@lo:41:osp-pre-0-1.0 00010000:00010000:2.0:1789403558.643220:0:22775:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789403559.667136:0:22774:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789403560.690101:0:22775:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1789403561.212756:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1789403561.212763:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1789403561.212765:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1789403561.212768:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1789403561.212785:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1789403561.212787:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1789403561.212790:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1789403561.212792:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1789403561.212830:0:3626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a144beed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3626:1876325050851456:0@lo:400:kworker.0 00000100:00100000:0.0:1789403561.212895:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789403561.212943:0:3626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a144beea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3626:1876325050851968:0@lo:400:kworker.0 00000100:00100000:0.0:1789403561.212983:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789403561.213010:0:3626:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1789403561.213016:0:3626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a144bec700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3626:1876325050851584:0@lo:400:kworker.0 00000100:00100000:0.0:1789403561.213036:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789403561.213065:0:3626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a144bed880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3626:1876325050852096:0@lo:400:kworker.0 00000100:00100000:0.0:1789403561.213086:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789403561.213130:0:22792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050851456 00000100:00100000:0.0:1789403561.213137:0:22792:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050851456 00000100:00100000:0.0:1789403561.213177:0:22792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1789403561.213185:0:22792:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a1442ed180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3626:x1876325050851456:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789403561.213362:0:3629:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a144bed180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:7ccb4038-daf9-4dcd-9b85-da9390181204:3629:1876325050851328:0@lo:400:kworker.0 00000100:00100000:3.0:1789403561.213429:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789403561.213455:0:3629:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a144bedc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3629:1876325050851840:0@lo:400:kworker.0 00000100:00100000:3.0:1789403561.213478:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789403561.213491:0:3629:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789403561.213496:0:3629:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a144befb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3629:1876325050851712:0@lo:400:kworker.0 00000100:00100000:3.0:1789403561.213516:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789403561.213552:0:22780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050851328 00000100:00100000:3.0:1789403561.213557:0:22780:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050851328 00000100:00100000:3.0:1789403561.213586:0:22780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:3.0:1789403561.213593:0:22780:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a242b64450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7ccb4038-daf9-4dcd-9b85-da9390181204+21:3629:x1876325050851328:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789403561.213632:0:22780:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a242b64450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7ccb4038-daf9-4dcd-9b85-da9390181204+21:3629:x1876325050851328:12345-0@lo:400:kworker.0 Request processed in 40us (202us total) trans 0 rc 0/0 00000100:00100000:3.0:1789403561.213639:0:22780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:3.0:1789403561.213684:0:3629:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a144bed180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:7ccb4038-daf9-4dcd-9b85-da9390181204:3629:1876325050851328:0@lo:400:kworker.0 00000100:00100000:0.0:1789403561.213795:0:22792:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a1442ed180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3626:x1876325050851456:12345-0@lo:400:kworker.0 Request processed in 609us (899us total) trans 0 rc 0/0 00000100:00100000:0.0:1789403561.213803:0:22792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1789403561.213815:0:22792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050851712 00000100:00100000:0.0:1789403561.213818:0:22792:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050851712 00000100:00100000:0.0:1789403561.213835:0:22792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1789403561.213841:0:22792:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a1443e5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3629:x1876325050851712:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789403561.213873:0:22792:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a1443e5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3629:x1876325050851712:12345-0@lo:400:kworker.0 Request processed in 32us (356us total) trans 0 rc 0/0 00000100:00100000:0.0:1789403561.213879:0:22792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1789403561.213899:0:22788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050851968 00000100:00100000:0.0:1789403561.213903:0:22788:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050851968 00000100:00100000:0.0:1789403561.213928:0:22788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050851584 00000100:00100000:0.0:1789403561.213931:0:22788:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050851584 00000100:00100000:0.0:1789403561.213942:0:22788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050852096 00000100:00100000:0.0:1789403561.213944:0:22788:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050852096 00000100:00100000:0.0:1789403561.213956:0:22788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050851840 00000100:00100000:0.0:1789403561.213958:0:22788:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050851840 00000100:00100000:0.0:1789403561.213971:0:22788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1789403561.213987:0:22788:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a1442ed880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3626:x1876325050851968:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789403561.214018:0:22788:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a1442ed880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3626:x1876325050851968:12345-0@lo:400:kworker.0 Request processed in 32us (1044us total) trans 0 rc 0/0 00000100:00100000:0.0:1789403561.214024:0:22788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1789403561.214036:0:22788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1789403561.214042:0:22788:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a1442ece00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3626:x1876325050851584:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789403561.214157:0:3626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a144beed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3626:1876325050851456:0@lo:400:kworker.0 00010000:00080000:3.0:1789403561.214174:0:3626:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90a144beea00 x1876325050851968/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789403577 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789403561.214185:0:3626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a144beea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3626:1876325050851968:0@lo:400:kworker.0 00000100:00100000:3.0:1789403561.214233:0:3629:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a144befb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3629:1876325050851712:0@lo:400:kworker.0 00000100:00100000:0.0:1789403561.214367:0:22788:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a1442ece00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3626:x1876325050851584:12345-0@lo:400:kworker.0 Request processed in 325us (1329us total) trans 0 rc 0/0 00000100:00100000:0.0:1789403561.214374:0:22788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1789403561.214403:0:22788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1789403561.214410:0:22788:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a1442eea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3626:x1876325050852096:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789403561.214441:0:22788:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a1442eea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3626:x1876325050852096:12345-0@lo:400:kworker.0 Request processed in 29us (1351us total) trans 0 rc 0/0 00000100:00100000:0.0:1789403561.214446:0:22788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1789403561.214456:0:22788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1789403561.214462:0:22788:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a1443e4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3629:x1876325050851840:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789403561.214504:0:22788:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a1443e4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3629:x1876325050851840:12345-0@lo:400:kworker.0 Request processed in 42us (1025us total) trans 0 rc 0/0 00000100:00100000:0.0:1789403561.214509:0:22788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00010000:00080000:3.0:1789403561.214846:0:3626:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90a144bec700 x1876325050851584/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789403577 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789403561.214857:0:3626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a144bec700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3626:1876325050851584:0@lo:400:kworker.0 00010000:00080000:3.0:1789403561.214873:0:3626:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90a144bed880 x1876325050852096/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789403577 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789403561.214882:0:3626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a144bed880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3626:1876325050852096:0@lo:400:kworker.0 00010000:00080000:3.0:1789403561.214907:0:3629:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90a144bedc00 x1876325050851840/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789403577 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789403561.214916:0:3629:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a144bedc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3629:1876325050851840:0@lo:400:kworker.0 00000100:00080000:0.0:1789403561.216157:0:22782:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1789403561.216164:0:22782:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000040:00080000:0.0:1789403561.266193:0:22826:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1789403561.713554:0:22774:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1789403562.684255:0:24655:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg343-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:0.0:1789403562.738556:0:22775:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789403563.254927:0:3628:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a27a64e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3628:1876325050852224:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1789403563.255004:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789403563.256664:0:22792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050852224 00000100:00100000:0.0:1789403563.256746:0:22792:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050852224 00000100:00100000:0.0:1789403563.256809:0:22792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1789403563.256820:0:22792:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a27a64c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3628:x1876325050852224:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1789403563.256856:0:22792:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:0.0:1789403563.256936:0:22792:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a27a64c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3628:x1876325050852224:12345-0@lo:41:osp-pre-1-0.0 Request processed in 118us (1931us total) trans 0 rc 0/0 00000100:00100000:0.0:1789403563.256944:0:22792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1789403563.257021:0:3628:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a27a64e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3628:1876325050852224:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1789403563.260424:0:3628:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789403563.260453:0:3628:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a1442ef800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3628:1876325050852352:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1789403563.260529:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789403563.260590:0:22791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050852352 00000100:00100000:2.0:1789403563.260598:0:22791:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050852352 00000100:00100000:2.0:1789403563.260650:0:22791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1789403563.260662:0:22791:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a27a64e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3628:x1876325050852352:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1789403563.260696:0:22791:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446309888 avail 1300070400 00000100:00100000:2.0:1789403563.260743:0:22791:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a27a64e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3628:x1876325050852352:12345-0@lo:41:osp-pre-0-1.0 Request processed in 84us (216us total) trans 0 rc 0/0 00000100:00100000:2.0:1789403563.260749:0:22791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1789403563.260812:0:3628:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a1442ef800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3628:1876325050852352:0@lo:41:osp-pre-0-1.0 00000020:00000004:2.0:1789403563.604339:0:24708:0:(tgt_mount.c:2346:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1789403563.605192:0:24708:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1789403563.762373:0:22774:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1789403564.282554:0:23539:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000020:00000004:3.0:1789403564.462794:0:24758:0:(tgt_mount.c:2346:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1789403564.463032:0:24758:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1789403564.785749:0:22775:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789403565.809582:0:22774:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1789403566.321691:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1789403566.321698:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1789403566.321701:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1789403566.321704:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1789403566.321728:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1789403566.321731:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1789403566.321733:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1789403566.321736:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1789403566.321771:0:3627:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a1442ec700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3627:1876325050852608:0@lo:400:kworker.0 00000100:00100000:0.0:1789403566.321836:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789403566.321886:0:3627:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a1442efb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3627:1876325050853120:0@lo:400:kworker.0 00000100:00100000:0.0:1789403566.321911:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789403566.321946:0:3627:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:0.0:1789403566.321953:0:3627:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a1442ef100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7ccb4038-daf9-4dcd-9b85-da9390181204:3627:1876325050852480:0@lo:400:kworker.0 00000100:00100000:0.0:1789403566.321981:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789403566.322005:0:3627:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a1442edf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3627:1876325050852992:0@lo:400:kworker.0 00000100:00100000:0.0:1789403566.322031:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789403566.322058:0:3628:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a1442ee300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3628:1876325050852736:0@lo:400:kworker.0 00000100:00100000:0.0:1789403566.322080:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789403566.322097:0:3628:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a1442ec380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3628:1876325050853248:0@lo:400:kworker.0 00000100:00100000:0.0:1789403566.322118:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789403566.322130:0:3628:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789403566.322143:0:3628:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a1442ed500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3628:1876325050852864:0@lo:400:kworker.0 00000100:00100000:0.0:1789403566.322164:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789403566.322195:0:22791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050852608 00000100:00100000:0.0:1789403566.322203:0:22791:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050852608 00000100:00100000:0.0:1789403566.322236:0:22791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050852864 00000100:00100000:0.0:1789403566.322239:0:22791:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050852864 00000100:00100000:0.0:1789403566.322253:0:22791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1789403566.322261:0:22791:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a1442ec000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3627:x1876325050852608:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789403566.322313:0:22791:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a1442ec000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3627:x1876325050852608:12345-0@lo:400:kworker.0 Request processed in 52us (476us total) trans 0 rc 0/0 00000100:00100000:0.0:1789403566.322320:0:22791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1789403566.322336:0:22791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1789403566.322342:0:22791:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a1442ee680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3628:x1876325050852864:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789403566.322372:0:22791:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a1442ee680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3628:x1876325050852864:12345-0@lo:400:kworker.0 Request processed in 31us (207us total) trans 0 rc 0/0 00000100:00100000:0.0:1789403566.322378:0:22791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1789403566.322426:0:22788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050853120 00000100:00100000:0.0:1789403566.322430:0:22788:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050853120 00000100:00100000:0.0:1789403566.322456:0:22788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050852992 00000100:00100000:0.0:1789403566.322458:0:22788:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050852992 00000100:00100000:0.0:1789403566.322466:0:22788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050852736 00000100:00100000:0.0:1789403566.322467:0:22788:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050852736 00000100:00100000:0.0:1789403566.322475:0:22788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050853248 00000100:00100000:0.0:1789403566.322477:0:22788:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050853248 00000100:00100000:0.0:1789403566.322490:0:22788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1789403566.322495:0:22788:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a1442edc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3627:x1876325050853120:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789403566.322522:0:22788:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a1442edc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3627:x1876325050853120:12345-0@lo:400:kworker.0 Request processed in 27us (611us total) trans 0 rc 0/0 00000100:00100000:0.0:1789403566.322527:0:22788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1789403566.322545:0:22788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1789403566.322550:0:22788:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a1442ef480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3627:x1876325050852992:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789403566.322575:0:22788:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a1442ef480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3627:x1876325050852992:12345-0@lo:400:kworker.0 Request processed in 25us (550us total) trans 0 rc 0/0 00000100:00100000:0.0:1789403566.322580:0:22788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1789403566.322590:0:22788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1789403566.322595:0:22788:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a1442eed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3628:x1876325050852736:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789403566.322618:0:22788:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a1442eed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3628:x1876325050852736:12345-0@lo:400:kworker.0 Request processed in 22us (537us total) trans 0 rc 0/0 00000100:00100000:0.0:1789403566.322623:0:22788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1789403566.322632:0:22788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1789403566.322638:0:22788:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a1442eca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3628:x1876325050853248:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789403566.322660:0:22788:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a1442eca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3628:x1876325050853248:12345-0@lo:400:kworker.0 Request processed in 23us (541us total) trans 0 rc 0/0 00000100:00100000:0.0:1789403566.322665:0:22788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1789403566.322680:0:22778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050852480 00000100:00100000:0.0:1789403566.322683:0:22778:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050852480 00000100:00100000:0.0:1789403566.322707:0:22778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:0.0:1789403566.322712:0:22778:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a276a74450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7ccb4038-daf9-4dcd-9b85-da9390181204+21:3627:x1876325050852480:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789403566.322740:0:22778:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a276a74450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7ccb4038-daf9-4dcd-9b85-da9390181204+21:3627:x1876325050852480:12345-0@lo:400:kworker.0 Request processed in 28us (758us total) trans 0 rc 0/0 00000100:00100000:0.0:1789403566.322746:0:22778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00080000:0.0:1789403566.322779:0:22782:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1789403566.322783:0:22782:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789403566.322807:0:3628:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a1442ed500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3628:1876325050852864:0@lo:400:kworker.0 00010000:00080000:0.0:1789403566.322819:0:3628:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90a1442ee300 x1876325050852736/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789403582 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789403566.322835:0:3628:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a1442ee300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3628:1876325050852736:0@lo:400:kworker.0 00010000:00080000:0.0:1789403566.322845:0:3628:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90a1442ec380 x1876325050853248/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789403582 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789403566.322852:0:3628:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a1442ec380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3628:1876325050853248:0@lo:400:kworker.0 00000100:00100000:0.0:1789403566.322876:0:3627:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a1442ef100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7ccb4038-daf9-4dcd-9b85-da9390181204:3627:1876325050852480:0@lo:400:kworker.0 00010000:00080000:0.0:1789403566.322884:0:3627:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90a1442edf80 x1876325050852992/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789403582 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789403566.322891:0:3627:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a1442edf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3627:1876325050852992:0@lo:400:kworker.0 00000100:00100000:0.0:1789403566.322899:0:3627:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a1442ec700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3627:1876325050852608:0@lo:400:kworker.0 00010000:00080000:0.0:1789403566.322907:0:3627:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90a1442efb80 x1876325050853120/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789403582 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789403566.322915:0:3627:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a1442efb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3627:1876325050853120:0@lo:400:kworker.0 00010000:00010000:0.0:1789403566.837509:0:22775:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789403567.858227:0:22774:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789403568.177506:0:3625:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789403553/real 1789403553] req@ffff90a144b29500 x1876325050845312/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789403568 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789403568.177542:0:3625:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff90a144b29500 x1876325050845312/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789403568 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789403568.177553:0:3625:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789403553/real 1789403553] req@ffff90a144b28700 x1876325050845440/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789403568 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789403568.177565:0:3625:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff90a144b28700 x1876325050845440/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789403568 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1789403568.177602:0:3625:0:(import.c:65:import_set_state_nolock()) ffff90a14249e000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1789403568.177636:0:3625:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:0.0:1789403568.177641:0:3625:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a144b29500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3625:1876325050845312:0@lo:8:kworker.0 00000100:00080000:0.0:1789403568.177647:0:3625:0:(import.c:65:import_set_state_nolock()) ffff90a26d291800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1789403568.177653:0:3625:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:0.0:1789403568.177656:0:3625:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a144b28700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3625:1876325050845440:0@lo:8:kworker.0 00000100:00080000:1.0:1789403568.177826:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789403568.177831:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1789403568.177833:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789403568.177837:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1789403568.177851:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789403568.177854:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:1.0:1789403568.177857:0:37:0:(import.c:65:import_set_state_nolock()) ffff90a14249e000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1789403568.177862:0:37:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 599 00000100:00080000:1.0:1789403568.177867:0:37:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-MDT0001: tried all connections, increasing latency to 10s 00000100:00080000:1.0:1789403568.177885:0:37:0:(import.c:666:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff90a14249e000 using connection 192.168.203.143@tcp/0@lo 00000100:00100000:1.0:1789403568.177905:0:37:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff90a141aadc00 x1876325050853888/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1789403568.177916:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789403568.177928:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1789403568.177930:0:37:0:(import.c:65:import_set_state_nolock()) ffff90a26d291800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1789403568.177933:0:37:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 599 00000100:00080000:1.0:1789403568.177935:0:37:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 10s 00000100:00080000:1.0:1789403568.177940:0:37:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff90a26d291800 using connection 192.168.203.143@tcp/0@lo 00000100:00100000:1.0:1789403568.177950:0:37:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff90a141aaf800 x1876325050854016/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1789403568.178043:0:3626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a141aaed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3626:1876325050853504:0@lo:400:kworker.0 00000100:00100000:3.0:1789403568.178114:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789403568.178146:0:3626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a144048700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3626:1876325050854272:0@lo:400:kworker.0 00000100:00100000:3.0:1789403568.178170:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789403568.178188:0:3626:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1789403568.178194:0:3626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a141aac000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3626:1876325050853632:0@lo:400:kworker.0 00000100:00100000:3.0:1789403568.178213:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789403568.178227:0:3626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a14404b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3626:1876325050854400:0@lo:400:kworker.0 00000100:00100000:3.0:1789403568.178245:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789403568.178371:0:3628:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a141aace00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3628:1876325050853760:0@lo:400:kworker.0 00000100:00100000:2.0:1789403568.178433:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789403568.178453:0:3628:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1789403568.178458:0:3628:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a141aad500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7ccb4038-daf9-4dcd-9b85-da9390181204:3628:1876325050853376:0@lo:400:kworker.0 00000100:00100000:2.0:1789403568.178481:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789403568.178503:0:3628:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a14404a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3628:1876325050854144:0@lo:400:kworker.0 00000100:00100000:2.0:1789403568.178532:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789403568.178598:0:22792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050853504 00000100:00100000:3.0:1789403568.178612:0:22792:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050853504 00000100:00100000:3.0:1789403568.178648:0:22792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050853760 00000100:00100000:3.0:1789403568.178650:0:22792:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050853760 00000100:00100000:3.0:1789403568.178665:0:22792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1789403568.178673:0:22792:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a1443e4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3626:x1876325050853504:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789403568.178734:0:22792:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a1443e4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3626:x1876325050853504:12345-0@lo:400:kworker.0 Request processed in 61us (629us total) trans 0 rc 0/0 00000100:00100000:3.0:1789403568.178740:0:22792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1789403568.178756:0:22792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1789403568.178761:0:22792:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a27a64ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3628:x1876325050853760:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789403568.178793:0:22792:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a27a64ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3628:x1876325050853760:12345-0@lo:400:kworker.0 Request processed in 31us (359us total) trans 0 rc 0/0 00000100:00100000:3.0:1789403568.178798:0:22792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1789403568.178816:0:22781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050853376 00000100:00100000:3.0:1789403568.178819:0:22781:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050853376 00000100:00100000:3.0:1789403568.178841:0:22781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:3.0:1789403568.178847:0:22781:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a276a75850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7ccb4038-daf9-4dcd-9b85-da9390181204+21:3628:x1876325050853376:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789403568.178874:0:22781:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a276a75850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7ccb4038-daf9-4dcd-9b85-da9390181204+21:3628:x1876325050853376:12345-0@lo:400:kworker.0 Request processed in 27us (391us total) trans 0 rc 0/0 00000100:00100000:3.0:1789403568.178879:0:22781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:3.0:1789403568.178917:0:3628:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a141aad500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7ccb4038-daf9-4dcd-9b85-da9390181204:3628:1876325050853376:0@lo:400:kworker.0 00000100:00100000:3.0:1789403568.178939:0:3628:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a141aace00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3628:1876325050853760:0@lo:400:kworker.0 00000100:00100000:2.0:1789403568.179134:0:3626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a141aaed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3626:1876325050853504:0@lo:400:kworker.0 00000100:00100000:0.0:1789403568.179256:0:22788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050854272 00000100:00100000:0.0:1789403568.179262:0:22788:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050854272 00000100:00100000:0.0:1789403568.179303:0:22788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050853632 00000100:00100000:0.0:1789403568.179306:0:22788:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050853632 00000100:00100000:0.0:1789403568.179316:0:22788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050854400 00000100:00100000:0.0:1789403568.179318:0:22788:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050854400 00000100:00100000:0.0:1789403568.179329:0:22788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050854144 00000100:00100000:0.0:1789403568.179331:0:22788:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050854144 00000100:00100000:0.0:1789403568.179341:0:22788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1789403568.179348:0:22788:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a1443e5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3626:x1876325050854272:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789403568.179420:0:22788:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a1443e5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3626:x1876325050854272:12345-0@lo:400:kworker.0 Request processed in 73us (1249us total) trans 0 rc 0/0 00000100:00100000:0.0:1789403568.179426:0:22788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1789403568.179438:0:22788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1789403568.179444:0:22788:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a1443e7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3626:x1876325050853632:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789403568.179470:0:22788:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a1443e7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3626:x1876325050853632:12345-0@lo:400:kworker.0 Request processed in 27us (1257us total) trans 0 rc 0/0 00000100:00100000:0.0:1789403568.179476:0:22788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1789403568.179487:0:22788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1789403568.179493:0:22788:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a1443e5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3626:x1876325050854400:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789403568.179529:0:22788:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a1443e5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3626:x1876325050854400:12345-0@lo:400:kworker.0 Request processed in 36us (1283us total) trans 0 rc 0/0 00000100:00100000:0.0:1789403568.179535:0:22788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1789403568.179546:0:22788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1789403568.179552:0:22788:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a27a64f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3628:x1876325050854144:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789403568.179580:0:22788:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a27a64f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3628:x1876325050854144:12345-0@lo:400:kworker.0 Request processed in 28us (1047us total) trans 0 rc 0/0 00000100:00100000:0.0:1789403568.179586:0:22788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1789403568.179617:0:3625:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a141aadc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3625:1876325050853888:0@lo:8:kworker.0 00010000:00080000:1.0:1789403568.179728:0:3628:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90a14404a680 x1876325050854144/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789403584 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789403568.179739:0:3628:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a14404a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3628:1876325050854144:0@lo:400:kworker.0 00000100:00080000:2.0:1789403568.179800:0:22782:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1789403568.179805:0:22782:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789403568.179853:0:3625:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789403568.179930:0:3625:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a141aaf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3625:1876325050854016:0@lo:8:kworker.0 00000100:00100000:0.0:1789403568.179952:0:3625:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:3.0:1789403568.179999:0:3626:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90a141aac000 x1876325050853632/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789403584 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789403568.180010:0:3626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a141aac000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3626:1876325050853632:0@lo:400:kworker.0 00010000:00080000:3.0:1789403568.180034:0:3626:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90a14404b800 x1876325050854400/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789403584 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789403568.180042:0:3626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a14404b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3626:1876325050854400:0@lo:400:kworker.0 00010000:00080000:3.0:1789403568.180053:0:3626:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90a144048700 x1876325050854272/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789403584 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789403568.180060:0:3626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a144048700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3626:1876325050854272:0@lo:400:kworker.0 00000100:00100000:1.0:1789403568.182947:0:24290:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050853888 00000100:00100000:1.0:1789403568.182962:0:24290:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050853888 00000100:00100000:1.0:1789403568.184766:0:24290:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050854016 00000100:00100000:1.0:1789403568.184779:0:24290:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050854016 00000100:00100000:3.0:1789403568.184806:0:24293:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1789403568.184818:0:24293:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a1442efb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3625:x1876325050853888:12345-0@lo:8:kworker.0 00010000:00080000:3.0:1789403568.184852:0:24293:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 614 last 0 00000020:00000080:3.0:1789403568.184893:0:24293:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x5fb08b1e5b7627f7 00002000:00100000:3.0:1789403568.184909:0:24293:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0001-mdtlov_UUID/ffff90a281b15000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a27 ocd_grant: 0 ocd_index: 0 ocd_group 1 00002000:00080000:3.0:1789403568.184914:0:24293:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 1 00002000:00100000:3.0:1789403568.184917:0:24293:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:3.0:1789403568.185087:0:24293:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 1 00000100:00080000:3.0:1789403568.185125:0:24293:0:(import.c:65:import_set_state_nolock()) ffff90a281b14800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1789403568.185201:0:24293:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a1442efb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+6:3625:x1876325050853888:12345-0@lo:8:kworker.0 Request processed in 384us (5347us total) trans 0 rc 0/0 00000100:00100000:3.0:1789403568.185209:0:24293:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1789403568.185226:0:24293:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1789403568.185230:0:24293:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a1442ec700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3625:x1876325050854016:12345-0@lo:8:kworker.0 00010000:00020000:3.0:1789403568.185241:0:24293:0:(ldlm_lib.c:1199:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00010000:00080000:0.0:1789403568.188440:0:3625:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90a141aadc00 x1876325050853888/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/416 e 0 to 0 dl 1789403588 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789403568.188455:0:3625:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:0.0:1789403568.188465:0:3625:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0001: connect to target with instance 3 00000100:00080000:0.0:1789403568.188473:0:3625:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0001: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:0.0:1789403568.188478:0:3625:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:0.0:1789403568.188481:0:3625:0:(import.c:65:import_set_state_nolock()) ffff90a14249e000 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:0.0:1789403568.188511:0:3625:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:0.0:1789403568.188517:0:3625:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a141aadc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3625:1876325050853888:0@lo:8:kworker.0 00000004:00080000:0.0:1789403568.188567:0:23527:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:0.0:1789403568.188655:0:23527:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 614187266048ns, next at 0ns, rc = 0 00080000:00080000:0.0:1789403568.188662:0:23527:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0001: async commit OSD 00000004:00080000:1.0:1789403568.190260:0:23528:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0001: going to cleanup orphans since [0x280000400:0x1:0x0] 00000100:00100000:1.0:1789403568.190289:0:23528:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a144048a80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:23528:1876325050854656:0@lo:7:osp-pre-0-1.0 00000100:00100000:1.0:1789403568.190352:0:23528:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789403568.190378:0:23528:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a281abe540 going to sleep for 11 seconds 00000100:00100000:1.0:1789403568.190424:0:24290:0:(service.c:3467:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:1.0:1789403568.190431:0:24290:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost00_003' 00000100:00100000:2.0:1789403568.190490:0:3629:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1789403568.190502:0:3629:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a14404a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3629:1876325050854528:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1789403568.190533:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789403568.191216:0:24294:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050854528 00000100:00100000:1.0:1789403568.191224:0:24294:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050854528 00000100:00100000:1.0:1789403568.191295:0:24294:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1789403568.191304:0:24294:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a27a64ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3629:x1876325050854528:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1789403568.191331:0:24294:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3915849728 avail 3684327424 00000100:00100000:1.0:1789403568.191384:0:24294:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a27a64ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3629:x1876325050854528:12345-0@lo:13:osp-pre-0-1.0 Request processed in 82us (850us total) trans 0 rc 0/0 00000100:00100000:1.0:1789403568.191415:0:24294:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:1.0:1789403568.191453:0:3629:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90a14404a680 x1876325050854528/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789403584 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789403568.191472:0:3629:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a14404a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3629:1876325050854528:0@lo:13:osp-pre-0-1.0 00000100:00080000:2.0:1789403568.191548:0:22782:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789403568.193915:0:24290:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050854656 00000100:00100000:0.0:1789403568.193947:0:24290:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050854656 00000100:00100000:1.0:1789403568.194312:0:24926:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1789403568.194324:0:24926:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a144048380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:23528:x1876325050854656:12345-0@lo:7:osp-pre-0-1.0 00000004:00080000:0.0:1789403568.195250:0:23519:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 1 committed 00002000:00080000:1.0:1789403568.199245:0:24926:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x280000400 00002000:00080000:1.0:1789403568.199255:0:24926:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0000: LAST FID is [0x280000400:0x41:0x0] 00000100:00100000:1.0:1789403568.199431:0:24926:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a144048380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:23528:x1876325050854656:12345-0@lo:7:osp-pre-0-1.0 Request processed in 5106us (9075us total) trans 0 rc 0/0 00000100:00100000:1.0:1789403568.199442:0:24926:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:2.0:1789403568.202521:0:23528:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90a144048a80 x1876325050854656/t0(0) o7->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 264/240 e 0 to 0 dl 1789403584 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789403568.202538:0:23528:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a144048a80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:23528:1876325050854656:0@lo:7:osp-pre-0-1.0 00000004:00080000:2.0:1789403568.202553:0:23528:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0000-osc-MDT0001: Got last_fid [0x280000400:0x41:0x0] 00000100:00100000:2.0:1789403568.202595:0:23528:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a27a64d880 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:23528:1876325050854784:0@lo:5:osp-pre-0-1.0 00000100:00100000:2.0:1789403568.202979:0:23528:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789403568.203013:0:23528:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a274cd2f00 going to sleep for 11 seconds 00000100:00100000:0.0:1789403568.203078:0:24290:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050854784 00000100:00100000:0.0:1789403568.203086:0:24290:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050854784 00000100:00100000:0.0:1789403568.203202:0:24290:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1789403568.203212:0:24290:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a27a64d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:23528:x1876325050854784:12345-0@lo:5:osp-pre-0-1.0 00002000:00080000:0.0:1789403568.203241:0:24290:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 65 -> diff = 0 00000100:00100000:0.0:1789403568.204255:0:24290:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a27a64d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:23528:x1876325050854784:12345-0@lo:5:osp-pre-0-1.0 Request processed in 1043us (1274us total) trans 0 rc 0/0 00000100:00100000:0.0:1789403568.204265:0:24290:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1789403568.204477:0:24293:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a1442ec700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3625:x1876325050854016:12345-0@lo:8:kworker.0 Request processed in 19244us (24522us total) trans 0 rc -19/-19 00000100:00100000:3.0:1789403568.204496:0:24293:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00080000:0.0:1789403568.204645:0:3625:0:(import.c:65:import_set_state_nolock()) ffff90a26d291800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1789403568.204650:0:3625:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1789403568.204654:0:3625:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a141aaf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3625:1876325050854016:0@lo:8:kworker.0 00010000:00080000:1.0:1789403568.204808:0:23528:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90a27a64d880 x1876325050854784/t0(0) o5->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1789403584 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789403568.204822:0:23528:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a27a64d880 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:23528:1876325050854784:0@lo:5:osp-pre-0-1.0 00000004:00080000:1.0:1789403568.204833:0:23528:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0001: Got last_id [0x280000400:0x41:0x0] from OST, last_created [0x280000400:0x41:0x0]last_used is [0x280000400:0x41:0x0] 00000100:00100000:1.0:1789403568.205025:0:23528:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a14404a680 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:23528:1876325050854912:0@lo:5:osp-pre-0-1.0 00000100:00100000:1.0:1789403568.205062:0:23528:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789403568.205138:0:23528:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a281abe840 going to sleep for 11 seconds 00000100:00100000:0.0:1789403568.211429:0:24926:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050854912 00000100:00100000:0.0:1789403568.211445:0:24926:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050854912 00000100:00100000:0.0:1789403568.211504:0:24926:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1789403568.211514:0:24926:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a14404b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:23528:x1876325050854912:12345-0@lo:5:osp-pre-0-1.0 00002000:00080000:0.0:1789403568.211558:0:24926:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000400 at 66 00000001:00080000:0.0:1789403568.258430:0:24287:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 12884901889 is committed 00000001:00100000:0.0:1789403568.258447:0:24287:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000100:00100000:0.0:1789403568.258586:0:24926:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a14404b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:23528:x1876325050854912:12345-0@lo:5:osp-pre-0-1.0 Request processed in 47071us (53520us total) trans 12884901889 rc 0/0 00000100:00100000:0.0:1789403568.258595:0:24926:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:1.0:1789403568.258962:0:23528:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90a14404a680 x1876325050854912/t0(0) o5->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1789403584 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789403568.258987:0:23528:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 12884901889 gen 2 00000100:00100000:1.0:1789403568.258994:0:23528:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a14404a680 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:23528:1876325050854912:0@lo:5:osp-pre-0-1.0 00000004:00080000:1.0:1789403568.259010:0:23528:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0001: current precreated pool: [0x280000400:0x41:0x0]-[0x280000400:0x61:0x0] 00000100:00100000:1.0:1789403568.259059:0:23528:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a14404a680 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0000-lwp-MDT0001_UUID:23528:1876325050855040:0@lo:900:osp-pre-0-1.0 00000100:00100000:1.0:1789403568.259094:0:23528:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789403568.259112:0:23528:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a261643480 going to sleep for 11 seconds 00000100:00100000:0.0:1789403568.259270:0:22798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050855040 00000100:00100000:0.0:1789403568.259276:0:22798:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050855040 00000100:00100000:0.0:1789403568.259318:0:22798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1789403568.259327:0:22798:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a14404aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:23528:x1876325050855040:12345-0@lo:900:osp-pre-0-1.0 00000100:00100000:0.0:1789403568.259372:0:22798:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a14404aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:23528:x1876325050855040:12345-0@lo:900:osp-pre-0-1.0 Request processed in 46us (277us total) trans 0 rc 0/0 00000100:00100000:0.0:1789403568.259386:0:22798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:1.0:1789403568.259496:0:23528:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90a14404a680 x1876325050855040/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1789403584 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789403568.259506:0:23528:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a14404a680 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0000-lwp-MDT0001_UUID:23528:1876325050855040:0@lo:900:osp-pre-0-1.0 00000100:00100000:2.0:1789403568.369850:0:3628:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789403568.369871:0:3628:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a27a64d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3628:1876325050855168:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1789403568.369952:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789403568.370011:0:22792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050855168 00000100:00100000:2.0:1789403568.370019:0:22792:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050855168 00000100:00100000:2.0:1789403568.370064:0:22792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1789403568.370072:0:22792:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a281910700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3628:x1876325050855168:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1789403568.370118:0:22792:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:2.0:1789403568.370161:0:22792:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a281910700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3628:x1876325050855168:12345-0@lo:41:osp-pre-1-0.0 Request processed in 90us (210us total) trans 0 rc 0/0 00000100:00100000:2.0:1789403568.370168:0:22792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1789403568.370299:0:3626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a14404a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3626:1876325050855296:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1789403568.370329:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789403568.370360:0:22791:0:(service.c:3467:ptlrpc_start_thread()) mdt_out[0] started 2 min 2 max 116 00000100:00100000:1.0:1789403568.370368:0:22791:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt_out00_002' 00000100:00100000:1.0:1789403568.370501:0:22791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050855296 00000100:00100000:1.0:1789403568.370506:0:22791:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050855296 00000100:00100000:2.0:1789403568.370668:0:3628:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a27a64d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3628:1876325050855168:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1789403568.381858:0:22791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1789403568.381878:0:22791:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a14404bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3626:x1876325050855296:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1789403568.381930:0:22791:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446309888 avail 1300070400 00000100:00100000:1.0:1789403568.382023:0:22791:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a14404bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3626:x1876325050855296:12345-0@lo:41:osp-pre-0-1.0 Request processed in 152us (11692us total) trans 0 rc 0/0 00000100:00100000:1.0:1789403568.382030:0:22791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1789403568.382087:0:3626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a14404a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3626:1876325050855296:0@lo:41:osp-pre-0-1.0 00010000:00010000:0.0:1789403568.881688:0:22775:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789403569.907723:0:22774:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789403570.932303:0:22775:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1789403571.507580:0:22826:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000020:01000004:0.0:1789403571.697210:0:25105:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:0.0:1789403571.697214:0:25105:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/ost2_flakey 00000020:01000004:0.0:1789403571.697215:0:25105:0:(obd_mount.c:929:lmd_print()) options: errors=remount-ro 00000080:01200004:0.0:1789403571.697328:0:25105:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff90a276eb8800 00000020:01000004:0.0:1789403571.697343:0:25105:0:(tgt_mount.c:2502:osd_start()) Attempting to start lustre-OST0001, type=osd-ldiskfs, lsifl=200002, mountfl=0 00000020:01000004:0.0:1789403571.697356:0:25105:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-ldiskfs) 00000020:00000080:0.0:1789403571.697370:0:25105:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffff90a1425d3380) 00000020:00000080:0.0:1789403571.698797:0:25105:0:(obd_config.c:720:class_attach_name()) OBD: dev 25 attached type osd-ldiskfs with refcount 2 00100000:10000000:2.0:1789403571.798302:0:25105:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:2.0:1789403571.799136:0:25105:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000003:0x4:0x0] (8/32) registered 00100000:10000000:2.0:1789403571.806012:0:25105:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:2.0:1789403571.808730:0:25105:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000003:0x5:0x0] (8/32) registered 00100000:10000000:2.0:1789403571.809691:0:25105:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:2.0:1789403571.810440:0:25105:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:2.0:1789403571.811827:0:25105:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/32) registered 00080000:01000000:3.0:1789403571.816969:0:25105:0:(osd_lproc.c:911:osd_procfs_init()) lustre-OST0001: register osd-ldiskfs tunable parameters 00000020:00000080:3.0:1789403571.817188:0:25105:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:3.0:1789403571.817203:0:25105:0:(osd_handler.c:8924:osd_obd_connect()) connect #0 00000020:00000080:3.0:1789403571.817214:0:25105:0:(genops.c:1384:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x5fb08b1e5b762805 00000020:01000004:3.0:1789403571.817222:0:25105:0:(tgt_mount.c:2587:server_fill_super()) Found service lustre-OST0001 on device /dev/mapper/ost2_flakey 00000020:01000004:3.0:1789403571.817245:0:25105:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.203.143@tcp:Set MGC reconnect 1 10000000:01000000:3.0:1789403571.817248:0:25105:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.203.143@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:3.0:1789403571.817254:0:25105:0:(tgt_mount.c:1808:server_start_targets()) starting target lustre-OST0001 00000020:01000004:3.0:1789403571.817283:0:25105:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/ost2_flakey 10000000:01000000:3.0:1789403571.817287:0:25105:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.143@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00000040:01000000:3.0:1789403571.832838:0:25105:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.143@tcp ctxt 0 is initialized 00000020:01000004:3.0:1789403571.832881:0:25105:0:(tgt_mount.c:1416:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.203.143@tcp, index=0001, flags=0x20002 00000020:01000004:3.0:1789403571.832886:0:25105:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:3.0:1789403571.832888:0:25105:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1789403571.832889:0:25105:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789403571.832899:0:25105:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1789403571.832901:0:25105:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789403571.832903:0:25105:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789403571.832904:0:25105:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1789403571.832906:0:25105:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789403571.832907:0:25105:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1789403571.832911:0:25105:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020002 00000020:01000004:3.0:1789403571.832913:0:25105:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1789403571.832914:0:25105:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1789403571.832915:0:25105:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789403571.832916:0:25105:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1789403571.832917:0:25105:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789403571.832918:0:25105:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789403571.832919:0:25105:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1789403571.832920:0:25105:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789403571.832921:0:25105:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1789403571.832948:0:25105:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:3.0:1789403571.832969:0:25105:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a1443e6300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7ccb4038-daf9-4dcd-9b85-da9390181204:25105:1876325050855424:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1789403571.833054:0:25105:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789403571.833154:0:25105:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a25ecdf780 going to sleep for 11 seconds 00000100:00100000:0.0:1789403571.833963:0:22780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050855424 00000100:00100000:0.0:1789403571.833975:0:22780:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050855424 00000100:00100000:0.0:1789403571.834153:0:22780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:0.0:1789403571.834165:0:22780:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a276a76450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7ccb4038-daf9-4dcd-9b85-da9390181204+21:25105:x1876325050855424:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1789403571.834200:0:22780:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:0.0:1789403571.834203:0:22780:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0001 is running on 0@lo 20000000:01000000:0.0:1789403571.834207:0:22780:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:0.0:1789403571.835561:0:22780:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a276a76450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7ccb4038-daf9-4dcd-9b85-da9390181204+21:25105:x1876325050855424:12345-0@lo:253:mount.lustre.0 Request processed in 1392us (2500us total) trans 0 rc 0/0 00000100:00100000:0.0:1789403571.835576:0:22780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:3.0:1789403571.835955:0:25105:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a1443e6300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7ccb4038-daf9-4dcd-9b85-da9390181204:25105:1876325050855424:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1789403571.835968:0:25105:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:3.0:1789403571.835972:0:25105:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1789403571.835973:0:25105:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1789403571.835975:0:25105:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789403571.835976:0:25105:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1789403571.835977:0:25105:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789403571.836048:0:25105:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789403571.836050:0:25105:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1789403571.836051:0:25105:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789403571.836053:0:25105:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:3.0:1789403571.836073:0:25105:0:(tgt_mount.c:101:server_register_mount()) register mount ffff90a276eb8800 from lustre-OST0001 10000000:01000000:3.0:1789403571.836106:0:25105:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:3.0:1789403571.836110:0:25105:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:3.0:1789403571.836118:0:25105:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff90a27e00b380 local copy 00010000:00010000:3.0:1789403571.836128:0:25105:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.143@tcp lock: ffff90a144063400/0x5fb08b1e5b76251f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb08b1e5b762526 expref: -99 pid: 22765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789403571.836221:0:25105:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a1443e6300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7ccb4038-daf9-4dcd-9b85-da9390181204:25105:1876325050855552:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789403571.836267:0:25105:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789403571.836305:0:25105:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a25ecdfcc0 going to sleep for 11 seconds 00000100:00100000:0.0:1789403571.836671:0:22778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050855552 00000100:00100000:0.0:1789403571.836679:0:22778:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050855552 00000100:00100000:0.0:1789403571.836720:0:22778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:0.0:1789403571.836728:0:22778:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a276a74050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7ccb4038-daf9-4dcd-9b85-da9390181204+21:25105:x1876325050855552:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789403571.836830:0:22778:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a276a74050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7ccb4038-daf9-4dcd-9b85-da9390181204+21:25105:x1876325050855552:12345-0@lo:501:mount.lustre.0 Request processed in 101us (563us total) trans 0 rc -2/-2 00000100:00100000:0.0:1789403571.836862:0:22778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:1.0:1789403571.837069:0:25105:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a1443e6300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7ccb4038-daf9-4dcd-9b85-da9390181204:25105:1876325050855552:0@lo:501:mount.lustre.0 10000000:01000000:1.0:1789403571.837092:0:25105:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.203.143@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:1.0:1789403571.837119:0:25105:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.203.143@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:1.0:1789403571.837126:0:25105:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.143@tcp lock: ffff90a144063400/0x5fb08b1e5b76251f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb08b1e5b762526 expref: -99 pid: 22765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403571.837134:0:25105:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.143@tcp lock: ffff90a144063400/0x5fb08b1e5b76251f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb08b1e5b762526 expref: -99 pid: 22765 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789403571.837161:0:25105:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff90a276eb8800 10000000:01000000:1.0:1789403571.837166:0:25105:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:1.0:1789403571.837171:0:25105:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:1.0:1789403571.837174:0:25105:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1789403571.837178:0:25105:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:1.0:1789403571.837181:0:25105:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:1.0:1789403571.837205:0:25105:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.143@tcp lock: ffff90a144062a00/0x5fb08b1e5b76280c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 25105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403571.837213:0:25105:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.143@tcp lock: ffff90a144062a00/0x5fb08b1e5b76280c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 25105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403571.837222:0:25105:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.143@tcp lock: ffff90a144062a00/0x5fb08b1e5b76280c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 25105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789403571.837244:0:25105:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a14404a680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7ccb4038-daf9-4dcd-9b85-da9390181204:25105:1876325050855680:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1789403571.837279:0:25105:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789403571.837328:0:22780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050855680 00000100:00100000:0.0:1789403571.837334:0:22780:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050855680 00000100:00100000:1.0:1789403571.837354:0:25105:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a1426050c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789403571.837376:0:22780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:0.0:1789403571.837384:0:22780:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a276a76050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7ccb4038-daf9-4dcd-9b85-da9390181204+21:25105:x1876325050855680:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1789403571.837411:0:22780:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789403571.837424:0:22780:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90a248af0800/0x5fb08b1e5b762813 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x5fb08b1e5b76280c expref: -99 pid: 22780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403571.837447:0:22780:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90a248af0800/0x5fb08b1e5b762813 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5fb08b1e5b76280c expref: 22 pid: 22780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403571.837457:0:22780:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90a248af0800/0x5fb08b1e5b762813 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5fb08b1e5b76280c expref: 22 pid: 22780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403571.837465:0:22780:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a248af0800, rc 0) 00000100:00100000:0.0:1789403571.837510:0:22780:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a276a76050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7ccb4038-daf9-4dcd-9b85-da9390181204+22:25105:x1876325050855680:12345-0@lo:101:mount.lustre.0 Request processed in 127us (231us total) trans 0 rc 0/0 00000100:00100000:0.0:1789403571.837516:0:22780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:1.0:1789403571.839286:0:25105:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a14404a680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7ccb4038-daf9-4dcd-9b85-da9390181204:25105:1876325050855680:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1789403571.839310:0:25105:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.143@tcp lock: ffff90a144062a00/0x5fb08b1e5b76280c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb08b1e5b762813 expref: -99 pid: 25105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403571.839336:0:25105:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.143@tcp lock: ffff90a144062a00/0x5fb08b1e5b76280c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x5fb08b1e5b762813 expref: -99 pid: 25105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1789403571.841145:0:25105:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 11 count 11 00000040:00080000:1.0:1789403571.842873:0:25105:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1789403571.846429:0:25105:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].1, 224 off8416 00000040:00080000:1.0:1789403571.846488:0:25105:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].2, 128 off8544 00000040:00080000:1.0:1789403571.846502:0:25105:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].3, 112 off8656 00000040:00080000:1.0:1789403571.846516:0:25105:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].4, 224 off8880 00000040:00080000:1.0:1789403571.846530:0:25105:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].5, 224 off9104 00000040:00080000:1.0:1789403571.846543:0:25105:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].6, 80 off9184 00000040:00080000:1.0:1789403571.846556:0:25105:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].7, 224 off9408 00000040:00080000:1.0:1789403571.846572:0:25105:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].8, 224 off9632 00000040:00080000:1.0:1789403571.846586:0:25105:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].9, 120 off9752 00000040:00080000:1.0:1789403571.846610:0:25105:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].10, 224 off9976 00000040:00080000:1.0:1789403571.846616:0:25105:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 10 count 11 00000100:00100000:1.0:1789403571.846732:0:25105:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a14404a680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7ccb4038-daf9-4dcd-9b85-da9390181204:25105:1876325050855808:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789403571.846800:0:25105:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789403571.847441:0:25105:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a141b509c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789403571.854060:0:22780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050855808 00000100:00100000:0.0:1789403571.854074:0:22780:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050855808 00000100:00100000:0.0:1789403571.854182:0:22780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:0.0:1789403571.854193:0:22780:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a276a77c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7ccb4038-daf9-4dcd-9b85-da9390181204+22:25105:x1876325050855808:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789403571.854417:0:22780:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a276a77c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7ccb4038-daf9-4dcd-9b85-da9390181204+22:25105:x1876325050855808:12345-0@lo:501:mount.lustre.0 Request processed in 225us (7616us total) trans 0 rc 0/0 00000100:00100000:0.0:1789403571.854424:0:22780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:3.0:1789403571.854524:0:25105:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a14404a680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7ccb4038-daf9-4dcd-9b85-da9390181204:25105:1876325050855808:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789403571.854584:0:25105:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a1443e4e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7ccb4038-daf9-4dcd-9b85-da9390181204:25105:1876325050855936:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1789403571.854637:0:25105:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789403571.854664:0:22778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050855936 00000100:00100000:2.0:1789403571.854671:0:22778:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050855936 00000100:00100000:3.0:1789403571.854680:0:25105:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a25ecdf300 going to sleep for 11 seconds 00000100:00100000:2.0:1789403571.854700:0:22778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:2.0:1789403571.854708:0:22778:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a276a76850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7ccb4038-daf9-4dcd-9b85-da9390181204+22:25105:x1876325050855936:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1789403571.857693:0:22778:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a276a76850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7ccb4038-daf9-4dcd-9b85-da9390181204+22:25105:x1876325050855936:12345-0@lo:503:mount.lustre.0 Request processed in 2973us (3043us total) trans 0 rc 0/0 00000100:00100000:2.0:1789403571.857707:0:22778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:3.0:1789403571.857745:0:25105:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a1443e4e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7ccb4038-daf9-4dcd-9b85-da9390181204:25105:1876325050855936:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1789403571.860972:0:25105:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1789403571.861089:0:25105:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a281913b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7ccb4038-daf9-4dcd-9b85-da9390181204:25105:1876325050856064:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1789403571.861162:0:25105:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789403571.861216:0:25105:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a1426050c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789403571.861296:0:22780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050856064 00000100:00100000:0.0:1789403571.861311:0:22780:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050856064 00000100:00100000:0.0:1789403571.861364:0:22780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:0.0:1789403571.861374:0:22780:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a276a74c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7ccb4038-daf9-4dcd-9b85-da9390181204+22:25105:x1876325050856064:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1789403571.863030:0:22780:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a276a74c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7ccb4038-daf9-4dcd-9b85-da9390181204+22:25105:x1876325050856064:12345-0@lo:502:mount.lustre.0 Request processed in 1651us (1860us total) trans 0 rc 0/0 00000100:00100000:0.0:1789403571.863042:0:22780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:2.0:1789403571.863196:0:25105:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a281913b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7ccb4038-daf9-4dcd-9b85-da9390181204:25105:1876325050856064:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1789403571.863487:0:25105:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].1, 224 off8416 00000040:00080000:2.0:1789403571.864216:0:25105:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].2, 128 off8544 00000040:00080000:2.0:1789403571.864236:0:25105:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].3, 112 off8656 00000040:00080000:2.0:1789403571.864252:0:25105:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].4, 224 off8880 00000040:00080000:2.0:1789403571.864266:0:25105:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].5, 224 off9104 00000040:00080000:2.0:1789403571.864279:0:25105:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].6, 80 off9184 00000040:00080000:2.0:1789403571.864291:0:25105:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].7, 224 off9408 00000040:00080000:2.0:1789403571.864317:0:25105:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].8, 224 off9632 00000040:00080000:2.0:1789403571.864332:0:25105:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].9, 120 off9752 00000100:00100000:2.0:1789403571.864373:0:25105:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a281913b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7ccb4038-daf9-4dcd-9b85-da9390181204:25105:1876325050856192:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1789403571.865878:0:25105:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789403571.865936:0:25105:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a243e06840 going to sleep for 11 seconds 00000100:00100000:3.0:1789403571.866181:0:22781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050856192 00000100:00100000:3.0:1789403571.866201:0:22781:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050856192 00000100:00100000:3.0:1789403571.866256:0:22781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:3.0:1789403571.866265:0:22781:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a276a75450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7ccb4038-daf9-4dcd-9b85-da9390181204+22:25105:x1876325050856192:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789403571.866417:0:22781:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a276a75450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7ccb4038-daf9-4dcd-9b85-da9390181204+22:25105:x1876325050856192:12345-0@lo:502:mount.lustre.0 Request processed in 153us (542us total) trans 0 rc 0/0 00000100:00100000:3.0:1789403571.866425:0:22781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:1.0:1789403571.866769:0:25105:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a281913b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7ccb4038-daf9-4dcd-9b85-da9390181204:25105:1876325050856192:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1789403571.867028:0:25105:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].10, 224 off9976 00000040:00080000:1.0:1789403571.867043:0:25105:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 10 count 11 00000020:01000000:1.0:1789403571.868370:0:25109:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1789403571.868381:0:25109:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/ost2_flakey 00000020:00000080:1.0:1789403571.869736:0:25109:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789403571.869751:0:25109:0:(obd_config.c:1563:class_process_config()) marker 29 (0x1) lustre-OST0001 add ost 00000020:00000080:1.0:1789403571.869765:0:25109:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1789403571.869781:0:25109:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffff90a27ceeb380) 00000020:00000080:1.0:1789403571.869807:0:25109:0:(obd_config.c:720:class_attach_name()) OBD: dev 26 attached type obdfilter with refcount 2 00000020:00000080:1.0:1789403571.869837:0:25109:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:1.0:1789403571.869921:0:25109:0:(tgt_mount.c:153:server_get_mount()) get mount ffff90a276eb8800 from lustre-OST0001, refs=2 00080000:01000000:1.0:1789403571.869930:0:25109:0:(osd_handler.c:8924:osd_obd_connect()) connect #1 00000020:00000080:1.0:1789403571.869937:0:25109:0:(genops.c:1384:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x5fb08b1e5b762821 00010000:00010000:1.0:1789403571.879321:0:25109:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-4 is initialized 00000001:00000004:1.0:1789403571.880355:0:25109:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 3, last_transno is 8589934594 00080000:10000000:1.0:1789403571.882104:0:25109:0:(osd_handler.c:5580:osd_index_try()) lustre-OST0001: index object [0x200000003:0xb:0x0] (8/32) registered 00000020:00000080:3.0:1789403571.885873:0:25109:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:3.0:1789403571.885884:0:25109:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789403571.885904:0:25109:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789403571.885906:0:25109:0:(obd_config.c:1563:class_process_config()) marker 29 (0x2) lustre-OST0001 add ost 00000020:01000000:3.0:1789403571.885911:0:25109:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789403571.885916:0:25109:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789403571.885918:0:25109:0:(obd_config.c:1563:class_process_config()) marker 36 (0x1) lustre sys.timeout 00000020:00000080:3.0:1789403571.885922:0:25109:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1789403571.885924:0:25109:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:3.0:1789403571.885926:0:25109:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789403571.885928:0:25109:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789403571.885930:0:25109:0:(obd_config.c:1563:class_process_config()) marker 36 (0x2) lustre sys.timeout 00000020:01000000:3.0:1789403571.885932:0:25109:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789403571.885934:0:25109:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789403571.885935:0:25109:0:(obd_config.c:1563:class_process_config()) marker 41 (0x1) lustre sys.jobid_var 00000020:00000080:3.0:1789403571.885939:0:25109:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:3.0:1789403571.885970:0:25109:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789403571.885974:0:25109:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789403571.885975:0:25109:0:(obd_config.c:1563:class_process_config()) marker 41 (0x2) lustre sys.jobid_var 00000040:00080000:3.0:1789403571.885978:0:25109:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xc:0x0] index 11 count 11 00000020:01000000:2.0:1789403571.890832:0:25105:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-10 (rc=0) 10000000:01000000:2.0:1789403571.890884:0:25105:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.143@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:2.0:1789403571.890922:0:25105:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.143@tcp lock: ffff90a144062a00/0x5fb08b1e5b76280c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb08b1e5b762813 expref: -99 pid: 25105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403571.890935:0:25105:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.143@tcp lock: ffff90a144062a00/0x5fb08b1e5b76280c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb08b1e5b762813 expref: -99 pid: 25105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789403571.890944:0:25105:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff90a276eb8800 from 1 10000000:01000000:2.0:1789403571.890946:0:25105:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1789403571.890984:0:25105:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.143@tcp lock: ffff90a270185800/0x5fb08b1e5b762828 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 25105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403571.890992:0:25105:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.143@tcp lock: ffff90a270185800/0x5fb08b1e5b762828 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 25105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403571.891002:0:25105:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.143@tcp lock: ffff90a270185800/0x5fb08b1e5b762828 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 25105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789403571.891027:0:25105:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a281912300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7ccb4038-daf9-4dcd-9b85-da9390181204:25105:1876325050856320:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1789403571.891091:0:25105:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789403571.891132:0:25105:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a142675900 going to sleep for 11 seconds 00000100:00100000:0.0:1789403571.891257:0:22780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050856320 00000100:00100000:0.0:1789403571.891265:0:22780:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050856320 00000100:00100000:0.0:1789403571.891341:0:22780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:0.0:1789403571.891348:0:22780:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a276a77850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7ccb4038-daf9-4dcd-9b85-da9390181204+22:25105:x1876325050856320:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1789403571.891359:0:22780:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789403571.891369:0:22780:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90a248af0000/0x5fb08b1e5b76282f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x5fb08b1e5b762828 expref: -99 pid: 22780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403571.891419:0:22780:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90a248af0000/0x5fb08b1e5b76282f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5fb08b1e5b762828 expref: 23 pid: 22780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403571.891430:0:22780:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90a248af0000/0x5fb08b1e5b76282f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5fb08b1e5b762828 expref: 23 pid: 22780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403571.891439:0:22780:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a248af0000, rc 0) 00000100:00100000:0.0:1789403571.891485:0:22780:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a276a77850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7ccb4038-daf9-4dcd-9b85-da9390181204+23:25105:x1876325050856320:12345-0@lo:101:mount.lustre.0 Request processed in 137us (395us total) trans 0 rc 0/0 00000100:00100000:0.0:1789403571.891492:0:22780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:2.0:1789403571.891704:0:25105:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a281912300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7ccb4038-daf9-4dcd-9b85-da9390181204:25105:1876325050856320:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1789403571.891718:0:25105:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.143@tcp lock: ffff90a270185800/0x5fb08b1e5b762828 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb08b1e5b76282f expref: -99 pid: 25105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403571.891739:0:25105:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.143@tcp lock: ffff90a270185800/0x5fb08b1e5b762828 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x5fb08b1e5b76282f expref: -99 pid: 25105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1789403571.893412:0:25105:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 13 count 13 00000040:00080000:2.0:1789403571.893881:0:25105:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1789403571.896373:0:25105:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].1, 224 off8416 00000040:00080000:3.0:1789403571.896863:0:25105:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].2, 112 off8528 00000040:00080000:3.0:1789403571.896881:0:25105:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].3, 224 off8752 00000040:00080000:3.0:1789403571.896906:0:25105:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].4, 224 off8976 00000040:00080000:3.0:1789403571.896921:0:25105:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].5, 112 off9088 00000040:00080000:3.0:1789403571.896936:0:25105:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].6, 224 off9312 00000040:00080000:3.0:1789403571.896963:0:25105:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].7, 224 off9536 00000040:00080000:3.0:1789403571.896978:0:25105:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].8, 128 off9664 00000040:00080000:3.0:1789403571.896992:0:25105:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].9, 224 off9888 00000040:00080000:3.0:1789403571.897006:0:25105:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].10, 224 off10112 00000040:00080000:3.0:1789403571.897019:0:25105:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].11, 128 off10240 00000040:00080000:3.0:1789403571.897036:0:25105:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xd:0x0].12, 224 off10464 00000040:00080000:3.0:1789403571.897041:0:25105:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 12 count 13 00000100:00100000:3.0:1789403571.897133:0:25105:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a1443e4e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7ccb4038-daf9-4dcd-9b85-da9390181204:25105:1876325050856448:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789403571.897198:0:25105:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789403571.897297:0:25105:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a25ecdfcc0 going to sleep for 11 seconds 00000100:00100000:2.0:1789403571.897339:0:22778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050856448 00000100:00100000:2.0:1789403571.897347:0:22778:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050856448 00000100:00100000:1.0:1789403571.897591:0:22781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:1.0:1789403571.897603:0:22781:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a276a75c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7ccb4038-daf9-4dcd-9b85-da9390181204+23:25105:x1876325050856448:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789403571.897756:0:22781:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a276a75c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7ccb4038-daf9-4dcd-9b85-da9390181204+23:25105:x1876325050856448:12345-0@lo:501:mount.lustre.0 Request processed in 155us (557us total) trans 0 rc 0/0 00000100:00100000:1.0:1789403571.897764:0:22781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:3.0:1789403571.898025:0:25105:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a1443e4e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7ccb4038-daf9-4dcd-9b85-da9390181204:25105:1876325050856448:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789403571.898062:0:25105:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a1443e4e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7ccb4038-daf9-4dcd-9b85-da9390181204:25105:1876325050856576:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1789403571.898108:0:25105:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789403571.898143:0:25105:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a25ecdfcc0 going to sleep for 11 seconds 00000100:00100000:1.0:1789403571.898245:0:22780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050856576 00000100:00100000:1.0:1789403571.898251:0:22780:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050856576 00000100:00100000:1.0:1789403571.898288:0:22780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:1.0:1789403571.898295:0:22780:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a276a75050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7ccb4038-daf9-4dcd-9b85-da9390181204+23:25105:x1876325050856576:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1789403571.898385:0:22780:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a276a75050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7ccb4038-daf9-4dcd-9b85-da9390181204+23:25105:x1876325050856576:12345-0@lo:503:mount.lustre.0 Request processed in 91us (276us total) trans 0 rc 0/0 00000100:00100000:1.0:1789403571.898416:0:22780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:2.0:1789403571.898502:0:25105:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a1443e4e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7ccb4038-daf9-4dcd-9b85-da9390181204:25105:1876325050856576:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1789403571.898907:0:25105:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1789403571.898971:0:25105:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a281912300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7ccb4038-daf9-4dcd-9b85-da9390181204:25105:1876325050856704:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1789403571.899011:0:25105:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789403571.899048:0:25105:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a142675900 going to sleep for 11 seconds 00000100:00100000:1.0:1789403571.899278:0:22778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050856704 00000100:00100000:1.0:1789403571.899283:0:22778:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050856704 00000100:00100000:1.0:1789403571.899318:0:22778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:1.0:1789403571.899327:0:22778:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a276a77450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7ccb4038-daf9-4dcd-9b85-da9390181204+23:25105:x1876325050856704:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1789403571.899433:0:22778:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a276a77450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7ccb4038-daf9-4dcd-9b85-da9390181204+23:25105:x1876325050856704:12345-0@lo:502:mount.lustre.0 Request processed in 107us (421us total) trans 0 rc 0/0 00000100:00100000:1.0:1789403571.899440:0:22778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:2.0:1789403571.899581:0:25105:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a281912300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7ccb4038-daf9-4dcd-9b85-da9390181204:25105:1876325050856704:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1789403571.900069:0:25105:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].1, 224 off8416 00000040:00080000:2.0:1789403571.900097:0:25105:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].2, 112 off8528 00000040:00080000:2.0:1789403571.900114:0:25105:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].3, 224 off8752 00000040:00080000:2.0:1789403571.900131:0:25105:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].4, 224 off8976 00000040:00080000:2.0:1789403571.900217:0:25105:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].5, 112 off9088 00000040:00080000:2.0:1789403571.900300:0:25105:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].6, 224 off9312 00000040:00080000:2.0:1789403571.900325:0:25105:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].7, 224 off9536 00000040:00080000:2.0:1789403571.900338:0:25105:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].8, 128 off9664 00000040:00080000:2.0:1789403571.900352:0:25105:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].9, 224 off9888 00000040:00080000:2.0:1789403571.900679:0:25105:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].10, 224 off10112 00000040:00080000:3.0:1789403571.900790:0:25105:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].11, 128 off10240 00000100:00100000:3.0:1789403571.900831:0:25105:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a1443e6d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7ccb4038-daf9-4dcd-9b85-da9390181204:25105:1876325050856832:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789403571.900885:0:25105:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789403571.900927:0:25105:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a2494c3600 going to sleep for 11 seconds 00000100:00100000:1.0:1789403571.901088:0:22778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050856832 00000100:00100000:1.0:1789403571.901102:0:22778:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050856832 00000100:00100000:1.0:1789403571.901143:0:22778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:1.0:1789403571.901151:0:22778:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a276a77050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7ccb4038-daf9-4dcd-9b85-da9390181204+23:25105:x1876325050856832:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1789403571.901253:0:22778:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a276a77050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7ccb4038-daf9-4dcd-9b85-da9390181204+23:25105:x1876325050856832:12345-0@lo:502:mount.lustre.0 Request processed in 103us (367us total) trans 0 rc 0/0 00000100:00100000:1.0:1789403571.901260:0:22778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:2.0:1789403571.901446:0:25105:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a1443e6d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7ccb4038-daf9-4dcd-9b85-da9390181204:25105:1876325050856832:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1789403571.901493:0:25105:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xe:0x0].12, 224 off10464 00000040:00080000:2.0:1789403571.901502:0:25105:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 12 count 13 00000020:01000000:1.0:1789403571.903066:0:25113:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789403571.903083:0:25113:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789403571.903086:0:25113:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:1.0:1789403571.903093:0:25113:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff90a276eb8800 00000020:00000080:1.0:1789403571.903096:0:25113:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1789403571.903104:0:25113:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789403571.903107:0:25113:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789403571.903108:0:25113:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:1.0:1789403571.903110:0:25113:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789403571.903112:0:25113:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789403571.903114:0:25113:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:1.0:1789403571.903117:0:25113:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff90a276eb8800 00000020:00000080:1.0:1789403571.903119:0:25113:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1789403571.903247:0:25113:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789403571.903252:0:25113:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789403571.903253:0:25113:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:1.0:1789403571.903256:0:25113:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789403571.903258:0:25113:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789403571.903259:0:25113:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1789403571.903263:0:25113:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff90a276eb8800 00000020:00000080:1.0:1789403571.903265:0:25113:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1789403571.903801:0:25113:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789403571.903879:0:25113:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789403571.903881:0:25113:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1789403571.903887:0:25113:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789403571.903900:0:25113:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789403571.903902:0:25113:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:0.0:1789403571.903917:0:25113:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff90a276eb8800 00000020:00000080:0.0:1789403571.903919:0:25113:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1789403571.903960:0:25113:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789403571.903964:0:25113:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789403571.903965:0:25113:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:0.0:1789403571.903969:0:25113:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xe:0x0] index 13 count 13 00000020:01000000:3.0:1789403571.905375:0:25105:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:3.0:1789403571.905440:0:25105:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.143@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1789403571.905461:0:25105:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.143@tcp lock: ffff90a270185800/0x5fb08b1e5b762828 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb08b1e5b76282f expref: -99 pid: 25105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403571.905474:0:25105:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.143@tcp lock: ffff90a270185800/0x5fb08b1e5b762828 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb08b1e5b76282f expref: -99 pid: 25105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789403571.905537:0:25105:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:3.0:1789403571.905540:0:25105:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff90a276eb8800 10000000:01000000:3.0:1789403571.905555:0:25105:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff90a276eb8800 10000000:01000000:3.0:1789403571.905559:0:25105:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1789403571.905566:0:25105:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff90a276eb8800 from 1 10000000:01000000:3.0:1789403571.905569:0:25105:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1789403571.905606:0:25105:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.143@tcp lock: ffff90a259946800/0x5fb08b1e5b762836 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 25105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403571.905614:0:25105:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.143@tcp lock: ffff90a259946800/0x5fb08b1e5b762836 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 25105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403571.905625:0:25105:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.143@tcp lock: ffff90a259946800/0x5fb08b1e5b762836 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 25105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789403571.905660:0:25105:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a1443e4a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7ccb4038-daf9-4dcd-9b85-da9390181204:25105:1876325050856960:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1789403571.905721:0:25105:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789403571.905758:0:25105:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a281abe000 going to sleep for 11 seconds 00000100:00100000:3.0:1789403571.912449:0:22780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050856960 00000100:00100000:3.0:1789403571.912464:0:22780:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050856960 00000100:00100000:3.0:1789403571.912518:0:22780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:3.0:1789403571.912527:0:22780:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a27c943450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7ccb4038-daf9-4dcd-9b85-da9390181204+23:25105:x1876325050856960:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1789403571.912544:0:22780:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789403571.912561:0:22780:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90a259947600/0x5fb08b1e5b76283d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x5fb08b1e5b762836 expref: -99 pid: 22780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403571.912587:0:22780:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90a259947600/0x5fb08b1e5b76283d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5fb08b1e5b762836 expref: 24 pid: 22780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403571.912597:0:22780:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90a259947600/0x5fb08b1e5b76283d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5fb08b1e5b762836 expref: 24 pid: 22780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403571.912616:0:22780:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a259947600, rc 0) 00000100:00100000:3.0:1789403571.912700:0:22780:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a27c943450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7ccb4038-daf9-4dcd-9b85-da9390181204+24:25105:x1876325050856960:12345-0@lo:101:mount.lustre.0 Request processed in 174us (6978us total) trans 0 rc 0/0 00000100:00100000:3.0:1789403571.912707:0:22780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:3.0:1789403571.912766:0:25105:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a1443e4a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7ccb4038-daf9-4dcd-9b85-da9390181204:25105:1876325050856960:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1789403571.912784:0:25105:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.143@tcp lock: ffff90a259946800/0x5fb08b1e5b762836 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb08b1e5b76283d expref: -99 pid: 25105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403571.912794:0:25105:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.143@tcp lock: ffff90a259946800/0x5fb08b1e5b762836 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x5fb08b1e5b76283d expref: -99 pid: 25105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1789403571.928573:0:25105:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 52 count 51 00000040:00080000:1.0:1789403571.929130:0:25105:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1789403571.929345:0:25105:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].1, 224 off8416 00000040:00080000:1.0:1789403571.929371:0:25105:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].2, 120 off8536 00000040:00080000:1.0:1789403571.929436:0:25105:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].3, 168 off8704 00000040:00080000:1.0:1789403571.929453:0:25105:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].4, 224 off8928 00000040:00080000:1.0:1789403571.929467:0:25105:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].5, 224 off9152 00000040:00080000:1.0:1789403571.929482:0:25105:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].6, 120 off9272 00000040:00080000:1.0:1789403571.929509:0:25105:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].7, 168 off9440 00000040:00080000:1.0:1789403571.929525:0:25105:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].8, 224 off9664 00000040:00080000:1.0:1789403571.929537:0:25105:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].9, 224 off9888 00000040:00080000:1.0:1789403571.929550:0:25105:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].10, 120 off10008 00000040:00080000:1.0:1789403571.929563:0:25105:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].11, 224 off10232 00000040:00080000:1.0:1789403571.929576:0:25105:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].12, 224 off10456 00000040:00080000:1.0:1789403571.929587:0:25105:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].13, 88 off10544 00000040:00080000:1.0:1789403571.929600:0:25105:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].14, 128 off10672 00000040:00080000:1.0:1789403571.929613:0:25105:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].15, 144 off10816 00000040:00080000:1.0:1789403571.929627:0:25105:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].16, 160 off10976 00000040:00080000:1.0:1789403571.931445:0:25105:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].17, 224 off11200 00000040:00080000:1.0:1789403571.931483:0:25105:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].18, 224 off11424 00000040:00080000:1.0:1789403571.931500:0:25105:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].19, 80 off11504 00000040:00080000:1.0:1789403571.931516:0:25105:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].20, 224 off11728 00000040:00080000:1.0:1789403571.931529:0:25105:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].21, 224 off11952 00000040:00080000:1.0:1789403571.931544:0:25105:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].22, 88 off12040 00000040:00080000:1.0:1789403571.931581:0:25105:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].23, 128 off12168 00000040:00080000:1.0:1789403571.931598:0:25105:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].24, 144 off12312 00000040:00080000:1.0:1789403571.931627:0:25105:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].25, 160 off12472 00000040:00080000:1.0:1789403571.931651:0:25105:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].26, 224 off12696 00000040:00080000:1.0:1789403571.931667:0:25105:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].27, 224 off12920 00000040:00080000:1.0:1789403571.931682:0:25105:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].28, 80 off13000 00000040:00080000:1.0:1789403571.931697:0:25105:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].29, 224 off13224 00000040:00080000:1.0:1789403571.931713:0:25105:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].30, 224 off13448 00000040:00080000:1.0:1789403571.931726:0:25105:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].31, 88 off13536 00000040:00080000:1.0:1789403571.931739:0:25105:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].32, 128 off13664 00000040:00080000:1.0:1789403571.931754:0:25105:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].33, 144 off13808 00000040:00080000:1.0:1789403571.931767:0:25105:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].34, 128 off13936 00000040:00080000:1.0:1789403571.931779:0:25105:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].35, 224 off14160 00000040:00080000:1.0:1789403571.931804:0:25105:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].36, 224 off14384 00000040:00080000:1.0:1789403571.931819:0:25105:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].37, 80 off14464 00000040:00080000:1.0:1789403571.931834:0:25105:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].38, 224 off14688 00000040:00080000:1.0:1789403571.931862:0:25105:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].39, 224 off14912 00000040:00080000:1.0:1789403571.931879:0:25105:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].40, 88 off15000 00000040:00080000:1.0:1789403571.931905:0:25105:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].41, 128 off15128 00000040:00080000:1.0:1789403571.931922:0:25105:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].42, 144 off15272 00000040:00080000:1.0:1789403571.931936:0:25105:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].43, 128 off15400 00000040:00080000:1.0:1789403571.931950:0:25105:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].44, 224 off15624 00000040:00080000:1.0:1789403571.931964:0:25105:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].45, 224 off15848 00000040:00080000:1.0:1789403571.931978:0:25105:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].46, 80 off15928 00000040:00080000:1.0:1789403571.931992:0:25105:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].47, 224 off16152 00000040:00080000:1.0:1789403571.932006:0:25105:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].48, 232 off16384 00000040:00080000:1.0:1789403571.932157:0:25105:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].49, 224 off16608 00000040:00080000:1.0:1789403571.932178:0:25105:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].50, 120 off16728 00000040:00080000:1.0:1789403571.932195:0:25105:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xf:0x0].51, 224 off16952 00000040:00080000:1.0:1789403571.932200:0:25105:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 51 count 51 00000100:00100000:1.0:1789403571.932299:0:25105:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a144048e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7ccb4038-daf9-4dcd-9b85-da9390181204:25105:1876325050857088:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789403571.932365:0:25105:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789403571.932438:0:25105:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a1441aa600 going to sleep for 11 seconds 00000100:00100000:2.0:1789403571.933187:0:22781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050857088 00000100:00100000:2.0:1789403571.933203:0:22781:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050857088 00000100:00100000:2.0:1789403571.933256:0:22781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:2.0:1789403571.933266:0:22781:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a27c943850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7ccb4038-daf9-4dcd-9b85-da9390181204+24:25105:x1876325050857088:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789403571.933424:0:22781:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a27c943850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7ccb4038-daf9-4dcd-9b85-da9390181204+24:25105:x1876325050857088:12345-0@lo:501:mount.lustre.0 Request processed in 159us (1058us total) trans 0 rc 0/0 00000100:00100000:2.0:1789403571.933432:0:22781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:0.0:1789403571.933446:0:25105:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a144048e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7ccb4038-daf9-4dcd-9b85-da9390181204:25105:1876325050857088:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789403571.933488:0:25105:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a1442edf80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7ccb4038-daf9-4dcd-9b85-da9390181204:25105:1876325050857216:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1789403571.933542:0:25105:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789403571.933579:0:25105:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a26d1460c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789403571.933923:0:22780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050857216 00000100:00100000:3.0:1789403571.933929:0:22780:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050857216 00000100:00100000:3.0:1789403571.933957:0:22780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:3.0:1789403571.933965:0:22780:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a27c940450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7ccb4038-daf9-4dcd-9b85-da9390181204+24:25105:x1876325050857216:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1789403571.934045:0:22780:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a27c940450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7ccb4038-daf9-4dcd-9b85-da9390181204+24:25105:x1876325050857216:12345-0@lo:503:mount.lustre.0 Request processed in 81us (504us total) trans 0 rc 0/0 00000100:00100000:3.0:1789403571.934052:0:22780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:0.0:1789403571.934151:0:25105:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a1442edf80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7ccb4038-daf9-4dcd-9b85-da9390181204:25105:1876325050857216:0@lo:503:mount.lustre.0 00000040:00080000:0.0:1789403571.936984:0:25105:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1789403571.937079:0:25105:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a1442edf80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7ccb4038-daf9-4dcd-9b85-da9390181204:25105:1876325050857344:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1789403571.937148:0:25105:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789403571.937196:0:25105:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a26d1460c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789403571.937283:0:22780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050857344 00000100:00100000:3.0:1789403571.937290:0:22780:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050857344 00000100:00100000:3.0:1789403571.937340:0:22780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:3.0:1789403571.937349:0:22780:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a27c942450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7ccb4038-daf9-4dcd-9b85-da9390181204+24:25105:x1876325050857344:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789403571.937476:0:22780:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a27c942450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7ccb4038-daf9-4dcd-9b85-da9390181204+24:25105:x1876325050857344:12345-0@lo:502:mount.lustre.0 Request processed in 128us (327us total) trans 0 rc 0/0 00000100:00100000:3.0:1789403571.937483:0:22780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:0.0:1789403571.938095:0:25105:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a1442edf80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7ccb4038-daf9-4dcd-9b85-da9390181204:25105:1876325050857344:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1789403571.938801:0:25105:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].1, 224 off8416 00000040:00080000:0.0:1789403571.938831:0:25105:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].2, 120 off8536 00000040:00080000:0.0:1789403571.938844:0:25105:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].3, 168 off8704 00000040:00080000:0.0:1789403571.938874:0:25105:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].4, 224 off8928 00000040:00080000:0.0:1789403571.938888:0:25105:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].5, 224 off9152 00000040:00080000:0.0:1789403571.938916:0:25105:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].6, 120 off9272 00000040:00080000:0.0:1789403571.938930:0:25105:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].7, 168 off9440 00000040:00080000:0.0:1789403571.938942:0:25105:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].8, 224 off9664 00000040:00080000:0.0:1789403571.938953:0:25105:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].9, 224 off9888 00000040:00080000:0.0:1789403571.938966:0:25105:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].10, 120 off10008 00000040:00080000:0.0:1789403571.938978:0:25105:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].11, 224 off10232 00000040:00080000:0.0:1789403571.938990:0:25105:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].12, 224 off10456 00000040:00080000:0.0:1789403571.939013:0:25105:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].13, 88 off10544 00000040:00080000:0.0:1789403571.939026:0:25105:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].14, 128 off10672 00000040:00080000:0.0:1789403571.939040:0:25105:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].15, 144 off10816 00000040:00080000:0.0:1789403571.939053:0:25105:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].16, 160 off10976 00000040:00080000:0.0:1789403571.939064:0:25105:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].17, 224 off11200 00000040:00080000:0.0:1789403571.939077:0:25105:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].18, 224 off11424 00000040:00080000:0.0:1789403571.939090:0:25105:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].19, 80 off11504 00000040:00080000:0.0:1789403571.939119:0:25105:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].20, 224 off11728 00000040:00080000:0.0:1789403571.939133:0:25105:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].21, 224 off11952 00000040:00080000:0.0:1789403571.939145:0:25105:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].22, 88 off12040 00000040:00080000:0.0:1789403571.939158:0:25105:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].23, 128 off12168 00000040:00080000:0.0:1789403571.939173:0:25105:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].24, 144 off12312 00000040:00080000:0.0:1789403571.939185:0:25105:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].25, 160 off12472 00000040:00080000:0.0:1789403571.939197:0:25105:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].26, 224 off12696 00000040:00080000:0.0:1789403571.939210:0:25105:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].27, 224 off12920 00000040:00080000:0.0:1789403571.939221:0:25105:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].28, 80 off13000 00000040:00080000:0.0:1789403571.939233:0:25105:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].29, 224 off13224 00000040:00080000:0.0:1789403571.939480:0:25105:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].30, 224 off13448 00000040:00080000:0.0:1789403571.939495:0:25105:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].31, 88 off13536 00000040:00080000:0.0:1789403571.939519:0:25105:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].32, 128 off13664 00000040:00080000:0.0:1789403571.939533:0:25105:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].33, 144 off13808 00000040:00080000:0.0:1789403571.939546:0:25105:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].34, 128 off13936 00000040:00080000:0.0:1789403571.939574:0:25105:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].35, 224 off14160 00000040:00080000:0.0:1789403571.939601:0:25105:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].36, 224 off14384 00000040:00080000:0.0:1789403571.939617:0:25105:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].37, 80 off14464 00000040:00080000:0.0:1789403571.939630:0:25105:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].38, 224 off14688 00000040:00080000:0.0:1789403571.939643:0:25105:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].39, 224 off14912 00000040:00080000:0.0:1789403571.939661:0:25105:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].40, 88 off15000 00000040:00080000:0.0:1789403571.939677:0:25105:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].41, 128 off15128 00000040:00080000:0.0:1789403571.939689:0:25105:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].42, 144 off15272 00000040:00080000:0.0:1789403571.939702:0:25105:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].43, 128 off15400 00000040:00080000:0.0:1789403571.939715:0:25105:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].44, 224 off15624 00000040:00080000:0.0:1789403571.939727:0:25105:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].45, 224 off15848 00000040:00080000:0.0:1789403571.940327:0:25105:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].46, 80 off15928 00000040:00080000:0.0:1789403571.940347:0:25105:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].47, 224 off16152 00000040:00080000:0.0:1789403571.940361:0:25105:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].48, 232 off16384 00000100:00100000:0.0:1789403571.940975:0:25105:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a1442edf80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7ccb4038-daf9-4dcd-9b85-da9390181204:25105:1876325050857472:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1789403571.941051:0:25105:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789403571.941098:0:25105:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a26d1460c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789403571.941126:0:22781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050857472 00000100:00100000:2.0:1789403571.941133:0:22781:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050857472 00000100:00100000:2.0:1789403571.941182:0:22781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:2.0:1789403571.941191:0:22781:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a27c943c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7ccb4038-daf9-4dcd-9b85-da9390181204+24:25105:x1876325050857472:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1789403571.941316:0:22781:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a27c943c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7ccb4038-daf9-4dcd-9b85-da9390181204+24:25105:x1876325050857472:12345-0@lo:502:mount.lustre.0 Request processed in 125us (264us total) trans 0 rc 0/0 00000100:00100000:2.0:1789403571.941324:0:22781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:0.0:1789403571.941507:0:25105:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a1442edf80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7ccb4038-daf9-4dcd-9b85-da9390181204:25105:1876325050857472:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1789403571.942205:0:25105:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].49, 224 off16608 00000040:00080000:0.0:1789403571.942238:0:25105:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].50, 120 off16728 00000100:00100000:0.0:1789403571.942271:0:25105:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a1442edf80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7ccb4038-daf9-4dcd-9b85-da9390181204:25105:1876325050857600:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1789403571.942677:0:25105:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789403571.942746:0:25105:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a26d1460c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789403571.942784:0:22778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050857600 00000100:00100000:2.0:1789403571.942790:0:22778:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050857600 00000100:00100000:2.0:1789403571.942931:0:22778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:2.0:1789403571.942942:0:22778:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a27c940c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7ccb4038-daf9-4dcd-9b85-da9390181204+24:25105:x1876325050857600:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1789403571.943090:0:22778:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a27c940c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7ccb4038-daf9-4dcd-9b85-da9390181204+24:25105:x1876325050857600:12345-0@lo:502:mount.lustre.0 Request processed in 150us (767us total) trans 0 rc 0/0 00000100:00100000:0.0:1789403571.943166:0:25105:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a1442edf80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7ccb4038-daf9-4dcd-9b85-da9390181204:25105:1876325050857600:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1789403571.943220:0:25105:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x10:0x0].51, 224 off16952 00000040:00080000:0.0:1789403571.943228:0:25105:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 51 count 51 00000100:00100000:2.0:1789403571.946486:0:22778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000020:01000004:3.0:1789403571.947274:0:25118:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:3.0:1789403571.947290:0:25118:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffff90a27dbd4d40) 00000020:00000080:3.0:1789403571.947315:0:25118:0:(obd_config.c:720:class_attach_name()) OBD: dev 27 attached type lwp with refcount 2 00000020:01000004:3.0:1789403571.947440:0:25118:0:(tgt_mount.c:153:server_get_mount()) get mount ffff90a276eb8800 from lustre-OST0001, refs=3 00000020:01000004:3.0:1789403571.947445:0:25118:0:(tgt_mount.c:187:server_put_mount()) put mount ffff90a276eb8800 from lustre-OST0001, refs=3 00000020:01000004:3.0:1789403571.947448:0:25118:0:(obd_mount.c:710:lustre_put_lsi()) put ffff90a276eb8800 3 00010000:00080000:3.0:1789403571.947477:0:25118:0:(ldlm_lib.c:102:import_set_conn()) imp ffff90a1426d0800@lustre-MDT0000-lwp-OST0001: add connection 192.168.203.143@tcp at head 00010000:00010000:3.0:1789403571.949124:0:25118:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-11 is initialized 00000020:00000080:3.0:1789403571.949337:0:25118:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:3.0:1789403571.949377:0:25118:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1789403571.949405:0:25118:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0x5fb08b1e5b76284b 00000100:00080000:3.0:1789403571.949414:0:25118:0:(import.c:545:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1789403571.949424:0:25118:0:(import.c:666:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff90a1426d0800 using connection 192.168.203.143@tcp/0@lo 00000100:00100000:3.0:1789403571.949457:0:25118:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff90a1443e4a80 x1876325050857728/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1789403571.949481:0:25118:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00100000:2.0:1789403571.950136:0:3625:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a1443e4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3625:1876325050857728:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1789403571.950205:0:3625:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789403571.950327:0:22788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050857728 00000100:00100000:0.0:1789403571.950335:0:22788:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050857728 00000100:00100000:0.0:1789403571.950369:0:22788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1789403571.950376:0:22788:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a281912300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3625:x1876325050857728:12345-0@lo:38:llog_process_th.0 00010000:00080000:0.0:1789403571.950417:0:22788:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 617 last 0 00000020:00000080:0.0:1789403571.950459:0:22788:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0x5fb08b1e5b762852 00000004:00100000:0.0:1789403571.950473:0:22788:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1789403571.950512:0:22788:0:(import.c:65:import_set_state_nolock()) ffff90a276ebf800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1789403571.950572:0:22788:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a281912300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3625:x1876325050857728:12345-0@lo:38:llog_process_th.0 Request processed in 194us (366us total) trans 0 rc 0/0 00000100:00100000:0.0:1789403571.950579:0:22788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:2.0:1789403571.950698:0:3625:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90a1443e4a80 x1876325050857728/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1789403581 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789403571.950708:0:3625:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:2.0:1789403571.950714:0:3625:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 3 00000100:00080000:2.0:1789403571.950728:0:3625:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:2.0:1789403571.950733:0:3625:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1789403571.950735:0:3625:0:(import.c:65:import_set_state_nolock()) ffff90a1426d0800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1789403571.950813:0:3625:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a1443e4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3625:1876325050857728:0@lo:38:llog_process_th.0 00000100:00080000:2.0:1789403571.950881:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1789403571.950885:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1789403571.950888:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1789403571.950902:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1789403571.950930:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1789403571.950933:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1789403571.950935:0:36:0:(import.c:65:import_set_state_nolock()) ffff90a26d291800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1789403571.950938:0:36:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 614 00000100:00080000:2.0:1789403571.950942:0:36:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 15s 00000100:00080000:2.0:1789403571.950948:0:36:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff90a26d291800 using connection 192.168.203.143@tcp/0@lo 00000100:00100000:2.0:1789403571.950960:0:36:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff90a281913800 x1876325050858368/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000020:01000004:1.0:1789403571.950966:0:25118:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-lwp-OST0001 (typ=lwp) 00000020:00000080:1.0:1789403571.950980:0:25118:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-lwp-OST0001 (ffff90a27ceecd40) 00000020:00000080:1.0:1789403571.950997:0:25118:0:(obd_config.c:720:class_attach_name()) OBD: dev 28 attached type lwp with refcount 2 00000100:00100000:2.0:1789403571.950998:0:3626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a281911500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3626:1876325050858240:0@lo:400:kworker.0 00000100:00100000:2.0:1789403571.951027:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789403571.951049:0:3626:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1789403571.951054:0:3626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a281913100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3626:1876325050857856:0@lo:400:kworker.0 00000100:00100000:2.0:1789403571.951075:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:01000004:1.0:1789403571.951080:0:25118:0:(tgt_mount.c:153:server_get_mount()) get mount ffff90a276eb8800 from lustre-OST0001, refs=3 00000020:01000004:1.0:1789403571.951084:0:25118:0:(tgt_mount.c:187:server_put_mount()) put mount ffff90a276eb8800 from lustre-OST0001, refs=3 00000020:01000004:1.0:1789403571.951087:0:25118:0:(obd_mount.c:710:lustre_put_lsi()) put ffff90a276eb8800 3 00000100:00100000:2.0:1789403571.951090:0:3626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a281910e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3626:1876325050858496:0@lo:400:kworker.0 00000100:00100000:2.0:1789403571.951110:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:1.0:1789403571.951110:0:25118:0:(ldlm_lib.c:102:import_set_conn()) imp ffff90a276e28800@lustre-MDT0001-lwp-OST0001: add connection 192.168.203.143@tcp at head 00000100:00100000:2.0:1789403571.951140:0:3628:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a281911880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3628:1876325050857984:0@lo:400:kworker.0 00000100:00100000:2.0:1789403571.951161:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789403571.951177:0:3628:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a281910a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3628:1876325050858624:0@lo:400:kworker.0 00000100:00100000:2.0:1789403571.951194:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789403571.951208:0:3628:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1789403571.951213:0:3628:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a281913480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3628:1876325050858112:0@lo:400:kworker.0 00000100:00100000:2.0:1789403571.951231:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789403571.951261:0:3628:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a281912a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3628:1876325050858752:0@lo:400:kworker.0 00000100:00100000:2.0:1789403571.951283:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789403571.951307:0:3625:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a281913800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3625:1876325050858368:0@lo:8:kworker.0 00000100:00100000:2.0:1789403571.951325:0:3625:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789403571.951353:0:24290:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050858240 00000100:00100000:2.0:1789403571.951359:0:24290:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050858240 00000100:00100000:2.0:1789403571.951413:0:24290:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050858368 00000100:00100000:2.0:1789403571.951416:0:24290:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050858368 00000100:00100000:2.0:1789403571.951432:0:24290:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1789403571.951439:0:24290:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a281910380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3626:x1876325050858240:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789403571.951477:0:24290:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a281910380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3626:x1876325050858240:12345-0@lo:400:kworker.0 Request processed in 39us (449us total) trans 0 rc 0/0 00000100:00100000:2.0:1789403571.951482:0:24290:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1789403571.951503:0:24290:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1789403571.951507:0:24290:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a281913b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3625:x1876325050858368:12345-0@lo:8:kworker.0 00000100:00100000:2.0:1789403571.951558:0:24290:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a281913b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3625:x1876325050858368:12345-0@lo:8:kworker.0 Request processed in 49us (231us total) trans 0 rc -11/-11 00000100:00100000:2.0:1789403571.951564:0:24290:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1789403571.951583:0:22791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050857856 00000100:00100000:2.0:1789403571.951592:0:22791:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050857856 00000100:00100000:2.0:1789403571.951620:0:22791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050858112 00000100:00100000:2.0:1789403571.951622:0:22791:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050858112 00000100:00100000:2.0:1789403571.951635:0:22791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1789403571.951640:0:22791:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a281910000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3626:x1876325050857856:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789403571.951670:0:22791:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a281910000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3626:x1876325050857856:12345-0@lo:400:kworker.0 Request processed in 30us (594us total) trans 0 rc 0/0 00000100:00100000:2.0:1789403571.951676:0:22791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1789403571.951687:0:22791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1789403571.951692:0:22791:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a281911180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3628:x1876325050858112:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789403571.951718:0:22791:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a281911180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3628:x1876325050858112:12345-0@lo:400:kworker.0 Request processed in 26us (485us total) trans 0 rc 0/0 00000100:00100000:2.0:1789403571.951723:0:22791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1789403571.951738:0:22787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050858496 00010000:00010000:1.0:1789403571.952691:0:25118:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-lwp-OST0001-12 is initialized 00000100:00100000:2.0:1789403571.953854:0:22787:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050858496 00000100:00100000:2.0:1789403571.953912:0:22787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050857984 00000100:00100000:2.0:1789403571.953918:0:22787:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050857984 00000100:00100000:2.0:1789403571.953930:0:22787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050858624 00000100:00100000:2.0:1789403571.953933:0:22787:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050858624 00000100:00100000:2.0:1789403571.953950:0:22787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050858752 00000100:00100000:2.0:1789403571.953952:0:22787:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050858752 00000100:00100000:2.0:1789403571.953968:0:22787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1789403571.953977:0:22787:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a281911c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3626:x1876325050858496:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789403571.954050:0:22787:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a281911c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3626:x1876325050858496:12345-0@lo:400:kworker.0 Request processed in 74us (2938us total) trans 0 rc 0/0 00000100:00100000:2.0:1789403571.954056:0:22787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1789403571.954072:0:22787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1789403571.954077:0:22787:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a281912680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3628:x1876325050857984:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789403571.954113:0:22787:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a281912680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3628:x1876325050857984:12345-0@lo:400:kworker.0 Request processed in 36us (2951us total) trans 0 rc 0/0 00000100:00100000:2.0:1789403571.954118:0:22787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1789403571.954128:0:22787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1789403571.954133:0:22787:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a281911f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3628:x1876325050858624:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789403571.954152:0:22787:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a281911f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3628:x1876325050858624:12345-0@lo:400:kworker.0 Request processed in 19us (2957us total) trans 0 rc 0/0 00000100:00100000:2.0:1789403571.954156:0:22787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1789403571.954164:0:22787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1789403571.954169:0:22787:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a281912d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3628:x1876325050858752:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789403571.954189:0:22787:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a281912d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3628:x1876325050858752:12345-0@lo:400:kworker.0 Request processed in 20us (2905us total) trans 0 rc 0/0 00000100:00100000:2.0:1789403571.954193:0:22787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00080000:2.0:1789403571.954216:0:22782:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1789403571.954219:0:22782:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789403571.954221:0:22782:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789403571.954850:0:3626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a281913100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3626:1876325050857856:0@lo:400:kworker.0 00010000:00080000:2.0:1789403571.954863:0:3626:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90a281910e00 x1876325050858496/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789403587 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789403571.954873:0:3626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a281910e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3626:1876325050858496:0@lo:400:kworker.0 00010000:00080000:2.0:1789403571.954883:0:3626:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90a281911500 x1876325050858240/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789403587 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789403571.954900:0:3626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a281911500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3626:1876325050858240:0@lo:400:kworker.0 00000100:00100000:2.0:1789403571.954936:0:3625:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:2.0:1789403571.954947:0:3625:0:(import.c:65:import_set_state_nolock()) ffff90a26d291800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1789403571.954951:0:3625:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-11) 00000100:00100000:2.0:1789403571.954955:0:3625:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a281913800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3625:1876325050858368:0@lo:8:kworker.0 00000100:00100000:2.0:1789403571.954986:0:3628:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a281913480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3628:1876325050858112:0@lo:400:kworker.0 00010000:00080000:2.0:1789403571.954996:0:3628:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90a281912a00 x1876325050858752/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789403587 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789403571.955004:0:3628:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a281912a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3628:1876325050858752:0@lo:400:kworker.0 00010000:00080000:2.0:1789403571.955013:0:3628:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90a281911880 x1876325050857984/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789403587 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789403571.955020:0:3628:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a281911880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3628:1876325050857984:0@lo:400:kworker.0 00010000:00080000:2.0:1789403571.955029:0:3628:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff90a281910a80 x1876325050858624/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789403587 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789403571.955036:0:3628:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a281910a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3628:1876325050858624:0@lo:400:kworker.0 00010000:00010000:3.0:1789403571.955696:0:22774:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1789403571.958010:0:25118:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-lwp-OST0001 (uuid lustre-MDT0001-lwp-OST0001_UUID) 00000010:01000000:0.0:1789403571.958061:0:25118:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1789403571.958075:0:25118:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-lwp-OST0001, cookie 0x5fb08b1e5b762860 00000100:00080000:0.0:1789403571.958085:0:25118:0:(import.c:545:import_select_connection()) lustre-MDT0001-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1789403571.958096:0:25118:0:(import.c:666:import_select_connection()) lustre-MDT0001-lwp-OST0001: import ffff90a276e28800 using connection 192.168.203.143@tcp/0@lo 00000100:00100000:0.0:1789403571.958128:0:25118:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff90a1442edf80 x1876325050858880/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1789403571.958155:0:25118:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID 00000100:00100000:2.0:1789403571.958658:0:3625:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a1442edf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3625:1876325050858880:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1789403571.958725:0:3625:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1789403571.958790:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1789403571.958795:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1789403571.958797:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1789403571.958799:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1789403571.958820:0:22787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050858880 00000100:00100000:2.0:1789403571.958826:0:22787:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050858880 00000100:00100000:2.0:1789403571.958857:0:22787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1789403571.958872:0:22787:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a281910a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3625:x1876325050858880:12345-0@lo:38:llog_process_th.0 00010000:00080000:2.0:1789403571.958908:0:22787:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0001-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 617 last 0 00000020:00000080:2.0:1789403571.958938:0:22787:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-lwp-OST0001_UUID, cookie 0x5fb08b1e5b762867 00000004:00100000:2.0:1789403571.958952:0:22787:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1789403571.958982:0:22787:0:(import.c:65:import_set_state_nolock()) ffff90a276e17000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1789403571.959029:0:22787:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a281910a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3625:x1876325050858880:12345-0@lo:38:llog_process_th.0 Request processed in 157us (304us total) trans 0 rc 0/0 00000100:00100000:2.0:1789403571.959036:0:22787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:2.0:1789403571.959074:0:3625:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90a1442edf80 x1876325050858880/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1789403581 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789403571.959084:0:3625:0:(client.c:3126:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:2.0:1789403571.959092:0:3625:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-MDT0001-lwp-OST0001: connect to target with instance 3 00000100:00080000:2.0:1789403571.959098:0:3625:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-MDT0001-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:2.0:1789403571.959102:0:3625:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:2.0:1789403571.959104:0:3625:0:(import.c:65:import_set_state_nolock()) ffff90a276e28800 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1789403571.959109:0:3625:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a1442edf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3625:1876325050858880:0@lo:38:llog_process_th.0 00000040:00080000:0.0:1789403571.961615:0:25118:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x10:0x0] index 52 count 51 00000020:01000000:1.0:1789403571.961747:0:25105:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:1.0:1789403571.961780:0:25105:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.143@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1789403571.961802:0:25105:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.143@tcp lock: ffff90a259946800/0x5fb08b1e5b762836 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb08b1e5b76283d expref: -99 pid: 25105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403571.961826:0:25105:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.143@tcp lock: ffff90a259946800/0x5fb08b1e5b762836 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb08b1e5b76283d expref: -99 pid: 25105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:1.0:1789403571.961875:0:25105:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:1.0:1789403571.961877:0:25105:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1789403571.961878:0:25105:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1789403571.961880:0:25105:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1789403571.961881:0:25105:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1789403571.961882:0:25105:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1789403571.961883:0:25105:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1789403571.961885:0:25105:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1789403571.961886:0:25105:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1789403571.961899:0:25105:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020002 00000020:01000004:1.0:1789403571.961901:0:25105:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1789403571.961903:0:25105:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1789403571.961904:0:25105:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1789403571.961905:0:25105:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1789403571.961906:0:25105:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1789403571.961907:0:25105:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1789403571.961908:0:25105:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1789403571.961909:0:25105:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1789403571.961910:0:25105:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1789403571.961936:0:25105:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:1.0:1789403571.961955:0:25105:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a14404ad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7ccb4038-daf9-4dcd-9b85-da9390181204:25105:1876325050859008:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1789403571.962018:0:25105:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789403571.962053:0:25105:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a1441aa3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789403571.962074:0:22780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050859008 00000100:00100000:1.0:1789403571.962080:0:22780:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050859008 00000100:00100000:1.0:1789403571.962121:0:22780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:1.0:1789403571.962129:0:22780:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a27c941050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7ccb4038-daf9-4dcd-9b85-da9390181204+24:25105:x1876325050859008:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1789403571.962153:0:22780:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:1.0:1789403571.962168:0:22780:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:0.0:1789403571.966659:0:22780:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1789403571.966703:0:22780:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:0.0:1789403571.967052:0:22780:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a27c941050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7ccb4038-daf9-4dcd-9b85-da9390181204+24:25105:x1876325050859008:12345-0@lo:253:mount.lustre.0 Request processed in 4919us (5029us total) trans 0 rc 0/0 00000100:00100000:0.0:1789403571.967063:0:22780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 20000000:01000000:1.0:1789403571.967124:0:22802:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:1.0:1789403571.967129:0:22802:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:1.0:1789403571.967150:0:22802:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff90a144062600/0x5fb08b1e5b76286e lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 22802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403571.967165:0:22802:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff90a248af1600/0x5fb08b1e5b7627e2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5fb08b1e5b7627db expref: 23 pid: 22780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403571.967172:0:22802:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff90a144063a00/0x5fb08b1e5b7627f0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5fb08b1e5b7627e9 expref: 23 pid: 22781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403571.967179:0:22802:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff90a144062600/0x5fb08b1e5b76286e lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 22802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403571.967214:0:22802:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff90a144063a00/0x5fb08b1e5b7627f0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5fb08b1e5b7627e9 expref: 23 pid: 22781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403571.967227:0:22802:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff90a144063a00/0x5fb08b1e5b7627f0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5fb08b1e5b7627e9 expref: 23 pid: 22781 timeout: 717 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789403571.967241:0:22802:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a144049880 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22802:1876325050859136:0@lo:104: 00000100:00100000:1.0:1789403571.967277:0:22802:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1789403571.967315:0:22802:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff90a248af1600/0x5fb08b1e5b7627e2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5fb08b1e5b7627db expref: 23 pid: 22780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403571.967323:0:22802:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff90a248af1600/0x5fb08b1e5b7627e2 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5fb08b1e5b7627db expref: 23 pid: 22780 timeout: 717 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789403571.967332:0:22802:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a144049180 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22802:1876325050859264:0@lo:104: 00000100:00100000:1.0:1789403571.967352:0:22802:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789403571.967507:0:22802:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a1441aa240 going to sleep for 11 seconds 00000100:00100000:0.0:1789403571.967555:0:22770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050859136 00000100:00100000:0.0:1789403571.967563:0:22770:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050859136 00000100:00100000:0.0:1789403571.967595:0:22770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050859264 00000100:00100000:0.0:1789403571.967597:0:22770:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050859264 00000100:00100000:0.0:1789403571.967624:0:22770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1789403571.967632:0:22770:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a144049f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:7ccb4038-daf9-4dcd-9b85-da9390181204+4:22802:x1876325050859136:12345-0@lo:104: 00010000:00010000:0.0:1789403571.967642:0:22770:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.143@tcp lock: ffff90a248af1800/0x5fb08b1e5b7627e9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x5fb08b1e5b7627f0 expref: -99 pid: 22783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403571.967688:0:22770:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1789403571.967694:0:22770:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a144049f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:7ccb4038-daf9-4dcd-9b85-da9390181204+4:22802:x1876325050859136:12345-0@lo:104: Request processed in 64us (418us total) trans 0 rc 0/0 00000100:00100000:0.0:1789403571.967700:0:22770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1789403571.967713:0:22770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1789403571.967719:0:22770:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a144048000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:7ccb4038-daf9-4dcd-9b85-da9390181204+3:22802:x1876325050859264:12345-0@lo:104: 00010000:00010000:0.0:1789403571.967732:0:22770:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.143@tcp lock: ffff90a259947800/0x5fb08b1e5b7627db lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x5fb08b1e5b7627e2 expref: -99 pid: 22783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403571.967886:0:22770:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1789403571.967903:0:22770:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a144048000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:7ccb4038-daf9-4dcd-9b85-da9390181204+3:22802:x1876325050859264:12345-0@lo:104: Request processed in 174us (539us total) trans 0 rc 0/0 00000100:00100000:0.0:1789403571.967910:0:22770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00010000:0.0:1789403571.967927:0:22775:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1789403571.967932:0:22775:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.143@tcp lock: ffff90a248af1800/0x5fb08b1e5b7627e9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x5fb08b1e5b7627f0 expref: -99 pid: 22783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403571.967939:0:22775:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a248af1800 already unused, calling callback (ffffffffc120dc20) 10000000:00010000:0.0:1789403571.967943:0:22775:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.143@tcp lock: ffff90a248af1800/0x5fb08b1e5b7627e9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x5fb08b1e5b7627f0 expref: -99 pid: 22783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403571.967951:0:22775:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.143@tcp lock: ffff90a248af1800/0x5fb08b1e5b7627e9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x5fb08b1e5b7627f0 expref: -99 pid: 22783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789403571.967958:0:22775:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.143@tcp lock: ffff90a248af1800/0x5fb08b1e5b7627e9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x5fb08b1e5b7627f0 expref: -99 pid: 22783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789403571.967964:0:22775:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1789403571.967989:0:22775:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.143@tcp lock: ffff90a248af1800/0x5fb08b1e5b7627e9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5fb08b1e5b7627f0 expref: -99 pid: 22783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403571.967995:0:22775:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789403571.968014:0:22775:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.143@tcp lock: ffff90a248af1800/0x5fb08b1e5b7627e9 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5fb08b1e5b7627f0 expref: -99 pid: 22783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403571.968020:0:22775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.143@tcp lock: ffff90a248af1800/0x5fb08b1e5b7627e9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5fb08b1e5b7627f0 expref: -99 pid: 22783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403571.968037:0:22775:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789403571.968040:0:22775:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.143@tcp lock: ffff90a259947800/0x5fb08b1e5b7627db lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x5fb08b1e5b7627e2 expref: -99 pid: 22783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403571.968045:0:22775:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a259947800 already unused, calling callback (ffffffffc120dc20) 10000000:00010000:0.0:1789403571.968048:0:22775:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.143@tcp lock: ffff90a259947800/0x5fb08b1e5b7627db lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x5fb08b1e5b7627e2 expref: -99 pid: 22783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403571.968055:0:22775:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.143@tcp lock: ffff90a259947800/0x5fb08b1e5b7627db lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x5fb08b1e5b7627e2 expref: -99 pid: 22783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789403571.968061:0:22775:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.143@tcp lock: ffff90a259947800/0x5fb08b1e5b7627db lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x5fb08b1e5b7627e2 expref: -99 pid: 22783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789403571.968067:0:22775:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1789403571.968079:0:22775:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.143@tcp lock: ffff90a259947800/0x5fb08b1e5b7627db lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5fb08b1e5b7627e2 expref: -99 pid: 22783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403571.968084:0:22775:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789403571.968090:0:22775:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.143@tcp lock: ffff90a259947800/0x5fb08b1e5b7627db lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5fb08b1e5b7627e2 expref: -99 pid: 22783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403571.968096:0:22775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.143@tcp lock: ffff90a259947800/0x5fb08b1e5b7627db lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5fb08b1e5b7627e2 expref: -99 pid: 22783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403571.968106:0:22775:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789403571.968108:0:22775:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789403571.968109:0:22775:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789403571.968158:0:22774:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789403571.968175:0:3627:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a1442ec380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7ccb4038-daf9-4dcd-9b85-da9390181204:3627:1876325050859520:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789403571.968204:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789403571.968223:0:3627:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789403571.968228:0:3627:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a1442ef100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7ccb4038-daf9-4dcd-9b85-da9390181204:3627:1876325050859392:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789403571.968246:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789403571.968272:0:22772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050859520 00000100:00100000:0.0:1789403571.968276:0:22772:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050859520 00010000:00010000:0.0:1789403571.968292:0:22772:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff90a248af1600/0x5fb08b1e5b7627e2 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5fb08b1e5b7627db expref: 24 pid: 22780 timeout: 717 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789403571.968309:0:22772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050859392 00000100:00100000:0.0:1789403571.968312:0:22772:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050859392 00010000:00010000:0.0:1789403571.968321:0:22772:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff90a144063a00/0x5fb08b1e5b7627f0 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5fb08b1e5b7627e9 expref: 25 pid: 22781 timeout: 717 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789403571.968342:0:22772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1789403571.968348:0:22771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1789403571.968348:0:22772:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a1442ee300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7ccb4038-daf9-4dcd-9b85-da9390181204+25:3627:x1876325050859520:12345-0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789403571.968355:0:22771:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a1442ed500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7ccb4038-daf9-4dcd-9b85-da9390181204+25:3627:x1876325050859392:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789403571.968356:0:22772:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789403571.968362:0:22771:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789403571.968362:0:22772:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff90a248af1600/0x5fb08b1e5b7627e2 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5fb08b1e5b7627db expref: 25 pid: 22780 timeout: 717 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403571.968366:0:22771:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff90a144063a00/0x5fb08b1e5b7627f0 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5fb08b1e5b7627e9 expref: 25 pid: 22781 timeout: 717 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403571.968370:0:22772:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff90a248af1600/0x5fb08b1e5b7627e2 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5fb08b1e5b7627db expref: 25 pid: 22780 timeout: 717 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789403571.968506:0:22802:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a144049880 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22802:1876325050859136:0@lo:104: 00000100:00100000:1.0:1789403571.968514:0:22802:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a144049180 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:22802:1876325050859264:0@lo:104: 00010000:00010000:3.0:1789403571.969609:0:22771:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff90a144063a00/0x5fb08b1e5b7627f0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5fb08b1e5b7627e9 expref: 25 pid: 22781 timeout: 717 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403571.969702:0:22772:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90a248af1600/0x5fb08b1e5b7627e2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5fb08b1e5b7627db expref: 25 pid: 22780 timeout: 717 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403571.969715:0:22772:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789403571.969822:0:22772:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a1442ee300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:7ccb4038-daf9-4dcd-9b85-da9390181204+24:3627:x1876325050859520:12345-0@lo:103:ldlm_bl.0 Request processed in 1474us (1617us total) trans 0 rc 0/0 00000100:00100000:0.0:1789403571.969843:0:22772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1789403571.970559:0:3627:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a1442ec380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7ccb4038-daf9-4dcd-9b85-da9390181204:3627:1876325050859520:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789403571.974673:0:25105:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a14404ad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:7ccb4038-daf9-4dcd-9b85-da9390181204:25105:1876325050859008:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1789403571.974693:0:25105:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:0.0:1789403571.974696:0:25105:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1789403571.974697:0:25105:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1789403571.974699:0:25105:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789403571.974700:0:25105:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789403571.974701:0:25105:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789403571.974703:0:25105:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789403571.974704:0:25105:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1789403571.974705:0:25105:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789403571.974707:0:25105:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:0.0:1789403571.974721:0:25105:0:(tgt_mount.c:2694:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 00010000:00010000:1.0:1789403571.975766:0:22802:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff90a144062600/0x5fb08b1e5b76286e lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 22802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403571.976035:0:22771:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90a144063a00/0x5fb08b1e5b7627f0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5fb08b1e5b7627e9 expref: 23 pid: 22781 timeout: 717 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403571.976061:0:22771:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff90a144062600/0x5fb08b1e5b76286e lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 22802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403571.976069:0:22771:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90a144062600/0x5fb08b1e5b76286e lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 22802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1789403571.976083:0:22771:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.008954876s 00010000:00010000:3.0:1789403571.976088:0:22771:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff90a144062600/0x5fb08b1e5b76286e lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 22802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403571.976095:0:22771:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff90a144062600/0x5fb08b1e5b76286e lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 22802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403571.976102:0:22771:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff90a144062600/0x5fb08b1e5b76286e lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 22802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403571.976109:0:22771:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff90a144062600/0x5fb08b1e5b76286e lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 22802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403571.976116:0:22771:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a144062600 already unused, calling callback (ffffffffc0c0b8b0) 00010000:00010000:3.0:1789403571.976119:0:22771:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff90a144062600/0x5fb08b1e5b76286e lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 22802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403571.976127:0:22771:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff90a144062600/0x5fb08b1e5b76286e lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 22802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403571.976149:0:22771:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff90a144062600/0x5fb08b1e5b76286e lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403571.976160:0:22771:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789403571.976263:0:22802:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff90a144062600/0x5fb08b1e5b76286e lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403571.976272:0:22802:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff90a144062600/0x5fb08b1e5b76286e lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403571.976279:0:22802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90a144062600/0x5fb08b1e5b76286e lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 22802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789403571.976343:0:22771:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a1442ed500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:7ccb4038-daf9-4dcd-9b85-da9390181204+22:3627:x1876325050859392:12345-0@lo:103:ldlm_bl.0 Request processed in 7986us (8094us total) trans 0 rc 0/0 00000100:00100000:3.0:1789403571.976353:0:22771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1789403571.976512:0:3627:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a1442ef100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7ccb4038-daf9-4dcd-9b85-da9390181204:3627:1876325050859392:0@lo:103:ldlm_bl.0 00000001:00000004:0.0:1789403571.976908:0:25105:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 3, last_transno is 12884901888 00002000:00080000:0.0:1789403571.981658:0:25105:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:0.0:1789403571.981668:0:25105:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:0.0:1789403571.981703:0:25105:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:0.0:1789403571.981761:0:25105:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.143@tcp: cl_mgc_mutex unlock 00000020:01000004:0.0:1789403571.981779:0:25105:0:(tgt_mount.c:2460:server_fill_super_common()) Server sb, dev=50 00000080:00000004:0.0:1789403571.981798:0:25105:0:(super25.c:182:lustre_fill_super()) /dev/mapper/ost2_flakey: Mount complete 00000020:00000004:0.0:1789403571.982445:0:25105:0:(tgt_mount.c:2346:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1789403571.985254:0:25105:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 10000000:01000000:1.0:1789403572.978656:0:22783:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1789403572.978663:0:22783:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff90a144165800 from 14 10000000:01000000:1.0:1789403572.978668:0:22783:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1789403572.978708:0:22783:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.143@tcp lock: ffff90a144062600/0x5fb08b1e5b762875 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403572.978720:0:22783:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.143@tcp lock: ffff90a144062600/0x5fb08b1e5b762875 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403572.978731:0:22783:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.143@tcp lock: ffff90a144062600/0x5fb08b1e5b762875 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789403572.978754:0:22783:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a144049180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7ccb4038-daf9-4dcd-9b85-da9390181204:22783:1876325050859648:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1789403572.978810:0:22783:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789403572.978851:0:22783:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a1441aa3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789403572.981106:0:22778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050859648 00000100:00100000:0.0:1789403572.981120:0:22778:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050859648 00000100:00100000:0.0:1789403572.981187:0:22778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:0.0:1789403572.981206:0:22778:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a27c941c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7ccb4038-daf9-4dcd-9b85-da9390181204+22:22783:x1876325050859648:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789403572.981222:0:22778:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789403572.981242:0:22778:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90a248af1600/0x5fb08b1e5b76287c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x5fb08b1e5b762875 expref: -99 pid: 22778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403572.981289:0:22778:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90a248af1600/0x5fb08b1e5b76287c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5fb08b1e5b762875 expref: 23 pid: 22778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403572.981300:0:22778:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90a248af1600/0x5fb08b1e5b76287c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5fb08b1e5b762875 expref: 23 pid: 22778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403572.981310:0:22778:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a248af1600, rc 0) 00000100:00100000:0.0:1789403572.981384:0:22778:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a27c941c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7ccb4038-daf9-4dcd-9b85-da9390181204+23:22783:x1876325050859648:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 180us (2572us total) trans 0 rc 0/0 00000100:00100000:0.0:1789403572.981405:0:22778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:1.0:1789403572.981515:0:22783:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a144049180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7ccb4038-daf9-4dcd-9b85-da9390181204:22783:1876325050859648:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789403572.981540:0:22783:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.143@tcp lock: ffff90a144062600/0x5fb08b1e5b762875 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb08b1e5b76287c expref: -99 pid: 22783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403572.981550:0:22783:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.143@tcp lock: ffff90a144062600/0x5fb08b1e5b762875 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x5fb08b1e5b76287c expref: -99 pid: 22783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789403572.981611:0:22783:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a144049180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7ccb4038-daf9-4dcd-9b85-da9390181204:22783:1876325050859776:0@lo:256:ll_cfg_requeue.0 00000100:00100000:1.0:1789403572.981649:0:22783:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789403572.981683:0:22783:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a1441aa3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789403572.982282:0:22780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050859776 00000100:00100000:0.0:1789403572.982290:0:22780:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050859776 00000100:00100000:0.0:1789403572.982322:0:22780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:0.0:1789403572.982329:0:22780:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a27c943050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7ccb4038-daf9-4dcd-9b85-da9390181204+23:22783:x1876325050859776:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:0.0:1789403572.982345:0:22780:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1789403572.982358:0:22780:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1789403572.982362:0:22780:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 14 00000100:00100000:0.0:1789403572.982462:0:22780:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a27c943050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7ccb4038-daf9-4dcd-9b85-da9390181204+23:22783:x1876325050859776:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 133us (812us total) trans 0 rc 0/0 00000100:00100000:0.0:1789403572.982469:0:22780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:0.0:1789403572.982505:0:22783:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a144049180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7ccb4038-daf9-4dcd-9b85-da9390181204:22783:1876325050859776:0@lo:256:ll_cfg_requeue.0 00010000:00010000:1.0:1789403572.982539:0:22775:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1789403572.982564:0:22783:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.143@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1789403572.982572:0:22783:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.143@tcp lock: ffff90a144062600/0x5fb08b1e5b762875 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb08b1e5b76287c expref: -99 pid: 22783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403572.982580:0:22783:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.143@tcp lock: ffff90a144062600/0x5fb08b1e5b762875 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb08b1e5b76287c expref: -99 pid: 22783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789403572.982594:0:22783:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1789403572.982596:0:22783:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff90a144559800 from 14 10000000:01000000:0.0:1789403572.982599:0:22783:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1789403572.982620:0:22783:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.143@tcp lock: ffff90a248af1800/0x5fb08b1e5b762883 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403572.982628:0:22783:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.143@tcp lock: ffff90a248af1800/0x5fb08b1e5b762883 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403572.982636:0:22783:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.143@tcp lock: ffff90a248af1800/0x5fb08b1e5b762883 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789403572.982652:0:22783:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a1442ec380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7ccb4038-daf9-4dcd-9b85-da9390181204:22783:1876325050859904:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1789403572.982676:0:22783:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789403572.982708:0:22783:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a25990de40 going to sleep for 11 seconds 00000100:00100000:1.0:1789403572.982767:0:22778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050859904 00000100:00100000:1.0:1789403572.982771:0:22778:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050859904 00000100:00100000:1.0:1789403572.982801:0:22778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:1.0:1789403572.982807:0:22778:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a27c942050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7ccb4038-daf9-4dcd-9b85-da9390181204+23:22783:x1876325050859904:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789403572.982815:0:22778:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789403572.982825:0:22778:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90a144063e00/0x5fb08b1e5b76288a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x5fb08b1e5b762883 expref: -99 pid: 22778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403572.982841:0:22778:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90a144063e00/0x5fb08b1e5b76288a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5fb08b1e5b762883 expref: 24 pid: 22778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403572.982850:0:22778:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90a144063e00/0x5fb08b1e5b76288a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5fb08b1e5b762883 expref: 24 pid: 22778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403572.982856:0:22778:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a144063e00, rc 0) 00000100:00100000:1.0:1789403572.982900:0:22778:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a27c942050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7ccb4038-daf9-4dcd-9b85-da9390181204+24:22783:x1876325050859904:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 93us (223us total) trans 0 rc 0/0 00000100:00100000:1.0:1789403572.982907:0:22778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:0.0:1789403572.983045:0:22783:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a1442ec380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7ccb4038-daf9-4dcd-9b85-da9390181204:22783:1876325050859904:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789403572.983058:0:22783:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.143@tcp lock: ffff90a248af1800/0x5fb08b1e5b762883 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb08b1e5b76288a expref: -99 pid: 22783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403572.983066:0:22783:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.143@tcp lock: ffff90a248af1800/0x5fb08b1e5b762883 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x5fb08b1e5b76288a expref: -99 pid: 22783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789403572.983104:0:22783:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a1442ec380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7ccb4038-daf9-4dcd-9b85-da9390181204:22783:1876325050860032:0@lo:256:ll_cfg_requeue.0 00000100:00100000:0.0:1789403572.983131:0:22783:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789403572.983154:0:22783:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a25990de40 going to sleep for 11 seconds 00000100:00100000:1.0:1789403572.983999:0:22781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050860032 00000100:00100000:1.0:1789403572.984008:0:22781:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050860032 00000100:00100000:1.0:1789403572.984050:0:22781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:1.0:1789403572.984058:0:22781:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a27c940850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7ccb4038-daf9-4dcd-9b85-da9390181204+24:22783:x1876325050860032:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:1.0:1789403572.984073:0:22781:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1789403572.984089:0:22781:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1789403572.984092:0:22781:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 14 00000100:00100000:1.0:1789403572.984177:0:22781:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a27c940850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7ccb4038-daf9-4dcd-9b85-da9390181204+24:22783:x1876325050860032:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 120us (1045us total) trans 0 rc 0/0 00000100:00100000:1.0:1789403572.984184:0:22781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:0.0:1789403572.984305:0:22783:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a1442ec380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7ccb4038-daf9-4dcd-9b85-da9390181204:22783:1876325050860032:0@lo:256:ll_cfg_requeue.0 10000000:01000000:0.0:1789403572.984354:0:22783:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.143@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1789403572.984366:0:22783:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.143@tcp lock: ffff90a248af1800/0x5fb08b1e5b762883 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb08b1e5b76288a expref: -99 pid: 22783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403572.984375:0:22783:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.143@tcp lock: ffff90a248af1800/0x5fb08b1e5b762883 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb08b1e5b76288a expref: -99 pid: 22783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00000004:0.0:1789403573.092207:0:25172:0:(tgt_mount.c:2346:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1789403573.092550:0:25172:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:2.0:1789403573.489568:0:3629:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1789403573.489590:0:3629:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a281911880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3629:1876325050860160:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1789403573.489658:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789403573.489712:0:22791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050860160 00000100:00100000:3.0:1789403573.489721:0:22791:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050860160 00000100:00100000:3.0:1789403573.489768:0:22791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1789403573.489777:0:22791:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a281912a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3629:x1876325050860160:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1789403573.489807:0:22791:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:3.0:1789403573.489853:0:22791:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a281912a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3629:x1876325050860160:12345-0@lo:41:osp-pre-1-0.0 Request processed in 77us (195us total) trans 0 rc 0/0 00000100:00100000:3.0:1789403573.489861:0:22791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1789403573.489918:0:3629:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a281911880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3629:1876325050860160:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1789403573.491491:0:3629:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a281913480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3629:1876325050860288:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1789403573.491560:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789403573.491750:0:3627:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789403573.491761:0:3627:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a1442ec380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3627:1876325050860416:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1789403573.491794:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789403573.491944:0:24294:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050860288 00000100:00100000:1.0:1789403573.491951:0:24294:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050860288 00000100:00100000:1.0:1789403573.492005:0:24294:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1789403573.492015:0:24294:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a1443e4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3629:x1876325050860288:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1789403573.492040:0:24294:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3915849728 avail 3684327424 00000100:00100000:0.0:1789403573.492092:0:22792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050860416 00000100:00100000:0.0:1789403573.492096:0:22792:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050860416 00000100:00100000:0.0:1789403573.492124:0:22792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1789403573.492139:0:22792:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a1442ef100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3627:x1876325050860416:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1789403573.492161:0:22792:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446309888 avail 1300070400 00000100:00100000:0.0:1789403573.492199:0:22792:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a1442ef100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3627:x1876325050860416:12345-0@lo:41:osp-pre-0-1.0 Request processed in 68us (403us total) trans 0 rc 0/0 00000100:00100000:0.0:1789403573.492206:0:22792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1789403573.492259:0:3627:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a1442ec380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3627:1876325050860416:0@lo:41:osp-pre-0-1.0 00000100:00080000:0.0:1789403573.492991:0:22782:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789403573.505715:0:24294:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a1443e4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3629:x1876325050860288:12345-0@lo:13:osp-pre-0-1.0 Request processed in 13693us (14146us total) trans 0 rc 0/0 00000100:00100000:1.0:1789403573.505730:0:24294:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:3.0:1789403573.506019:0:3629:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90a281913480 x1876325050860288/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789403589 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789403573.506042:0:3629:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a281913480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3629:1876325050860288:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1789403574.001607:0:3625:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789403554/real 1789403554] req@ffff90a141aad880 x1876325050846208/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789403574 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789403574.001648:0:3625:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff90a141aad880 x1876325050846208/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789403574 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789403574.001676:0:3625:0:(client.c:2504:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789403554/real 1789403554] req@ffff90a141aac380 x1876325050846336/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789403574 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789403574.001689:0:3625:0:(client.c:2535:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff90a141aac380 x1876325050846336/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789403574 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1789403574.001706:0:3625:0:(import.c:65:import_set_state_nolock()) ffff90a143719000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1789403574.001725:0:3625:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:2.0:1789403574.001729:0:3625:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a141aad880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3625:1876325050846208:0@lo:8:kworker.0 00000100:00080000:2.0:1789403574.001735:0:3625:0:(import.c:65:import_set_state_nolock()) ffff90a2488fd000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1789403574.001740:0:3625:0:(import.c:1556:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:2.0:1789403574.001743:0:3625:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a141aac380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3625:1876325050846336:0@lo:8:kworker.0 00000100:00080000:3.0:1789403574.001803:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1789403574.001807:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:3.0:1789403574.001810:0:37:0:(import.c:65:import_set_state_nolock()) ffff90a143719000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00010000:00010000:2.0:1789403574.001810:0:22774:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1789403574.001814:0:37:0:(import.c:545:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 600 00000100:00080000:3.0:1789403574.001819:0:37:0:(import.c:630:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 15s 00000100:00080000:3.0:1789403574.001828:0:37:0:(import.c:666:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff90a143719000 using connection 192.168.203.143@tcp/0@lo 00000100:00100000:3.0:1789403574.001847:0:37:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff90a1443e4a80 x1876325050860672/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1789403574.001890:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1789403574.001893:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1789403574.001895:0:37:0:(import.c:65:import_set_state_nolock()) ffff90a2488fd000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1789403574.001899:0:37:0:(import.c:545:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 600 00000100:00080000:3.0:1789403574.001902:0:37:0:(import.c:630:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 15s 00000100:00080000:3.0:1789403574.001907:0:37:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff90a2488fd000 using connection 192.168.203.143@tcp/0@lo 00000100:00100000:3.0:1789403574.001925:0:37:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff90a1443e6d80 x1876325050860800/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1789403574.001948:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1789403574.001951:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1789403574.001952:0:37:0:(import.c:65:import_set_state_nolock()) ffff90a26d291800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1789403574.001957:0:37:0:(import.c:666:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff90a26d291800 using connection 192.168.203.143@tcp/0@lo 00000100:00100000:3.0:1789403574.001966:0:37:0:(import.c:871:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff90a1443e6300 x1876325050861056/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1789403574.002076:0:3629:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a1443e7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3629:1876325050861184:0@lo:400:kworker.0 00000100:00100000:3.0:1789403574.002130:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789403574.002158:0:3629:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a141aac380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3629:1876325050861696:0@lo:400:kworker.0 00000100:00100000:3.0:1789403574.002183:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789403574.002198:0:3629:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:3.0:1789403574.002203:0:3629:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a1443e4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3629:1876325050860928:0@lo:400:kworker.0 00000100:00100000:3.0:1789403574.002221:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789403574.002235:0:3629:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a1443e6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3629:1876325050861568:0@lo:400:kworker.0 00000100:00100000:3.0:1789403574.002374:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789403574.002749:0:3627:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a1443e5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7ccb4038-daf9-4dcd-9b85-da9390181204:3627:1876325050860544:0@lo:400:kworker.0 00000100:00100000:0.0:1789403574.002783:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789403574.002810:0:3627:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a1443e7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3627:1876325050861440:0@lo:400:kworker.0 00000100:00100000:0.0:1789403574.002832:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789403574.002844:0:3627:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789403574.002850:0:3627:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a1443e7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3627:1876325050861312:0@lo:400:kworker.0 00000100:00100000:0.0:1789403574.002892:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789403574.002923:0:22780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050860544 00000100:00100000:0.0:1789403574.002931:0:22780:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050860544 00000100:00100000:0.0:1789403574.002971:0:22780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:0.0:1789403574.002980:0:22780:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a27c941450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7ccb4038-daf9-4dcd-9b85-da9390181204+24:3627:x1876325050860544:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789403574.003027:0:22780:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a27c941450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7ccb4038-daf9-4dcd-9b85-da9390181204+24:3627:x1876325050860544:12345-0@lo:400:kworker.0 Request processed in 48us (243us total) trans 0 rc 0/0 00000100:00100000:0.0:1789403574.003034:0:22780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:0.0:1789403574.003078:0:3627:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a1443e5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7ccb4038-daf9-4dcd-9b85-da9390181204:3627:1876325050860544:0@lo:400:kworker.0 00000100:00100000:2.0:1789403574.003186:0:22788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050861184 00000100:00100000:2.0:1789403574.003191:0:22788:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050861184 00000100:00100000:2.0:1789403574.003214:0:22788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050861696 00000100:00100000:2.0:1789403574.003217:0:22788:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050861696 00000100:00100000:2.0:1789403574.003236:0:22788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050860928 00000100:00100000:2.0:1789403574.003239:0:22788:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050860928 00000100:00100000:2.0:1789403574.003250:0:22788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050861568 00000100:00100000:2.0:1789403574.003252:0:22788:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050861568 00000100:00100000:2.0:1789403574.003263:0:22788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050861440 00000100:00100000:2.0:1789403574.003265:0:22788:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050861440 00000100:00100000:2.0:1789403574.003274:0:22788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050861312 00000100:00100000:2.0:1789403574.003276:0:22788:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050861312 00000100:00100000:2.0:1789403574.003289:0:22788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1789403574.003296:0:22788:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a141aad880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3629:x1876325050861184:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789403574.003342:0:22788:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a141aad880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3629:x1876325050861184:12345-0@lo:400:kworker.0 Request processed in 46us (1211us total) trans 0 rc 0/0 00000100:00100000:2.0:1789403574.003355:0:22788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1789403574.003370:0:22788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1789403574.003375:0:22788:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a141aaf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3629:x1876325050861696:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789403574.003428:0:22788:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a141aaf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3629:x1876325050861696:12345-0@lo:400:kworker.0 Request processed in 53us (1243us total) trans 0 rc 0/0 00000100:00100000:2.0:1789403574.003433:0:22788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1789403574.003445:0:22788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1789403574.003450:0:22788:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a141aadc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3629:x1876325050860928:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789403574.003476:0:22788:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a141aadc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3629:x1876325050860928:12345-0@lo:400:kworker.0 Request processed in 26us (1254us total) trans 0 rc 0/0 00000100:00100000:2.0:1789403574.003480:0:22788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1789403574.003503:0:22788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1789403574.003509:0:22788:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a141aac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3629:x1876325050861568:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789403574.003535:0:22788:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a141aac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3629:x1876325050861568:12345-0@lo:400:kworker.0 Request processed in 27us (1161us total) trans 0 rc 0/0 00000100:00100000:2.0:1789403574.003540:0:22788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1789403574.003551:0:22788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1789403574.003556:0:22788:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a1442ec380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3627:x1876325050861440:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789403574.003585:0:22788:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a1442ec380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3627:x1876325050861440:12345-0@lo:400:kworker.0 Request processed in 30us (753us total) trans 0 rc 0/0 00000100:00100000:2.0:1789403574.003591:0:22788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1789403574.003601:0:22788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1789403574.003607:0:22788:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a1442edf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3627:x1876325050861312:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789403574.003631:0:22788:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a1442edf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3627:x1876325050861312:12345-0@lo:400:kworker.0 Request processed in 25us (738us total) trans 0 rc 0/0 00000100:00100000:2.0:1789403574.003643:0:22788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00010000:00080000:2.0:1789403574.003681:0:3627:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90a1443e7b80 x1876325050861312/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789403590 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789403574.003692:0:3627:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a1443e7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3627:1876325050861312:0@lo:400:kworker.0 00010000:00080000:2.0:1789403574.003701:0:3627:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90a1443e7100 x1876325050861440/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789403590 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789403574.003709:0:3627:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a1443e7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3627:1876325050861440:0@lo:400:kworker.0 00000100:00100000:2.0:1789403574.003729:0:3625:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a1443e4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3625:1876325050860672:0@lo:8:kworker.0 00000100:00100000:2.0:1789403574.003755:0:3625:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789403574.003775:0:3625:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a1443e6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3625:1876325050860800:0@lo:8:kworker.0 00000100:00100000:2.0:1789403574.003799:0:3625:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789403574.003817:0:3625:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a1443e6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3625:1876325050861056:0@lo:8:kworker.0 00000100:00100000:2.0:1789403574.003838:0:3625:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789403574.003865:0:24290:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050860672 00000100:00100000:2.0:1789403574.003869:0:24290:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050860672 00000100:00100000:2.0:1789403574.003898:0:24290:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050860800 00000100:00100000:2.0:1789403574.003901:0:24290:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050860800 00000100:00100000:2.0:1789403574.003909:0:24290:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050861056 00000100:00100000:2.0:1789403574.003912:0:24290:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050861056 00000100:00100000:2.0:1789403574.003920:0:24290:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1789403574.003924:0:24290:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a281913800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3625:x1876325050860672:12345-0@lo:8:kworker.0 00000100:00100000:3.0:1789403574.004052:0:24926:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1789403574.004058:0:24926:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a281911500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:3625:x1876325050860800:12345-0@lo:8:kworker.0 00010000:00080000:3.0:1789403574.004076:0:24926:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 620 last 0 00000020:00000080:3.0:1789403574.004104:0:24926:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x5fb08b1e5b762891 00002000:00100000:3.0:1789403574.004118:0:24926:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff90a1426d1000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a27 ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:3.0:1789403574.004123:0:24926:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00002000:00100000:3.0:1789403574.004126:0:24926:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:3.0:1789403574.004300:0:24926:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:3.0:1789403574.004323:0:24926:0:(import.c:65:import_set_state_nolock()) ffff90a1426d5000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1789403574.004367:0:24926:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a281911500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3625:x1876325050860800:12345-0@lo:8:kworker.0 Request processed in 308us (566us total) trans 0 rc 0/0 00000100:00100000:3.0:1789403574.004374:0:24926:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1789403574.004503:0:24926:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1789403574.004508:0:24926:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a281910e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:3625:x1876325050861056:12345-0@lo:8:kworker.0 00010000:00080000:3.0:1789403574.004524:0:24926:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 620 last 0 00000020:00000080:3.0:1789403574.004541:0:24926:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0x5fb08b1e5b762898 00002000:00100000:3.0:1789403574.004548:0:24926:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0001-mdtlov_UUID/ffff90a1426d2800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a27 ocd_grant: 0 ocd_index: 1 ocd_group 1 00002000:00080000:3.0:1789403574.004551:0:24926:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 1 00002000:00100000:3.0:1789403574.004553:0:24926:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:3.0:1789403574.004578:0:24926:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 1 00000100:00080000:3.0:1789403574.004590:0:24926:0:(import.c:65:import_set_state_nolock()) ffff90a1426d5800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1789403574.004617:0:24926:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a281910e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:3625:x1876325050861056:12345-0@lo:8:kworker.0 Request processed in 108us (778us total) trans 0 rc 0/0 00000100:00100000:3.0:1789403574.004624:0:24926:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00080000:3.0:1789403574.004655:0:3629:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90a1443e4e00 x1876325050860928/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789403590 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789403574.004678:0:3629:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a1443e4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3629:1876325050860928:0@lo:400:kworker.0 00010000:00080000:3.0:1789403574.004691:0:3629:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90a1443e6680 x1876325050861568/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789403590 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789403574.004698:0:3629:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a1443e6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3629:1876325050861568:0@lo:400:kworker.0 00010000:00080000:3.0:1789403574.004708:0:3629:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90a1443e7480 x1876325050861184/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789403590 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789403574.004714:0:3629:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a1443e7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3629:1876325050861184:0@lo:400:kworker.0 00010000:00080000:3.0:1789403574.004723:0:3629:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90a141aac380 x1876325050861696/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789403590 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789403574.004730:0:3629:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a141aac380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3629:1876325050861696:0@lo:400:kworker.0 00010000:00080000:3.0:1789403574.004789:0:3625:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90a1443e6d80 x1876325050860800/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1789403599 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789403574.004796:0:3625:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1789403574.004801:0:3625:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 3 00000100:00080000:3.0:1789403574.004808:0:3625:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:3.0:1789403574.004813:0:3625:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:3.0:1789403574.004815:0:3625:0:(import.c:65:import_set_state_nolock()) ffff90a2488fd000 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:3.0:1789403574.004836:0:3625:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:3.0:1789403574.004841:0:3625:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a1443e6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3625:1876325050860800:0@lo:8:kworker.0 00010000:00080000:3.0:1789403574.004856:0:3625:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90a1443e6300 x1876325050861056/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/416 e 0 to 0 dl 1789403599 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1789403574.004865:0:3625:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0001: connect to target with instance 3 00000100:00080000:3.0:1789403574.004888:0:3625:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0001: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:3.0:1789403574.004891:0:3625:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:3.0:1789403574.004893:0:3625:0:(import.c:65:import_set_state_nolock()) ffff90a26d291800 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:3.0:1789403574.004904:0:3625:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:3.0:1789403574.004910:0:3625:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a1443e6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3625:1876325050861056:0@lo:8:kworker.0 00000004:00080000:3.0:1789403574.004958:0:22813:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x2c0000401:0x5:0x0] 00000100:00100000:3.0:1789403574.004975:0:22813:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a141aaed80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:22813:1876325050861952:0@lo:5:osp-pre-1-0.0 00000100:00100000:3.0:1789403574.005001:0:22813:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789403574.005015:0:22813:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a26d146000 going to sleep for 11 seconds 00000100:00100000:3.0:1789403574.005033:0:24926:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050861952 00000100:00100000:3.0:1789403574.005037:0:24926:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050861952 00000100:00100000:3.0:1789403574.005065:0:24926:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1789403574.005071:0:24926:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a141aace00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:22813:x1876325050861952:12345-0@lo:5:osp-pre-1-0.0 00000100:00100000:3.0:1789403574.005272:0:3627:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789403574.005282:0:3627:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a141aac380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3627:1876325050861824:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789403574.005309:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1789403574.005519:0:22782:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789403574.005524:0:22782:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789403574.005526:0:22782:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1789403574.005551:0:24295:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050861824 00000100:00100000:0.0:1789403574.005555:0:24295:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050861824 00000100:00100000:0.0:1789403574.005587:0:24295:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1789403574.005595:0:24295:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a141aad500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3627:x1876325050861824:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789403574.005614:0:24295:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923513344 avail 3691991040 00000100:00100000:0.0:1789403574.005655:0:24295:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a141aad500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3627:x1876325050861824:12345-0@lo:13:osp-pre-1-0.0 Request processed in 60us (344us total) trans 0 rc 0/0 00000100:00100000:0.0:1789403574.005661:0:24295:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:0.0:1789403574.005689:0:3627:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90a141aac380 x1876325050861824/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789403590 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789403574.005704:0:3627:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a141aac380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3627:1876325050861824:0@lo:13:osp-pre-1-0.0 00000004:00080000:0.0:1789403574.005817:0:23530:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0001: going to cleanup orphans since [0x2c0000400:0x1:0x0] 00000100:00100000:0.0:1789403574.005833:0:23530:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a1443e6300 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:23530:1876325050862208:0@lo:7:osp-pre-1-1.0 00000100:00100000:0.0:1789403574.005869:0:23530:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789403574.005898:0:23530:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a25990dcc0 going to sleep for 11 seconds 00000004:00080000:0.0:1789403574.005914:0:22812:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:0.0:1789403574.005978:0:22812:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 620004588314ns, next at 0ns, rc = 0 00080000:00080000:0.0:1789403574.005984:0:22812:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0000: async commit OSD 00000100:00100000:0.0:1789403574.006001:0:3626:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789403574.006008:0:3626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a1442ef800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3626:1876325050862080:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1789403574.006030:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789403574.006141:0:24293:0:(service.c:3467:ptlrpc_start_thread()) ost[0] started 4 min 3 max 116 00000100:00100000:0.0:1789403574.006149:0:24293:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost00_004' 00000100:00100000:0.0:1789403574.006215:0:24295:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050862080 00000100:00100000:0.0:1789403574.006220:0:24295:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050862080 00000100:00100000:0.0:1789403574.006245:0:24295:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1789403574.006252:0:24295:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a1443e7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3626:x1876325050862080:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1789403574.006265:0:24295:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923513344 avail 3691991040 00000100:00100000:0.0:1789403574.006324:0:24295:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a1443e7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3626:x1876325050862080:12345-0@lo:13:osp-pre-1-1.0 Request processed in 72us (293us total) trans 0 rc 0/0 00000100:00100000:0.0:1789403574.006330:0:24295:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00080000:0.0:1789403574.006344:0:22782:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:0.0:1789403574.006362:0:3626:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90a1442ef800 x1876325050862080/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789403590 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789403574.006374:0:3626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a1442ef800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3626:1876325050862080:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1789403574.006519:0:24293:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050862208 00000100:00100000:0.0:1789403574.006523:0:24293:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050862208 00000004:00080000:1.0:1789403574.006846:0:23529:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:1.0:1789403574.006914:0:23529:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 620005524571ns, next at 0ns, rc = 0 00080000:00080000:1.0:1789403574.006920:0:23529:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0001: async commit OSD 00010000:00080000:2.0:1789403574.008823:0:24290:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 620 last 0 00000020:00000080:2.0:1789403574.008860:0:24290:0:(genops.c:1384:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x5fb08b1e5b76289f 00002000:00100000:2.0:1789403574.008884:0:24290:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff90a276e12000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113a27 ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:2.0:1789403574.008896:0:24290:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00002000:00100000:2.0:1789403574.008899:0:24290:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:2.0:1789403574.008967:0:24290:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1789403574.008996:0:24290:0:(import.c:65:import_set_state_nolock()) ffff90a276e11000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1789403574.009083:0:24290:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a281913800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3625:x1876325050860672:12345-0@lo:8:kworker.0 Request processed in 5156us (5325us total) trans 0 rc 0/0 00000100:00100000:2.0:1789403574.009094:0:24290:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1789403574.009118:0:24290:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1789403574.009128:0:24290:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a1443e6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:23530:x1876325050862208:12345-0@lo:7:osp-pre-1-1.0 00000004:00080000:0.0:1789403574.009983:0:22766:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00010000:00080000:3.0:1789403574.010126:0:3625:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90a1443e4a80 x1876325050860672/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1789403599 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789403574.010137:0:3625:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1789403574.010146:0:3625:0:(import.c:1177:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 3 00000100:00080000:3.0:1789403574.010155:0:3625:0:(import.c:1001:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:3.0:1789403574.010160:0:3625:0:(import.c:1258:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:3.0:1789403574.010163:0:3625:0:(import.c:65:import_set_state_nolock()) ffff90a143719000 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:3.0:1789403574.010177:0:3625:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:3.0:1789403574.010182:0:3625:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a1443e4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3625:1876325050860672:0@lo:8:kworker.0 00000004:00080000:3.0:1789403574.010242:0:22811:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x280000401:0x22:0x0] 00000100:00100000:3.0:1789403574.010271:0:22811:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a144bedc00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:22811:1876325050862464:0@lo:5:osp-pre-0-0.0 00000100:00100000:3.0:1789403574.010317:0:22811:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789403574.010340:0:22811:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a26d146a80 going to sleep for 11 seconds 00000100:00100000:3.0:1789403574.010354:0:3628:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a141aac380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3628:1876325050862336:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789403574.010378:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789403574.010445:0:24292:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050862464 00000100:00100000:3.0:1789403574.010451:0:24292:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050862464 00000100:00100000:3.0:1789403574.010505:0:24292:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1789403574.010514:0:24292:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a144bed880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:22811:x1876325050862464:12345-0@lo:5:osp-pre-0-0.0 00000100:00100000:3.0:1789403574.010883:0:24295:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050862336 00000100:00100000:3.0:1789403574.010889:0:24295:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050862336 00000100:00100000:3.0:1789403574.010917:0:24295:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1789403574.010924:0:24295:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a144bec700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3628:x1876325050862336:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789403574.010937:0:24295:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3915849728 avail 3684327424 00000100:00100000:3.0:1789403574.010982:0:24295:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a144bec700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3628:x1876325050862336:12345-0@lo:13:osp-pre-0-0.0 Request processed in 59us (603us total) trans 0 rc 0/0 00000100:00100000:3.0:1789403574.010989:0:24295:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00080000:3.0:1789403574.011008:0:22782:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1789403574.011062:0:3628:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90a141aac380 x1876325050862336/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789403590 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789403574.011078:0:3628:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a141aac380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3628:1876325050862336:0@lo:13:osp-pre-0-0.0 00000004:00080000:1.0:1789403574.011621:0:22810:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:1.0:1789403574.011927:0:22810:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 620010537166ns, next at 0ns, rc = 0 00080000:00080000:1.0:1789403574.011934:0:22810:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0000: async commit OSD 00000004:00080000:1.0:1789403574.014060:0:23519:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 1 committed 00000004:00080000:1.0:1789403574.016809:0:22766:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00002000:00080000:3.0:1789403574.019467:0:24292:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x280000401 00002000:00080000:3.0:1789403574.019479:0:24292:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 65 -> diff = -31 00002000:02000040:3.0:1789403574.021760:0:24292:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000401:35 to 0x280000401:65) 00002000:00080000:1.0:1789403574.028444:0:24926:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x2c0000401 00002000:00080000:1.0:1789403574.028459:0:24926:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 65 -> diff = -60 00002000:02000040:1.0:1789403574.028465:0:24926:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x2c0000401:6 to 0x2c0000401:65) 00002000:00080000:0.0:1789403574.032812:0:24290:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x2c0000400 00002000:00080000:0.0:1789403574.032821:0:24290:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0001: LAST FID is [0x2c0000400:0x41:0x0] 00000100:00100000:0.0:1789403574.032918:0:24290:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a1443e6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:23530:x1876325050862208:12345-0@lo:7:osp-pre-1-1.0 Request processed in 23789us (27044us total) trans 0 rc 0/0 00000100:00100000:0.0:1789403574.032936:0:24290:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00080000:0.0:1789403574.032997:0:23530:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90a1443e6300 x1876325050862208/t0(0) o7->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 264/240 e 0 to 0 dl 1789403590 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789403574.033012:0:23530:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a1443e6300 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:23530:1876325050862208:0@lo:7:osp-pre-1-1.0 00000004:00080000:0.0:1789403574.033026:0:23530:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0001-osc-MDT0001: Got last_fid [0x2c0000400:0x41:0x0] 00000100:00100000:0.0:1789403574.033064:0:23530:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a1443e6300 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:23530:1876325050862592:0@lo:5:osp-pre-1-1.0 00000100:00100000:0.0:1789403574.033099:0:23530:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789403574.033122:0:23530:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a142675900 going to sleep for 11 seconds 00000100:00100000:0.0:1789403574.033139:0:25213:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050862592 00000100:00100000:0.0:1789403574.033146:0:25213:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050862592 00000100:00100000:0.0:1789403574.033190:0:25213:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1789403574.033198:0:25213:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a1443e6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+6:23530:x1876325050862592:12345-0@lo:5:osp-pre-1-1.0 00002000:00080000:0.0:1789403574.033224:0:25213:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 65 -> diff = 0 00000100:00100000:0.0:1789403574.033253:0:25213:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a1443e6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0001-mdtlov_UUID+6:23530:x1876325050862592:12345-0@lo:5:osp-pre-1-1.0 Request processed in 56us (156us total) trans 0 rc 0/0 00000100:00100000:0.0:1789403574.033260:0:25213:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00080000:0.0:1789403574.033282:0:23530:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90a1443e6300 x1876325050862592/t0(0) o5->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1789403590 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789403574.033292:0:23530:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a1443e6300 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:23530:1876325050862592:0@lo:5:osp-pre-1-1.0 00000004:00080000:0.0:1789403574.033300:0:23530:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0001: Got last_id [0x2c0000400:0x41:0x0] from OST, last_created [0x2c0000400:0x41:0x0]last_used is [0x2c0000400:0x41:0x0] 00000100:00100000:0.0:1789403574.033323:0:23530:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a1443e6300 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:23530:1876325050862720:0@lo:5:osp-pre-1-1.0 00000100:00100000:0.0:1789403574.033345:0:23530:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789403574.033358:0:23530:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a142675900 going to sleep for 11 seconds 00000100:00100000:0.0:1789403574.033369:0:24290:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050862720 00000100:00100000:0.0:1789403574.033379:0:24290:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050862720 00000100:00100000:0.0:1789403574.033419:0:24290:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1789403574.033426:0:24290:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a1443e4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:23530:x1876325050862720:12345-0@lo:5:osp-pre-1-1.0 00002000:00080000:0.0:1789403574.033449:0:24290:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000400 at 66 00002000:00010000:2.0:1789403574.044177:0:24292:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x41:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1789403574.044192:0:24292:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006afa2c86/0x5fb08b1e5b7628a6 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403574.044210:0:24292:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x41:0x0].0x0 since=620s v=(0 0) 00010000:00010000:2.0:1789403574.044215:0:24292:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x41:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789403574.044221:0:24292:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006afa2c86/0x5fb08b1e5b7628a6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403574.044238:0:24292:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006afa2c86/0x5fb08b1e5b7628a6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403574.044248:0:24292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006afa2c86/0x5fb08b1e5b7628a6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403574.044255:0:24292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006afa2c86/0x5fb08b1e5b7628a6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403574.044288:0:24292:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1789403574.051606:0:24292:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x40:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1789403574.051624:0:24292:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003840e913/0x5fb08b1e5b7628ad lrc: 3/0,1 mode: --/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403574.051734:0:24292:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x40:0x0].0x0 since=620s v=(0 0) 00010000:00010000:0.0:1789403574.051740:0:24292:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x40:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789403574.051747:0:24292:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003840e913/0x5fb08b1e5b7628ad lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403574.051770:0:24292:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003840e913/0x5fb08b1e5b7628ad lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403574.051783:0:24292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003840e913/0x5fb08b1e5b7628ad lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403574.051791:0:24292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003840e913/0x5fb08b1e5b7628ad lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403574.051819:0:24292:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1789403574.051837:0:22774:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1789403574.051844:0:22774:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006afa2c86/0x5fb08b1e5b7628a6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403574.051869:0:22774:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a270184c00 already unused, calling callback (ffffffffc0c0b8b0) 00010000:00010000:0.0:1789403574.051874:0:22774:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006afa2c86/0x5fb08b1e5b7628a6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403574.051894:0:22774:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006afa2c86/0x5fb08b1e5b7628a6 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403574.051911:0:22774:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006afa2c86/0x5fb08b1e5b7628a6 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403574.051919:0:22774:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006afa2c86/0x5fb08b1e5b7628a6 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403574.051944:0:22774:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789403574.051948:0:22774:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003840e913/0x5fb08b1e5b7628ad lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403574.051955:0:22774:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a2821e9c00 already unused, calling callback (ffffffffc0c0b8b0) 00010000:00010000:0.0:1789403574.051958:0:22774:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003840e913/0x5fb08b1e5b7628ad lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403574.051965:0:22774:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003840e913/0x5fb08b1e5b7628ad lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403574.051975:0:22774:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003840e913/0x5fb08b1e5b7628ad lrc: 1/0,0 mode: --/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403574.051989:0:22774:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003840e913/0x5fb08b1e5b7628ad lrc: 0/0,0 mode: --/PW res: [0x280000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403574.052014:0:22774:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789403574.052016:0:22774:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789403574.052018:0:22774:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789403574.052414:0:22775:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1789403574.059794:0:24292:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1789403574.059806:0:24292:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000895a45f/0x5fb08b1e5b7628b4 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403574.059824:0:24292:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3f:0x0].0x0 since=620s v=(0 0) 00010000:00010000:0.0:1789403574.059829:0:24292:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789403574.059835:0:24292:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000895a45f/0x5fb08b1e5b7628b4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403574.059849:0:24292:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000895a45f/0x5fb08b1e5b7628b4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403574.059860:0:24292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000895a45f/0x5fb08b1e5b7628b4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403574.059867:0:24292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000895a45f/0x5fb08b1e5b7628b4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403574.059897:0:24292:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789403574.059909:0:22774:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789403574.059920:0:22774:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000895a45f/0x5fb08b1e5b7628b4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403574.059928:0:22774:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a2821e9000 already unused, calling callback (ffffffffc0c0b8b0) 00010000:00010000:0.0:1789403574.059933:0:22774:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000895a45f/0x5fb08b1e5b7628b4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403574.059942:0:22774:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000895a45f/0x5fb08b1e5b7628b4 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403574.059958:0:22774:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000895a45f/0x5fb08b1e5b7628b4 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403574.059966:0:22774:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000895a45f/0x5fb08b1e5b7628b4 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403574.059984:0:22774:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789403574.059986:0:22774:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789403574.059988:0:22774:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1789403574.060785:0:24292:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1789403574.060793:0:24292:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c53f1154/0x5fb08b1e5b7628bb lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403574.060803:0:24292:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3e:0x0].0x0 since=620s v=(0 0) 00010000:00010000:0.0:1789403574.060807:0:24292:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789403574.060812:0:24292:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c53f1154/0x5fb08b1e5b7628bb lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403574.060834:0:24292:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c53f1154/0x5fb08b1e5b7628bb lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403574.060843:0:24292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c53f1154/0x5fb08b1e5b7628bb lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403574.060851:0:24292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c53f1154/0x5fb08b1e5b7628bb lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403574.060884:0:24292:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789403574.060915:0:22775:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789403574.060923:0:22775:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c53f1154/0x5fb08b1e5b7628bb lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403574.060940:0:22775:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a2821e8400 already unused, calling callback (ffffffffc0c0b8b0) 00010000:00010000:3.0:1789403574.060944:0:22775:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c53f1154/0x5fb08b1e5b7628bb lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403574.060954:0:22775:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c53f1154/0x5fb08b1e5b7628bb lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403574.060971:0:22775:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c53f1154/0x5fb08b1e5b7628bb lrc: 1/0,0 mode: --/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403574.060978:0:22775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c53f1154/0x5fb08b1e5b7628bb lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403574.060999:0:22775:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789403574.061000:0:22775:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789403574.061002:0:22775:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1789403574.061618:0:24292:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1789403574.061627:0:24292:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000076bdfda/0x5fb08b1e5b7628c2 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403574.061644:0:24292:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3d:0x0].0x0 since=620s v=(0 0) 00010000:00010000:2.0:1789403574.061649:0:24292:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789403574.061654:0:24292:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000076bdfda/0x5fb08b1e5b7628c2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403574.061665:0:24292:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000076bdfda/0x5fb08b1e5b7628c2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403574.061673:0:24292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000076bdfda/0x5fb08b1e5b7628c2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403574.061681:0:24292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000076bdfda/0x5fb08b1e5b7628c2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403574.061698:0:24292:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789403574.061822:0:22774:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789403574.061828:0:22774:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000076bdfda/0x5fb08b1e5b7628c2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403574.061836:0:22774:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a270184e00 already unused, calling callback (ffffffffc0c0b8b0) 00010000:00010000:2.0:1789403574.061847:0:22774:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000076bdfda/0x5fb08b1e5b7628c2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403574.061857:0:22774:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000076bdfda/0x5fb08b1e5b7628c2 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403574.061871:0:22774:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000076bdfda/0x5fb08b1e5b7628c2 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403574.061888:0:22774:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000076bdfda/0x5fb08b1e5b7628c2 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403574.061905:0:22774:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789403574.061907:0:22774:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789403574.061909:0:22774:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1789403574.064289:0:24292:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1789403574.064300:0:24292:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000071370c7b/0x5fb08b1e5b7628c9 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403574.064315:0:24292:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3c:0x0].0x0 since=620s v=(0 0) 00010000:00010000:0.0:1789403574.064320:0:24292:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789403574.064325:0:24292:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000071370c7b/0x5fb08b1e5b7628c9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403574.064341:0:24292:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000071370c7b/0x5fb08b1e5b7628c9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403574.064351:0:24292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000071370c7b/0x5fb08b1e5b7628c9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403574.064371:0:24292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000071370c7b/0x5fb08b1e5b7628c9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403574.064411:0:24292:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789403574.064423:0:22775:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789403574.064429:0:22775:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000071370c7b/0x5fb08b1e5b7628c9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403574.064437:0:22775:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a2821e9800 already unused, calling callback (ffffffffc0c0b8b0) 00010000:00010000:0.0:1789403574.064441:0:22775:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000071370c7b/0x5fb08b1e5b7628c9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403574.064450:0:22775:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000071370c7b/0x5fb08b1e5b7628c9 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403574.064464:0:22775:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000071370c7b/0x5fb08b1e5b7628c9 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403574.064473:0:22775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000071370c7b/0x5fb08b1e5b7628c9 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403574.064499:0:22775:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789403574.064501:0:22775:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789403574.064503:0:22775:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1789403574.065249:0:24292:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1789403574.065266:0:24292:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f1018bf1/0x5fb08b1e5b7628d0 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403574.065277:0:24292:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3b:0x0].0x0 since=620s v=(0 0) 00010000:00010000:0.0:1789403574.065282:0:24292:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789403574.065287:0:24292:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f1018bf1/0x5fb08b1e5b7628d0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403574.065298:0:24292:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f1018bf1/0x5fb08b1e5b7628d0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403574.065306:0:24292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f1018bf1/0x5fb08b1e5b7628d0 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403574.065313:0:24292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f1018bf1/0x5fb08b1e5b7628d0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403574.065330:0:24292:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789403574.065340:0:22774:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789403574.065345:0:22774:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f1018bf1/0x5fb08b1e5b7628d0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403574.065353:0:22774:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a2821e9600 already unused, calling callback (ffffffffc0c0b8b0) 00010000:00010000:0.0:1789403574.065357:0:22774:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f1018bf1/0x5fb08b1e5b7628d0 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403574.065364:0:22774:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f1018bf1/0x5fb08b1e5b7628d0 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403574.065384:0:22774:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f1018bf1/0x5fb08b1e5b7628d0 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403574.065411:0:22774:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f1018bf1/0x5fb08b1e5b7628d0 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403574.065426:0:22774:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789403574.065428:0:22774:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789403574.065430:0:22774:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1789403574.066462:0:24292:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1789403574.066472:0:24292:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004b53c252/0x5fb08b1e5b7628d7 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403574.066965:0:24292:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3a:0x0].0x0 since=620s v=(0 0) 00010000:00010000:0.0:1789403574.066972:0:24292:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789403574.066979:0:24292:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004b53c252/0x5fb08b1e5b7628d7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403574.066993:0:24292:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004b53c252/0x5fb08b1e5b7628d7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403574.067004:0:24292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004b53c252/0x5fb08b1e5b7628d7 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403574.067012:0:24292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004b53c252/0x5fb08b1e5b7628d7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403574.067053:0:24292:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789403574.067262:0:22775:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789403574.067269:0:22775:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004b53c252/0x5fb08b1e5b7628d7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403574.067278:0:22775:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a2821e8800 already unused, calling callback (ffffffffc0c0b8b0) 00010000:00010000:2.0:1789403574.067283:0:22775:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004b53c252/0x5fb08b1e5b7628d7 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403574.067293:0:22775:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004b53c252/0x5fb08b1e5b7628d7 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403574.067307:0:22775:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004b53c252/0x5fb08b1e5b7628d7 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403574.067322:0:22775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004b53c252/0x5fb08b1e5b7628d7 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403574.067341:0:22775:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789403574.067343:0:22775:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789403574.067345:0:22775:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789403574.068838:0:24292:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x39:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789403574.068861:0:24292:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000029fc8110/0x5fb08b1e5b7628de lrc: 3/0,1 mode: --/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403574.068885:0:24292:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x39:0x0].0x0 since=620s v=(0 0) 00010000:00010000:3.0:1789403574.068891:0:24292:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x39:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789403574.068898:0:24292:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000029fc8110/0x5fb08b1e5b7628de lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403574.068911:0:24292:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000029fc8110/0x5fb08b1e5b7628de lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403574.068929:0:24292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000029fc8110/0x5fb08b1e5b7628de lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403574.068937:0:24292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000029fc8110/0x5fb08b1e5b7628de lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403574.068958:0:24292:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789403574.069729:0:22774:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789403574.069739:0:22774:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000029fc8110/0x5fb08b1e5b7628de lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403574.069749:0:22774:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a259946000 already unused, calling callback (ffffffffc0c0b8b0) 00010000:00010000:0.0:1789403574.069754:0:22774:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000029fc8110/0x5fb08b1e5b7628de lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403574.069763:0:22774:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000029fc8110/0x5fb08b1e5b7628de lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403574.069782:0:22774:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000029fc8110/0x5fb08b1e5b7628de lrc: 1/0,0 mode: --/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403574.069789:0:22774:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000029fc8110/0x5fb08b1e5b7628de lrc: 0/0,0 mode: --/PW res: [0x280000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403574.069808:0:22774:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789403574.069809:0:22774:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789403574.069811:0:22774:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1789403574.070314:0:24292:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x38:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1789403574.070322:0:24292:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001780ca0f/0x5fb08b1e5b7628e5 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403574.070334:0:24292:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x38:0x0].0x0 since=620s v=(0 0) 00010000:00010000:0.0:1789403574.070345:0:24292:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x38:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789403574.070351:0:24292:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001780ca0f/0x5fb08b1e5b7628e5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403574.070361:0:24292:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001780ca0f/0x5fb08b1e5b7628e5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403574.070370:0:24292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001780ca0f/0x5fb08b1e5b7628e5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403574.070378:0:24292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001780ca0f/0x5fb08b1e5b7628e5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403574.070414:0:24292:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1789403574.070895:0:24292:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x37:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1789403574.070902:0:24292:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a59d08b2/0x5fb08b1e5b7628ec lrc: 3/0,1 mode: --/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403574.070911:0:24292:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x37:0x0].0x0 since=620s v=(0 0) 00010000:00010000:0.0:1789403574.070915:0:24292:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x37:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789403574.070919:0:24292:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a59d08b2/0x5fb08b1e5b7628ec lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403574.070929:0:24292:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a59d08b2/0x5fb08b1e5b7628ec lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403574.070937:0:24292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a59d08b2/0x5fb08b1e5b7628ec lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403574.070950:0:24292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a59d08b2/0x5fb08b1e5b7628ec lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403574.070966:0:24292:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1789403574.070976:0:22774:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1789403574.070981:0:22774:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001780ca0f/0x5fb08b1e5b7628e5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403574.071277:0:22775:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789403574.073923:0:22774:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a2821e9400 already unused, calling callback (ffffffffc0c0b8b0) 00010000:00010000:0.0:1789403574.073931:0:22774:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001780ca0f/0x5fb08b1e5b7628e5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403574.073944:0:22774:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001780ca0f/0x5fb08b1e5b7628e5 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403574.073965:0:22774:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001780ca0f/0x5fb08b1e5b7628e5 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403574.073973:0:22774:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001780ca0f/0x5fb08b1e5b7628e5 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403574.073999:0:22774:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789403574.074001:0:22774:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789403574.074003:0:22774:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789403574.074373:0:25221:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789403574.074403:0:22775:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a59d08b2/0x5fb08b1e5b7628ec lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403574.074412:0:22775:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a2821e8e00 already unused, calling callback (ffffffffc0c0b8b0) 00010000:00010000:0.0:1789403574.074415:0:22775:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a59d08b2/0x5fb08b1e5b7628ec lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403574.074423:0:22775:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a59d08b2/0x5fb08b1e5b7628ec lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403574.074435:0:22775:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a59d08b2/0x5fb08b1e5b7628ec lrc: 1/0,0 mode: --/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403574.074442:0:22775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a59d08b2/0x5fb08b1e5b7628ec lrc: 0/0,0 mode: --/PW res: [0x280000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403574.074457:0:22775:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789403574.074458:0:22775:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789403574.074460:0:22775:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789403574.074465:0:25221:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789403574.074466:0:25221:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789403574.075466:0:24292:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x36:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789403574.075477:0:24292:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000723f05bd/0x5fb08b1e5b7628f3 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403574.075491:0:24292:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x36:0x0].0x0 since=620s v=(0 0) 00010000:00010000:3.0:1789403574.075495:0:24292:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x36:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789403574.075500:0:24292:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000723f05bd/0x5fb08b1e5b7628f3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403574.075513:0:24292:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000723f05bd/0x5fb08b1e5b7628f3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403574.075523:0:24292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000723f05bd/0x5fb08b1e5b7628f3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403574.075531:0:24292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000723f05bd/0x5fb08b1e5b7628f3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403574.075673:0:24292:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789403574.075802:0:22774:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789403574.075808:0:22774:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000723f05bd/0x5fb08b1e5b7628f3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403574.075816:0:22774:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a259946a00 already unused, calling callback (ffffffffc0c0b8b0) 00010000:00010000:3.0:1789403574.075820:0:22774:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000723f05bd/0x5fb08b1e5b7628f3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403574.075830:0:22774:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000723f05bd/0x5fb08b1e5b7628f3 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403574.075927:0:22774:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000723f05bd/0x5fb08b1e5b7628f3 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403574.075936:0:22774:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000723f05bd/0x5fb08b1e5b7628f3 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403574.075951:0:22774:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789403574.075953:0:22774:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789403574.075955:0:22774:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789403574.076027:0:24292:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x35:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789403574.076032:0:24292:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000de63ff95/0x5fb08b1e5b7628fa lrc: 3/0,1 mode: --/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403574.076040:0:24292:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x35:0x0].0x0 since=620s v=(0 0) 00010000:00010000:3.0:1789403574.076049:0:24292:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x35:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789403574.076053:0:24292:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000de63ff95/0x5fb08b1e5b7628fa lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403574.076063:0:24292:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000de63ff95/0x5fb08b1e5b7628fa lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403574.076071:0:24292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000de63ff95/0x5fb08b1e5b7628fa lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403574.076077:0:24292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000de63ff95/0x5fb08b1e5b7628fa lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403574.076193:0:24292:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1789403574.076762:0:24292:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x34:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789403574.076769:0:24292:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000026e19e37/0x5fb08b1e5b762901 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403574.076780:0:24292:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x34:0x0].0x0 since=620s v=(0 0) 00010000:00010000:3.0:1789403574.076784:0:24292:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x34:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789403574.076788:0:24292:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000026e19e37/0x5fb08b1e5b762901 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403574.076798:0:24292:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000026e19e37/0x5fb08b1e5b762901 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403574.076806:0:24292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000026e19e37/0x5fb08b1e5b762901 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403574.076820:0:24292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000026e19e37/0x5fb08b1e5b762901 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1789403574.077964:0:24926:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x41:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1789403574.077974:0:24926:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000077d35c53/0x5fb08b1e5b762908 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403574.077987:0:24926:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x41:0x0].0x0 since=620s v=(0 0) 00010000:00010000:1.0:1789403574.077991:0:24926:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x41:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789403574.077996:0:24926:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000077d35c53/0x5fb08b1e5b762908 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403574.078010:0:24926:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000077d35c53/0x5fb08b1e5b762908 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403574.078019:0:24926:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000077d35c53/0x5fb08b1e5b762908 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403574.078028:0:24926:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000077d35c53/0x5fb08b1e5b762908 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403574.079481:0:22775:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1789403574.079495:0:22775:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000de63ff95/0x5fb08b1e5b7628fa lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403574.079508:0:22775:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a259947000 already unused, calling callback (ffffffffc0c0b8b0) 00010000:00010000:2.0:1789403574.079513:0:22775:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000de63ff95/0x5fb08b1e5b7628fa lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403574.079523:0:22775:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000de63ff95/0x5fb08b1e5b7628fa lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403574.079541:0:22775:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000de63ff95/0x5fb08b1e5b7628fa lrc: 1/0,0 mode: --/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403574.079548:0:22775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000de63ff95/0x5fb08b1e5b7628fa lrc: 0/0,0 mode: --/PW res: [0x280000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403574.081151:0:24292:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1789403574.081167:0:22775:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1789403574.081174:0:22775:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000026e19e37/0x5fb08b1e5b762901 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403574.081186:0:22775:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a259946200 already unused, calling callback (ffffffffc0c0b8b0) 00010000:00010000:3.0:1789403574.081190:0:22775:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000026e19e37/0x5fb08b1e5b762901 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403574.081201:0:22775:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000026e19e37/0x5fb08b1e5b762901 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403574.081217:0:22775:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000026e19e37/0x5fb08b1e5b762901 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403574.081224:0:22775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000026e19e37/0x5fb08b1e5b762901 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403574.081243:0:22775:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789403574.081247:0:22775:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000077d35c53/0x5fb08b1e5b762908 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403574.081265:0:22775:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a144063600 already unused, calling callback (ffffffffc0c0b8b0) 00010000:00010000:3.0:1789403574.081268:0:22775:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000077d35c53/0x5fb08b1e5b762908 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403574.081277:0:22775:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000077d35c53/0x5fb08b1e5b762908 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403574.081291:0:22775:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000077d35c53/0x5fb08b1e5b762908 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403574.081299:0:22775:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789403574.081301:0:22775:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789403574.081303:0:22775:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789403574.082243:0:24292:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x33:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789403574.082252:0:24292:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000027f777b/0x5fb08b1e5b76290f lrc: 3/0,1 mode: --/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403574.082265:0:24292:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x33:0x0].0x0 since=620s v=(0 0) 00010000:00010000:3.0:1789403574.082269:0:24292:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x33:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789403574.082275:0:24292:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000027f777b/0x5fb08b1e5b76290f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403574.082287:0:24292:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000027f777b/0x5fb08b1e5b76290f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403574.082295:0:24292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000027f777b/0x5fb08b1e5b76290f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403574.082308:0:24292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000027f777b/0x5fb08b1e5b76290f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403574.082327:0:24292:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789403574.082337:0:22774:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789403574.082341:0:22774:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000027f777b/0x5fb08b1e5b76290f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403574.082349:0:22774:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a259946e00 already unused, calling callback (ffffffffc0c0b8b0) 00010000:00010000:3.0:1789403574.082354:0:22774:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000027f777b/0x5fb08b1e5b76290f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403574.082362:0:22774:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000027f777b/0x5fb08b1e5b76290f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403574.082374:0:22774:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000027f777b/0x5fb08b1e5b76290f lrc: 1/0,0 mode: --/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403574.082381:0:22774:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000027f777b/0x5fb08b1e5b76290f lrc: 0/0,0 mode: --/PW res: [0x280000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403574.082418:0:22774:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789403574.082420:0:22774:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789403574.082421:0:22774:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789403574.082858:0:25221:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789403574.083237:0:24292:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x32:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1789403574.083252:0:24292:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bdd1f942/0x5fb08b1e5b762916 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403574.083263:0:24292:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x32:0x0].0x0 since=620s v=(0 0) 00010000:00010000:3.0:1789403574.083267:0:24292:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x32:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789403574.083271:0:24292:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bdd1f942/0x5fb08b1e5b762916 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403574.083282:0:24292:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000bdd1f942/0x5fb08b1e5b762916 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403574.083290:0:24292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bdd1f942/0x5fb08b1e5b762916 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403574.083299:0:24292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000bdd1f942/0x5fb08b1e5b762916 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403574.083355:0:24292:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789403574.084042:0:24926:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789403574.084051:0:24926:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000077d35c53/0x5fb08b1e5b762908 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x41:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403574.086013:0:22774:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789403574.086025:0:22774:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000bdd1f942/0x5fb08b1e5b762916 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403574.086037:0:22774:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a259947800 already unused, calling callback (ffffffffc0c0b8b0) 00010000:00010000:3.0:1789403574.086042:0:22774:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000bdd1f942/0x5fb08b1e5b762916 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403574.086053:0:22774:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000bdd1f942/0x5fb08b1e5b762916 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403574.086080:0:22774:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000bdd1f942/0x5fb08b1e5b762916 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403574.086088:0:22774:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000bdd1f942/0x5fb08b1e5b762916 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403574.086108:0:22774:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789403574.086111:0:22774:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789403574.086113:0:22774:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1789403574.089023:0:24926:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x40:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00002000:00010000:1.0:1789403574.089023:0:24292:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x31:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1789403574.089039:0:24292:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000358a8467/0x5fb08b1e5b762924 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403574.089049:0:24926:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f1eb3cd1/0x5fb08b1e5b76291d lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403574.089060:0:24292:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x31:0x0].0x0 since=620s v=(0 0) 00010000:00010000:2.0:1789403574.089062:0:24926:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x40:0x0].0x0 since=620s v=(0 0) 00010000:00010000:2.0:1789403574.089067:0:24926:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x40:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789403574.089075:0:24926:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f1eb3cd1/0x5fb08b1e5b76291d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403574.089075:0:24292:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x31:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789403574.089085:0:24292:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000358a8467/0x5fb08b1e5b762924 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403574.089102:0:24292:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000358a8467/0x5fb08b1e5b762924 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403574.089112:0:24292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000358a8467/0x5fb08b1e5b762924 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403574.089119:0:24292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000358a8467/0x5fb08b1e5b762924 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403574.089140:0:24292:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789403574.089168:0:24926:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f1eb3cd1/0x5fb08b1e5b76291d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403574.089179:0:24926:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f1eb3cd1/0x5fb08b1e5b76291d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403574.089188:0:24926:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f1eb3cd1/0x5fb08b1e5b76291d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403574.089208:0:24926:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:2.0:1789403574.089994:0:24926:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1789403574.090003:0:24926:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003f5996ef/0x5fb08b1e5b76292b lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403574.090014:0:24926:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3f:0x0].0x0 since=620s v=(0 0) 00010000:00010000:2.0:1789403574.090019:0:24926:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789403574.090024:0:24926:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003f5996ef/0x5fb08b1e5b76292b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403574.090035:0:24926:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003f5996ef/0x5fb08b1e5b76292b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403574.090053:0:24926:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003f5996ef/0x5fb08b1e5b76292b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403574.090060:0:24926:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000003f5996ef/0x5fb08b1e5b76292b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403574.090071:0:24926:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00002000:00010000:2.0:1789403574.090821:0:24926:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1789403574.090837:0:24926:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000132bbff1/0x5fb08b1e5b762932 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403574.090986:0:24926:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3e:0x0].0x0 since=620s v=(0 0) 00010000:00010000:2.0:1789403574.090990:0:24926:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789403574.090996:0:24926:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000132bbff1/0x5fb08b1e5b762932 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403574.091006:0:24926:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000132bbff1/0x5fb08b1e5b762932 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403574.091015:0:24926:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000132bbff1/0x5fb08b1e5b762932 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403574.091021:0:24926:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000132bbff1/0x5fb08b1e5b762932 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403574.091042:0:24926:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00002000:00010000:2.0:1789403574.091808:0:24926:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1789403574.091816:0:24926:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006434f158/0x5fb08b1e5b762939 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403574.091828:0:24926:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3d:0x0].0x0 since=620s v=(0 0) 00010000:00010000:2.0:1789403574.091831:0:24926:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789403574.091836:0:24926:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006434f158/0x5fb08b1e5b762939 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403574.091857:0:24926:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006434f158/0x5fb08b1e5b762939 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403574.091865:0:24926:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006434f158/0x5fb08b1e5b762939 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403574.091872:0:24926:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006434f158/0x5fb08b1e5b762939 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403574.091893:0:24926:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to regular blp list, 5 blwis in pool 00002000:00010000:2.0:1789403574.092173:0:24926:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1789403574.092179:0:24926:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005034bd84/0x5fb08b1e5b762940 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403574.092186:0:24926:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3c:0x0].0x0 since=620s v=(0 0) 00010000:00010000:2.0:1789403574.092195:0:24926:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789403574.092199:0:24926:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005034bd84/0x5fb08b1e5b762940 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403574.092208:0:24926:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005034bd84/0x5fb08b1e5b762940 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403574.092216:0:24926:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005034bd84/0x5fb08b1e5b762940 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403574.092223:0:24926:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005034bd84/0x5fb08b1e5b762940 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403574.092229:0:24926:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/6 locks to regular blp list, 6 blwis in pool 00002000:00010000:2.0:1789403574.092726:0:24926:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1789403574.092733:0:24926:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000073484d97/0x5fb08b1e5b762947 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403574.092743:0:24926:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3b:0x0].0x0 since=620s v=(0 0) 00010000:00010000:2.0:1789403574.092747:0:24926:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789403574.092750:0:24926:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000073484d97/0x5fb08b1e5b762947 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403574.092759:0:24926:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000073484d97/0x5fb08b1e5b762947 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403574.092768:0:24926:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000073484d97/0x5fb08b1e5b762947 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1789403574.092778:0:24292:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x30:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1789403574.092785:0:24926:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000073484d97/0x5fb08b1e5b762947 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403574.092789:0:24292:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007545d323/0x5fb08b1e5b76294e lrc: 3/0,1 mode: --/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403574.092806:0:24926:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/7 locks to regular blp list, 7 blwis in pool 00010000:00010000:1.0:1789403574.092808:0:24292:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x30:0x0].0x0 since=620s v=(0 0) 00010000:00010000:1.0:1789403574.092813:0:24292:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x30:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789403574.092817:0:24292:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007545d323/0x5fb08b1e5b76294e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403574.092828:0:24292:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007545d323/0x5fb08b1e5b76294e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403574.092837:0:24292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007545d323/0x5fb08b1e5b76294e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403574.092852:0:24292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007545d323/0x5fb08b1e5b76294e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403574.092862:0:24292:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/8 locks to regular blp list, 8 blwis in pool 00010000:00010000:0.0:1789403574.093168:0:22775:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 7 total in blp. (7 blwis in pool) 00010000:00010000:0.0:1789403574.093177:0:22775:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000358a8467/0x5fb08b1e5b762924 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403574.093185:0:22775:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a144063c00 already unused, calling callback (ffffffffc0c0b8b0) 00010000:00010000:0.0:1789403574.093190:0:22775:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000358a8467/0x5fb08b1e5b762924 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403574.093207:0:22775:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000358a8467/0x5fb08b1e5b762924 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403574.093224:0:22775:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000358a8467/0x5fb08b1e5b762924 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403574.093232:0:22775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000358a8467/0x5fb08b1e5b762924 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403574.093248:0:22775:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 6 total in blp. (6 blwis in pool) 00010000:00010000:0.0:1789403574.093252:0:22775:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f1eb3cd1/0x5fb08b1e5b76291d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403574.093259:0:22775:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a270185c00 already unused, calling callback (ffffffffc0c0b8b0) 00010000:00010000:0.0:1789403574.093262:0:22775:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f1eb3cd1/0x5fb08b1e5b76291d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403574.093270:0:22775:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f1eb3cd1/0x5fb08b1e5b76291d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403574.093283:0:22775:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f1eb3cd1/0x5fb08b1e5b76291d lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403574.093290:0:22775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f1eb3cd1/0x5fb08b1e5b76291d lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x40:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403574.093314:0:22775:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 5 total in blp. (5 blwis in pool) 00010000:00010000:0.0:1789403574.093318:0:22775:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000003f5996ef/0x5fb08b1e5b76292b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403574.093324:0:22775:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a270185a00 already unused, calling callback (ffffffffc0c0b8b0) 00010000:00010000:0.0:1789403574.093327:0:22775:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000003f5996ef/0x5fb08b1e5b76292b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403574.093335:0:22775:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000003f5996ef/0x5fb08b1e5b76292b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403574.093347:0:22775:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000003f5996ef/0x5fb08b1e5b76292b lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403574.093353:0:22775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003f5996ef/0x5fb08b1e5b76292b lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403574.093364:0:22775:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:0.0:1789403574.093367:0:22775:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000132bbff1/0x5fb08b1e5b762932 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403574.093373:0:22775:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a270185000 already unused, calling callback (ffffffffc0c0b8b0) 00010000:00010000:0.0:1789403574.093376:0:22775:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000132bbff1/0x5fb08b1e5b762932 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403574.093409:0:22775:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000132bbff1/0x5fb08b1e5b762932 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403574.093420:0:22775:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000132bbff1/0x5fb08b1e5b762932 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403574.093427:0:22775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000132bbff1/0x5fb08b1e5b762932 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403574.093441:0:22775:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:0.0:1789403574.093444:0:22775:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006434f158/0x5fb08b1e5b762939 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403574.093452:0:22775:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a270185e00 already unused, calling callback (ffffffffc0c0b8b0) 00010000:00010000:0.0:1789403574.093454:0:22775:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006434f158/0x5fb08b1e5b762939 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403574.093461:0:22775:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006434f158/0x5fb08b1e5b762939 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403574.093471:0:22775:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006434f158/0x5fb08b1e5b762939 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403574.093478:0:22775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006434f158/0x5fb08b1e5b762939 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403574.093579:0:22775:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1789403574.093583:0:22775:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005034bd84/0x5fb08b1e5b762940 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403574.093595:0:22775:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a270184600 already unused, calling callback (ffffffffc0c0b8b0) 00010000:00010000:0.0:1789403574.093598:0:22775:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005034bd84/0x5fb08b1e5b762940 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403574.093606:0:22775:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005034bd84/0x5fb08b1e5b762940 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403574.093617:0:22775:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005034bd84/0x5fb08b1e5b762940 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403574.093623:0:22775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005034bd84/0x5fb08b1e5b762940 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403574.093636:0:22775:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1789403574.093639:0:22775:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000073484d97/0x5fb08b1e5b762947 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403574.093646:0:22775:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a270184000 already unused, calling callback (ffffffffc0c0b8b0) 00010000:00010000:0.0:1789403574.093650:0:22775:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000073484d97/0x5fb08b1e5b762947 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403574.093670:0:22775:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000073484d97/0x5fb08b1e5b762947 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403574.093680:0:22775:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000073484d97/0x5fb08b1e5b762947 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403574.093687:0:22775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000073484d97/0x5fb08b1e5b762947 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403574.093701:0:22775:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789403574.093704:0:22775:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007545d323/0x5fb08b1e5b76294e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403574.093711:0:22775:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a144062800 already unused, calling callback (ffffffffc0c0b8b0) 00010000:00010000:0.0:1789403574.093714:0:22775:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007545d323/0x5fb08b1e5b76294e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403574.093722:0:22775:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007545d323/0x5fb08b1e5b76294e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403574.093732:0:22775:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007545d323/0x5fb08b1e5b76294e lrc: 1/0,0 mode: --/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403574.093740:0:22775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007545d323/0x5fb08b1e5b76294e lrc: 0/0,0 mode: --/PW res: [0x280000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403574.093764:0:22775:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789403574.093766:0:22775:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789403574.093768:0:22775:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789403574.093776:0:25221:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1789403574.094012:0:24926:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1789403574.094027:0:24926:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000370686c/0x5fb08b1e5b762955 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403574.094038:0:24926:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3a:0x0].0x0 since=620s v=(0 0) 00010000:00010000:2.0:1789403574.094048:0:24926:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789403574.094054:0:24926:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000370686c/0x5fb08b1e5b762955 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403574.094067:0:24926:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000370686c/0x5fb08b1e5b762955 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403574.094081:0:24926:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000370686c/0x5fb08b1e5b762955 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403574.094088:0:24926:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000000370686c/0x5fb08b1e5b762955 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403574.094122:0:24926:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1789403574.094642:0:24292:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1789403574.094649:0:24292:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008e534efb/0x5fb08b1e5b76295c lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403574.094659:0:24292:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2f:0x0].0x0 since=620s v=(0 0) 00010000:00010000:1.0:1789403574.094663:0:24292:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789403574.094667:0:24292:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008e534efb/0x5fb08b1e5b76295c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403574.094676:0:24292:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008e534efb/0x5fb08b1e5b76295c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403574.094684:0:24292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008e534efb/0x5fb08b1e5b76295c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403574.094690:0:24292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008e534efb/0x5fb08b1e5b76295c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403574.094702:0:24292:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1789403574.094890:0:22775:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1789403574.094896:0:22775:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000000370686c/0x5fb08b1e5b762955 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403574.094906:0:22775:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a270184400 already unused, calling callback (ffffffffc0c0b8b0) 00010000:00010000:0.0:1789403574.094911:0:22775:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000000370686c/0x5fb08b1e5b762955 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403574.094920:0:22775:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000000370686c/0x5fb08b1e5b762955 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403574.094934:0:22775:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000000370686c/0x5fb08b1e5b762955 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403574.094942:0:22775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000370686c/0x5fb08b1e5b762955 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403574.094960:0:22775:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789403574.094964:0:22775:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008e534efb/0x5fb08b1e5b76295c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403574.094970:0:22775:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a144062e00 already unused, calling callback (ffffffffc0c0b8b0) 00010000:00010000:0.0:1789403574.094979:0:22775:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008e534efb/0x5fb08b1e5b76295c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403574.094987:0:22775:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008e534efb/0x5fb08b1e5b76295c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403574.094999:0:22775:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008e534efb/0x5fb08b1e5b76295c lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403574.095007:0:22775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008e534efb/0x5fb08b1e5b76295c lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403574.095020:0:22775:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789403574.095021:0:22775:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789403574.095022:0:22775:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789403574.095028:0:25221:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789403574.095738:0:24292:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1789403574.095747:0:24292:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d9a42056/0x5fb08b1e5b762963 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403574.095766:0:24292:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2e:0x0].0x0 since=620s v=(0 0) 00010000:00010000:1.0:1789403574.095770:0:24292:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789403574.095776:0:24292:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d9a42056/0x5fb08b1e5b762963 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403574.095787:0:24292:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d9a42056/0x5fb08b1e5b762963 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403574.095797:0:24292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d9a42056/0x5fb08b1e5b762963 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403574.095805:0:24292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d9a42056/0x5fb08b1e5b762963 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403574.095818:0:24292:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1789403574.097990:0:24292:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1789403574.098004:0:24292:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000005f3f00f/0x5fb08b1e5b76296a lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403574.098020:0:24292:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2d:0x0].0x0 since=620s v=(0 0) 00010000:00010000:1.0:1789403574.098024:0:24292:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789403574.098031:0:24292:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000005f3f00f/0x5fb08b1e5b76296a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403574.098046:0:24292:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000005f3f00f/0x5fb08b1e5b76296a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403574.098068:0:24292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000005f3f00f/0x5fb08b1e5b76296a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403574.098076:0:24292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000005f3f00f/0x5fb08b1e5b76296a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403574.098107:0:24292:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1789403574.098246:0:25221:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1789403574.098254:0:25221:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d9a42056/0x5fb08b1e5b762963 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403574.098270:0:25221:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a144063a00 already unused, calling callback (ffffffffc0c0b8b0) 00010000:00010000:2.0:1789403574.098274:0:25221:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d9a42056/0x5fb08b1e5b762963 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403574.098284:0:25221:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d9a42056/0x5fb08b1e5b762963 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403574.098543:0:25221:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d9a42056/0x5fb08b1e5b762963 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403574.098562:0:25221:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d9a42056/0x5fb08b1e5b762963 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403574.098582:0:25221:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789403574.098586:0:25221:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000005f3f00f/0x5fb08b1e5b76296a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403574.098593:0:25221:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a144063200 already unused, calling callback (ffffffffc0c0b8b0) 00010000:00010000:2.0:1789403574.098596:0:25221:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000005f3f00f/0x5fb08b1e5b76296a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403574.098612:0:25221:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000005f3f00f/0x5fb08b1e5b76296a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403574.098624:0:25221:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000005f3f00f/0x5fb08b1e5b76296a lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403574.098638:0:25221:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000005f3f00f/0x5fb08b1e5b76296a lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403574.098651:0:25221:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789403574.098653:0:25221:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789403574.098655:0:25221:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789403574.099912:0:24292:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1789403574.099925:0:24292:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000941637f5/0x5fb08b1e5b762971 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403574.099939:0:24292:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2c:0x0].0x0 since=620s v=(0 0) 00010000:00010000:1.0:1789403574.100016:0:24292:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789403574.100022:0:24292:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000941637f5/0x5fb08b1e5b762971 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403574.100037:0:24292:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000941637f5/0x5fb08b1e5b762971 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403574.100047:0:24292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000941637f5/0x5fb08b1e5b762971 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403574.100055:0:24292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000941637f5/0x5fb08b1e5b762971 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403574.100088:0:24292:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1789403574.100773:0:24926:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x39:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1789403574.100782:0:24926:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a59d08b2/0x5fb08b1e5b762978 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403574.100793:0:24926:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x39:0x0].0x0 since=620s v=(0 0) 00010000:00010000:0.0:1789403574.100797:0:24926:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x39:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789403574.100801:0:24926:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a59d08b2/0x5fb08b1e5b762978 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403574.100812:0:24926:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a59d08b2/0x5fb08b1e5b762978 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403574.100834:0:24926:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a59d08b2/0x5fb08b1e5b762978 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403574.100842:0:24926:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a59d08b2/0x5fb08b1e5b762978 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403574.100851:0:24926:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1789403574.101054:0:22775:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1789403574.101061:0:22775:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000941637f5/0x5fb08b1e5b762971 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403574.101070:0:22775:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a281b04e00 already unused, calling callback (ffffffffc0c0b8b0) 00010000:00010000:0.0:1789403574.101074:0:22775:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000941637f5/0x5fb08b1e5b762971 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403574.101083:0:22775:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000941637f5/0x5fb08b1e5b762971 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403574.101098:0:22775:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000941637f5/0x5fb08b1e5b762971 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403574.101105:0:22775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000941637f5/0x5fb08b1e5b762971 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403574.101123:0:22775:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789403574.101131:0:22775:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a59d08b2/0x5fb08b1e5b762978 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403574.101138:0:22775:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a2821e8e00 already unused, calling callback (ffffffffc0c0b8b0) 00010000:00010000:0.0:1789403574.101140:0:22775:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a59d08b2/0x5fb08b1e5b762978 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403574.101147:0:22775:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a59d08b2/0x5fb08b1e5b762978 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403574.101157:0:22775:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a59d08b2/0x5fb08b1e5b762978 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403574.101164:0:22775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a59d08b2/0x5fb08b1e5b762978 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x39:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403574.101174:0:22775:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789403574.101175:0:22775:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789403574.101177:0:22775:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789403574.101490:0:25221:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1789403574.101903:0:24926:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x38:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1789403574.101910:0:24926:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001780ca0f/0x5fb08b1e5b762986 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403574.101921:0:24926:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x38:0x0].0x0 since=620s v=(0 0) 00010000:00010000:0.0:1789403574.101926:0:24926:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x38:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789403574.101931:0:24926:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001780ca0f/0x5fb08b1e5b762986 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1789403574.102014:0:24292:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1789403574.102021:0:24292:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000df992316/0x5fb08b1e5b76297f lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403574.102030:0:24292:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2b:0x0].0x0 since=620s v=(0 0) 00010000:00010000:1.0:1789403574.102033:0:24292:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789403574.102037:0:24292:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000df992316/0x5fb08b1e5b76297f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403574.102049:0:24292:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000df992316/0x5fb08b1e5b76297f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403574.102057:0:24292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000df992316/0x5fb08b1e5b76297f lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403574.102064:0:24292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000df992316/0x5fb08b1e5b76297f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403574.102078:0:24292:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789403574.102843:0:24926:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001780ca0f/0x5fb08b1e5b762986 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403574.102852:0:24926:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001780ca0f/0x5fb08b1e5b762986 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403574.102859:0:24926:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001780ca0f/0x5fb08b1e5b762986 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403574.102883:0:24926:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1789403574.103133:0:22775:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1789403574.103140:0:22775:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000df992316/0x5fb08b1e5b76297f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403574.103148:0:22775:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a281b05400 already unused, calling callback (ffffffffc0c0b8b0) 00010000:00010000:0.0:1789403574.103152:0:22775:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000df992316/0x5fb08b1e5b76297f lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403574.103160:0:22775:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000df992316/0x5fb08b1e5b76297f lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403574.103175:0:22775:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000df992316/0x5fb08b1e5b76297f lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403574.103366:0:22775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000df992316/0x5fb08b1e5b76297f lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403574.103466:0:25221:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789403574.103473:0:25221:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001780ca0f/0x5fb08b1e5b762986 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403574.103480:0:25221:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a2821e9400 already unused, calling callback (ffffffffc0c0b8b0) 00010000:00010000:1.0:1789403574.103490:0:25221:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001780ca0f/0x5fb08b1e5b762986 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403574.103594:0:25221:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001780ca0f/0x5fb08b1e5b762986 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403574.103607:0:25221:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001780ca0f/0x5fb08b1e5b762986 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403574.103615:0:25221:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001780ca0f/0x5fb08b1e5b762986 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x38:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403574.103635:0:25221:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789403574.103637:0:25221:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789403574.103639:0:25221:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789403574.103700:0:22775:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789403574.103701:0:22775:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789403574.103703:0:22775:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789403574.104567:0:22774:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789403574.104889:0:24292:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1789403574.104899:0:24292:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000aa484b08/0x5fb08b1e5b76298d lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403574.104912:0:24292:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2a:0x0].0x0 since=620s v=(0 0) 00010000:00010000:1.0:1789403574.104916:0:24292:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789403574.104922:0:24292:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000aa484b08/0x5fb08b1e5b76298d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403574.104934:0:24292:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000aa484b08/0x5fb08b1e5b76298d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789403574.105103:0:24926:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x37:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1789403574.105110:0:24926:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f1018bf1/0x5fb08b1e5b762994 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403574.105119:0:24926:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x37:0x0].0x0 since=620s v=(0 0) 00010000:00010000:0.0:1789403574.105121:0:24926:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x37:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789403574.105126:0:24926:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f1018bf1/0x5fb08b1e5b762994 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403574.105135:0:24926:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f1018bf1/0x5fb08b1e5b762994 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403574.105144:0:24926:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f1018bf1/0x5fb08b1e5b762994 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403574.105152:0:24926:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f1018bf1/0x5fb08b1e5b762994 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403574.105181:0:24926:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789403574.105356:0:24292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000aa484b08/0x5fb08b1e5b76298d lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403574.105485:0:24292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000aa484b08/0x5fb08b1e5b76298d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789403574.105503:0:25106:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 12884901889 is committed 00000001:00100000:2.0:1789403574.105520:0:25106:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000001:00100000:2.0:1789403574.105524:0:25106:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:3.0:1789403574.105789:0:24290:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a1443e4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:23530:x1876325050862720:12345-0@lo:5:osp-pre-1-1.0 Request processed in 72359us (72439us total) trans 12884901889 rc 0/0 00000100:00100000:3.0:1789403574.105799:0:24290:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00010000:00010000:3.0:1789403574.105828:0:25221:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789403574.105832:0:25221:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f1018bf1/0x5fb08b1e5b762994 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403574.105840:0:25221:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a2821e9600 already unused, calling callback (ffffffffc0c0b8b0) 00010000:00010000:3.0:1789403574.105843:0:25221:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f1018bf1/0x5fb08b1e5b762994 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403574.105851:0:25221:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f1018bf1/0x5fb08b1e5b762994 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403574.105866:0:25221:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f1018bf1/0x5fb08b1e5b762994 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403574.105897:0:25221:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f1018bf1/0x5fb08b1e5b762994 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x37:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403574.105914:0:25221:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789403574.105916:0:25221:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789403574.105917:0:25221:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789403574.106117:0:23530:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 12884901889 gen 2 00000100:00100000:0.0:1789403574.106126:0:23530:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a1443e6300 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:23530:1876325050862720:0@lo:5:osp-pre-1-1.0 00000004:00080000:0.0:1789403574.106143:0:23530:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0001: current precreated pool: [0x2c0000400:0x41:0x0]-[0x2c0000400:0x61:0x0] 00000100:00100000:0.0:1789403574.106734:0:23530:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a1443e6300 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0000-lwp-MDT0001_UUID:23530:1876325050862848:0@lo:900:osp-pre-1-1.0 00000100:00100000:0.0:1789403574.106785:0:23530:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789403574.106811:0:23530:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a27a797000 going to sleep for 11 seconds 00000100:00100000:0.0:1789403574.106830:0:22798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050862848 00000100:00100000:0.0:1789403574.106836:0:22798:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050862848 00000100:00100000:0.0:1789403574.106889:0:22798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1789403574.106898:0:22798:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a1443e7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:23530:x1876325050862848:12345-0@lo:900:osp-pre-1-1.0 00000100:00100000:0.0:1789403574.106958:0:22798:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a1443e7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-MDT0001_UUID+5:23530:x1876325050862848:12345-0@lo:900:osp-pre-1-1.0 Request processed in 62us (173us total) trans 0 rc 0/0 00000100:00100000:0.0:1789403574.106965:0:22798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:0.0:1789403574.106997:0:23530:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90a1443e6300 x1876325050862848/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1789403590 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789403574.107008:0:23530:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a1443e6300 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0000-lwp-MDT0001_UUID:23530:1876325050862848:0@lo:900:osp-pre-1-1.0 00010000:00010000:0.0:1789403574.107036:0:24292:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789403574.107201:0:22775:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789403574.107214:0:22775:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000aa484b08/0x5fb08b1e5b76298d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403574.107223:0:22775:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a281b05a00 already unused, calling callback (ffffffffc0c0b8b0) 00010000:00010000:0.0:1789403574.107291:0:22775:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000aa484b08/0x5fb08b1e5b76298d lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403574.107303:0:22775:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000aa484b08/0x5fb08b1e5b76298d lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403574.107318:0:22775:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000aa484b08/0x5fb08b1e5b76298d lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403574.107333:0:22775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000aa484b08/0x5fb08b1e5b76298d lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403574.107354:0:22775:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789403574.107356:0:22775:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789403574.107358:0:22775:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789403574.107836:0:24926:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x36:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00002000:00010000:0.0:1789403574.107836:0:24292:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x29:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1789403574.107844:0:24292:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000071370c7b/0x5fb08b1e5b7629a2 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403574.107845:0:24926:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008271fcb3/0x5fb08b1e5b76299b lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403574.107856:0:24926:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x36:0x0].0x0 since=620s v=(0 0) 00010000:00010000:0.0:1789403574.107856:0:24292:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x29:0x0].0x0 since=620s v=(0 0) 00010000:00010000:1.0:1789403574.107861:0:24926:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x36:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789403574.107861:0:24292:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x29:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789403574.107867:0:24926:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008271fcb3/0x5fb08b1e5b76299b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403574.107867:0:24292:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000071370c7b/0x5fb08b1e5b7629a2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403574.107892:0:24926:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008271fcb3/0x5fb08b1e5b76299b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403574.107892:0:24292:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000071370c7b/0x5fb08b1e5b7629a2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403574.107902:0:24926:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008271fcb3/0x5fb08b1e5b76299b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403574.107902:0:24292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000071370c7b/0x5fb08b1e5b7629a2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403574.107912:0:24926:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008271fcb3/0x5fb08b1e5b76299b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403574.107912:0:24292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000071370c7b/0x5fb08b1e5b7629a2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403574.107928:0:24292:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1789403574.107932:0:24926:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1789403574.108246:0:22774:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1789403574.108253:0:22774:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000071370c7b/0x5fb08b1e5b7629a2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403574.108261:0:22774:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a2821e9800 already unused, calling callback (ffffffffc0c0b8b0) 00010000:00010000:3.0:1789403574.108266:0:22774:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000071370c7b/0x5fb08b1e5b7629a2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403574.108275:0:22774:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000071370c7b/0x5fb08b1e5b7629a2 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403574.108287:0:22774:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000071370c7b/0x5fb08b1e5b7629a2 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403574.108295:0:22774:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000071370c7b/0x5fb08b1e5b7629a2 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403574.108310:0:22774:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789403574.108313:0:22774:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008271fcb3/0x5fb08b1e5b76299b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403574.108326:0:22774:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a281b05200 already unused, calling callback (ffffffffc0c0b8b0) 00010000:00010000:3.0:1789403574.108330:0:22774:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008271fcb3/0x5fb08b1e5b76299b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403574.108338:0:22774:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008271fcb3/0x5fb08b1e5b76299b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403574.108349:0:22774:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008271fcb3/0x5fb08b1e5b76299b lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403574.108356:0:22774:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008271fcb3/0x5fb08b1e5b76299b lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x36:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403574.108368:0:22774:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789403574.108370:0:22774:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789403574.108372:0:22774:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789403574.108378:0:25221:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789403574.108608:0:24926:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x35:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1789403574.108613:0:24926:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005b9fd863/0x5fb08b1e5b7629a9 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403574.108633:0:24926:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x35:0x0].0x0 since=620s v=(0 0) 00010000:00010000:1.0:1789403574.108637:0:24926:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x35:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789403574.108643:0:24926:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005b9fd863/0x5fb08b1e5b7629a9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403574.108653:0:24926:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005b9fd863/0x5fb08b1e5b7629a9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403574.108662:0:24926:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005b9fd863/0x5fb08b1e5b7629a9 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403574.108670:0:24926:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005b9fd863/0x5fb08b1e5b7629a9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403574.108685:0:24926:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1789403574.109026:0:24926:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x34:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1789403574.109032:0:24926:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000057934c25/0x5fb08b1e5b7629b0 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403574.109040:0:24926:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x34:0x0].0x0 since=620s v=(0 0) 00010000:00010000:1.0:1789403574.109044:0:24926:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x34:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789403574.109048:0:24926:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000057934c25/0x5fb08b1e5b7629b0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403574.109058:0:24926:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000057934c25/0x5fb08b1e5b7629b0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403574.109079:0:24926:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000057934c25/0x5fb08b1e5b7629b0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403574.109086:0:24926:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000057934c25/0x5fb08b1e5b7629b0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403574.109097:0:24926:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:1.0:1789403574.110064:0:24926:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x33:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1789403574.110073:0:24926:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006de12ddf/0x5fb08b1e5b7629b7 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403574.110085:0:24926:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x33:0x0].0x0 since=620s v=(0 0) 00010000:00010000:1.0:1789403574.110089:0:24926:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x33:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789403574.110094:0:24926:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006de12ddf/0x5fb08b1e5b7629b7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403574.110106:0:24926:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006de12ddf/0x5fb08b1e5b7629b7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403574.110114:0:24926:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006de12ddf/0x5fb08b1e5b7629b7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403574.110122:0:24926:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006de12ddf/0x5fb08b1e5b7629b7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403574.110151:0:24926:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:0.0:1789403574.110517:0:22775:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1789403574.110531:0:22775:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005b9fd863/0x5fb08b1e5b7629a9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403574.110540:0:22775:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a281b05800 already unused, calling callback (ffffffffc0c0b8b0) 00010000:00010000:0.0:1789403574.110544:0:22775:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005b9fd863/0x5fb08b1e5b7629a9 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403574.110553:0:22775:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005b9fd863/0x5fb08b1e5b7629a9 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403574.110569:0:22775:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005b9fd863/0x5fb08b1e5b7629a9 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403574.110576:0:22775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005b9fd863/0x5fb08b1e5b7629a9 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x35:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403574.110595:0:22775:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1789403574.110599:0:22775:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000057934c25/0x5fb08b1e5b7629b0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403574.110605:0:22775:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a281b05000 already unused, calling callback (ffffffffc0c0b8b0) 00010000:00010000:0.0:1789403574.110607:0:22775:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000057934c25/0x5fb08b1e5b7629b0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403574.110614:0:22775:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000057934c25/0x5fb08b1e5b7629b0 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403574.110648:0:22775:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000057934c25/0x5fb08b1e5b7629b0 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403574.110655:0:22775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000057934c25/0x5fb08b1e5b7629b0 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x34:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403574.110670:0:22775:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789403574.110673:0:22775:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006de12ddf/0x5fb08b1e5b7629b7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403574.110680:0:22775:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a281b04400 already unused, calling callback (ffffffffc0c0b8b0) 00010000:00010000:0.0:1789403574.110683:0:22775:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006de12ddf/0x5fb08b1e5b7629b7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403574.110690:0:22775:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006de12ddf/0x5fb08b1e5b7629b7 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403574.110700:0:22775:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006de12ddf/0x5fb08b1e5b7629b7 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403574.110707:0:22775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006de12ddf/0x5fb08b1e5b7629b7 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x33:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403574.110720:0:22775:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789403574.110722:0:22775:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789403574.110729:0:22775:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1789403574.110761:0:24292:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x28:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1789403574.110766:0:24292:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000895a45f/0x5fb08b1e5b7629be lrc: 3/0,1 mode: --/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403574.110776:0:24292:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x28:0x0].0x0 since=620s v=(0 0) 00010000:00010000:0.0:1789403574.110779:0:24292:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x28:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789403574.110783:0:24292:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000895a45f/0x5fb08b1e5b7629be lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403574.110793:0:24292:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000895a45f/0x5fb08b1e5b7629be lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403574.110802:0:24292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000895a45f/0x5fb08b1e5b7629be lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403574.110809:0:24292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000895a45f/0x5fb08b1e5b7629be lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403574.110833:0:24292:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789403574.111027:0:22775:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789403574.111033:0:22774:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789403574.111034:0:22775:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000895a45f/0x5fb08b1e5b7629be lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403574.111039:0:25221:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789403574.111041:0:22775:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a2821e9000 already unused, calling callback (ffffffffc0c0b8b0) 00010000:00010000:1.0:1789403574.111045:0:22775:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000895a45f/0x5fb08b1e5b7629be lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403574.111053:0:22775:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000895a45f/0x5fb08b1e5b7629be lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403574.111065:0:22775:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000895a45f/0x5fb08b1e5b7629be lrc: 1/0,0 mode: --/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403574.111072:0:22775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000895a45f/0x5fb08b1e5b7629be lrc: 0/0,0 mode: --/PW res: [0x280000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403574.111086:0:22775:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789403574.111088:0:22775:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789403574.111090:0:22775:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789403574.111791:0:24926:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x32:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1789403574.111799:0:24926:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bf41f918/0x5fb08b1e5b7629c5 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403574.111809:0:24926:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x32:0x0].0x0 since=620s v=(0 0) 00010000:00010000:1.0:1789403574.111822:0:24926:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x32:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789403574.111827:0:24926:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000bf41f918/0x5fb08b1e5b7629c5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403574.111839:0:24926:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000bf41f918/0x5fb08b1e5b7629c5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403574.111846:0:24926:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bf41f918/0x5fb08b1e5b7629c5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403574.111853:0:24926:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000bf41f918/0x5fb08b1e5b7629c5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403574.111869:0:24926:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1789403574.112676:0:24926:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x31:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1789403574.112686:0:24926:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f87a1435/0x5fb08b1e5b7629cc lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403574.112697:0:24926:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x31:0x0].0x0 since=620s v=(0 0) 00010000:00010000:1.0:1789403574.112701:0:24926:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x31:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789403574.112705:0:24926:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f87a1435/0x5fb08b1e5b7629cc lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403574.112716:0:24926:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f87a1435/0x5fb08b1e5b7629cc lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789403574.112725:0:24292:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x27:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1789403574.112725:0:24926:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f87a1435/0x5fb08b1e5b7629cc lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403574.112734:0:24292:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000076bdfda/0x5fb08b1e5b7629d3 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403574.112749:0:24926:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f87a1435/0x5fb08b1e5b7629cc lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403574.112752:0:24292:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x27:0x0].0x0 since=620s v=(0 0) 00010000:00010000:2.0:1789403574.112760:0:24292:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x27:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789403574.112766:0:24292:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000076bdfda/0x5fb08b1e5b7629d3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403574.112770:0:24926:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1789403574.112781:0:24292:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000076bdfda/0x5fb08b1e5b7629d3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403574.112790:0:24292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000076bdfda/0x5fb08b1e5b7629d3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403574.112799:0:24292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000076bdfda/0x5fb08b1e5b7629d3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403574.112825:0:24292:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:1.0:1789403574.112960:0:22775:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1789403574.112967:0:22775:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000bf41f918/0x5fb08b1e5b7629c5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403574.112975:0:22775:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a281b04200 already unused, calling callback (ffffffffc0c0b8b0) 00010000:00010000:1.0:1789403574.112990:0:22775:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000bf41f918/0x5fb08b1e5b7629c5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403574.112999:0:22775:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000bf41f918/0x5fb08b1e5b7629c5 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403574.113012:0:22775:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000bf41f918/0x5fb08b1e5b7629c5 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403574.113020:0:22775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000bf41f918/0x5fb08b1e5b7629c5 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x32:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403574.113034:0:22775:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1789403574.113037:0:22775:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f87a1435/0x5fb08b1e5b7629cc lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403574.113055:0:22775:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a281b05c00 already unused, calling callback (ffffffffc0c0b8b0) 00010000:00010000:1.0:1789403574.113059:0:22775:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f87a1435/0x5fb08b1e5b7629cc lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403574.113067:0:22775:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f87a1435/0x5fb08b1e5b7629cc lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403574.113080:0:22775:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f87a1435/0x5fb08b1e5b7629cc lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403574.113087:0:22775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f87a1435/0x5fb08b1e5b7629cc lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x31:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403574.113107:0:22775:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789403574.113111:0:22775:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000076bdfda/0x5fb08b1e5b7629d3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403574.113116:0:22775:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a270184e00 already unused, calling callback (ffffffffc0c0b8b0) 00010000:00010000:1.0:1789403574.113119:0:22775:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000076bdfda/0x5fb08b1e5b7629d3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403574.113127:0:22775:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000076bdfda/0x5fb08b1e5b7629d3 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403574.113138:0:22775:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000076bdfda/0x5fb08b1e5b7629d3 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403574.113154:0:22775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000076bdfda/0x5fb08b1e5b7629d3 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403574.113169:0:22775:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789403574.113171:0:22775:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789403574.113172:0:22775:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1789403574.113894:0:24292:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x26:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00002000:00010000:1.0:1789403574.113894:0:24926:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x30:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1789403574.113911:0:24292:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000370686c/0x5fb08b1e5b7629e1 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403574.113911:0:24926:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007511016e/0x5fb08b1e5b7629da lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403574.113936:0:24292:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x26:0x0].0x0 since=620s v=(0 0) 00010000:00010000:1.0:1789403574.113937:0:24926:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x30:0x0].0x0 since=620s v=(0 0) 00010000:00010000:2.0:1789403574.113946:0:24292:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x26:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789403574.113946:0:24926:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x30:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789403574.113958:0:24926:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007511016e/0x5fb08b1e5b7629da lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403574.113959:0:24292:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000370686c/0x5fb08b1e5b7629e1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403574.113984:0:24926:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007511016e/0x5fb08b1e5b7629da lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403574.113985:0:24292:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000370686c/0x5fb08b1e5b7629e1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403574.114012:0:24292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000370686c/0x5fb08b1e5b7629e1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403574.114012:0:24926:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007511016e/0x5fb08b1e5b7629da lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403574.114038:0:24926:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000007511016e/0x5fb08b1e5b7629da lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403574.114039:0:24292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000370686c/0x5fb08b1e5b7629e1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403574.114069:0:24292:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1789403574.114076:0:24926:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1789403574.114137:0:22774:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1789403574.114144:0:22774:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000370686c/0x5fb08b1e5b7629e1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403574.114153:0:22774:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a270184400 already unused, calling callback (ffffffffc0c0b8b0) 00010000:00010000:3.0:1789403574.114157:0:22774:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000370686c/0x5fb08b1e5b7629e1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403574.114177:0:22774:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000370686c/0x5fb08b1e5b7629e1 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403574.114190:0:22774:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000370686c/0x5fb08b1e5b7629e1 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403574.114198:0:22774:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000370686c/0x5fb08b1e5b7629e1 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403574.114213:0:22774:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789403574.114217:0:22774:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000007511016e/0x5fb08b1e5b7629da lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403574.114223:0:22774:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a281b05e00 already unused, calling callback (ffffffffc0c0b8b0) 00010000:00010000:3.0:1789403574.114226:0:22774:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000007511016e/0x5fb08b1e5b7629da lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403574.114234:0:22774:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000007511016e/0x5fb08b1e5b7629da lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403574.114244:0:22774:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000007511016e/0x5fb08b1e5b7629da lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403574.114251:0:22774:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007511016e/0x5fb08b1e5b7629da lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x30:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403574.114274:0:22774:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789403574.114276:0:22774:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789403574.114277:0:22774:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789403574.114284:0:25221:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789403574.114657:0:22775:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789403574.114804:0:24926:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1789403574.114811:0:24926:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000012ad4e08/0x5fb08b1e5b7629e8 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403574.114821:0:24926:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2f:0x0].0x0 since=620s v=(0 0) 00010000:00010000:1.0:1789403574.114825:0:24926:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789403574.114830:0:24926:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000012ad4e08/0x5fb08b1e5b7629e8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403574.114840:0:24926:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000012ad4e08/0x5fb08b1e5b7629e8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403574.114848:0:24926:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000012ad4e08/0x5fb08b1e5b7629e8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403574.114855:0:24926:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000012ad4e08/0x5fb08b1e5b7629e8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403574.114883:0:24926:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789403574.114902:0:22774:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789403574.114907:0:22774:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000012ad4e08/0x5fb08b1e5b7629e8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403574.114914:0:22774:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a281b04c00 already unused, calling callback (ffffffffc0c0b8b0) 00010000:00010000:3.0:1789403574.114918:0:22774:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000012ad4e08/0x5fb08b1e5b7629e8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403574.114926:0:22774:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000012ad4e08/0x5fb08b1e5b7629e8 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403574.114937:0:22774:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000012ad4e08/0x5fb08b1e5b7629e8 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403574.114944:0:22774:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000012ad4e08/0x5fb08b1e5b7629e8 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403574.114960:0:22774:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789403574.114962:0:22774:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789403574.114963:0:22774:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789403574.115172:0:24926:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1789403574.115178:0:24926:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002f76ee42/0x5fb08b1e5b7629ef lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789403574.115250:0:24292:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x25:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1789403574.115257:0:24292:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000073484d97/0x5fb08b1e5b7629f6 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403574.115265:0:24292:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x25:0x0].0x0 since=620s v=(0 0) 00010000:00010000:2.0:1789403574.115275:0:24292:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x25:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789403574.115280:0:24292:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000073484d97/0x5fb08b1e5b7629f6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403574.115290:0:24292:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000073484d97/0x5fb08b1e5b7629f6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403574.115311:0:24292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000073484d97/0x5fb08b1e5b7629f6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403574.115320:0:24292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000073484d97/0x5fb08b1e5b7629f6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403574.115334:0:24926:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2e:0x0].0x0 since=620s v=(0 0) 00010000:00010000:1.0:1789403574.115338:0:24926:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789403574.115339:0:24292:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789403574.115343:0:24926:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002f76ee42/0x5fb08b1e5b7629ef lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403574.115367:0:24926:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002f76ee42/0x5fb08b1e5b7629ef lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403574.115426:0:25221:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789403574.115432:0:25221:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000073484d97/0x5fb08b1e5b7629f6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403574.115447:0:25221:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a270184000 already unused, calling callback (ffffffffc0c0b8b0) 00010000:00010000:3.0:1789403574.115451:0:25221:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000073484d97/0x5fb08b1e5b7629f6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403574.115459:0:25221:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000073484d97/0x5fb08b1e5b7629f6 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403574.115470:0:25221:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000073484d97/0x5fb08b1e5b7629f6 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403574.115478:0:25221:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000073484d97/0x5fb08b1e5b7629f6 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403574.115504:0:25221:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789403574.115505:0:25221:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789403574.115507:0:25221:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1789403574.115666:0:24292:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x24:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1789403574.115672:0:24292:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005034bd84/0x5fb08b1e5b7629fd lrc: 3/0,1 mode: --/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403574.115680:0:24292:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x24:0x0].0x0 since=620s v=(0 0) 00010000:00010000:2.0:1789403574.115683:0:24292:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x24:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789403574.115687:0:24292:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005034bd84/0x5fb08b1e5b7629fd lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403574.115696:0:24292:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005034bd84/0x5fb08b1e5b7629fd lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403574.115705:0:24292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005034bd84/0x5fb08b1e5b7629fd lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403574.115720:0:24292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005034bd84/0x5fb08b1e5b7629fd lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403574.115745:0:24292:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1789403574.116022:0:24292:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x23:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1789403574.116028:0:24292:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006434f158/0x5fb08b1e5b762a04 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403574.116038:0:24292:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x23:0x0].0x0 since=620s v=(0 0) 00010000:00010000:2.0:1789403574.116041:0:24292:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x23:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789403574.116046:0:24292:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006434f158/0x5fb08b1e5b762a04 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403574.116055:0:24292:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006434f158/0x5fb08b1e5b762a04 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403574.116064:0:24292:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006434f158/0x5fb08b1e5b762a04 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403574.116071:0:24292:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006434f158/0x5fb08b1e5b762a04 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403574.116083:0:24292:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00080000:2.0:1789403574.116115:0:24292:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0000: after destroy: set last_id to 0x280000401:34 00000100:00100000:2.0:1789403574.116218:0:24292:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a144bed880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:22811:x1876325050862464:12345-0@lo:5:osp-pre-0-0.0 Request processed in 105689us (105884us total) trans 0 rc 0/0 00000100:00100000:2.0:1789403574.116306:0:24292:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1789403574.116361:0:22811:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a144bedc00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:22811:1876325050862464:0@lo:5:osp-pre-0-0.0 00010000:00010000:1.0:1789403574.116480:0:24926:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002f76ee42/0x5fb08b1e5b7629ef lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403574.116489:0:24926:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002f76ee42/0x5fb08b1e5b7629ef lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403574.116501:0:24926:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00000004:00080000:2.0:1789403574.117103:0:22811:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x280000401:0x41:0x0] from OST, last_created [0x280000401:0x41:0x0]last_used is [0x280000401:0x22:0x0] 00000100:00100000:2.0:1789403574.117155:0:22811:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a281913100 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:22811:1876325050862976:0@lo:5:osp-pre-0-0.0 00000100:00100000:2.0:1789403574.117220:0:22811:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1789403574.117434:0:22774:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1789403574.117443:0:22774:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005034bd84/0x5fb08b1e5b7629fd lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403574.117453:0:22774:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a270184600 already unused, calling callback (ffffffffc0c0b8b0) 00010000:00010000:3.0:1789403574.117457:0:22774:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005034bd84/0x5fb08b1e5b7629fd lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403574.117466:0:22774:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005034bd84/0x5fb08b1e5b7629fd lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403574.117502:0:22774:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005034bd84/0x5fb08b1e5b7629fd lrc: 1/0,0 mode: --/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403574.117509:0:22774:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005034bd84/0x5fb08b1e5b7629fd lrc: 0/0,0 mode: --/PW res: [0x280000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403574.117527:0:22774:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1789403574.117531:0:22774:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006434f158/0x5fb08b1e5b762a04 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403574.117537:0:22774:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a270185e00 already unused, calling callback (ffffffffc0c0b8b0) 00010000:00010000:3.0:1789403574.117540:0:22774:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006434f158/0x5fb08b1e5b762a04 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403574.117547:0:22774:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006434f158/0x5fb08b1e5b762a04 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403574.117557:0:22774:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006434f158/0x5fb08b1e5b762a04 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403574.117564:0:22774:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006434f158/0x5fb08b1e5b762a04 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403574.117576:0:22774:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789403574.117580:0:22774:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002f76ee42/0x5fb08b1e5b7629ef lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403574.117594:0:22774:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a281b04000 already unused, calling callback (ffffffffc0c0b8b0) 00010000:00010000:3.0:1789403574.117597:0:22774:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002f76ee42/0x5fb08b1e5b7629ef lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403574.117603:0:22774:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002f76ee42/0x5fb08b1e5b7629ef lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403574.117613:0:22774:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002f76ee42/0x5fb08b1e5b7629ef lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403574.117620:0:22774:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002f76ee42/0x5fb08b1e5b7629ef lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403574.117635:0:22774:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789403574.117637:0:22774:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789403574.117639:0:22774:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789403574.117648:0:22775:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789403574.117653:0:25221:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789403574.119007:0:22811:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a245ca7d80 going to sleep for 11 seconds 00000100:00100000:2.0:1789403574.119034:0:24293:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050862976 00000100:00100000:2.0:1789403574.119042:0:24293:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050862976 00000100:00100000:2.0:1789403574.119091:0:24293:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1789403574.119099:0:24293:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a281913480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:22811:x1876325050862976:12345-0@lo:5:osp-pre-0-0.0 00002000:00080000:2.0:1789403574.119139:0:24293:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000401 at 66 00002000:00010000:1.0:1789403574.122269:0:24926:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1789403574.122281:0:24926:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000374ae10c/0x5fb08b1e5b762a0b lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403574.122298:0:24926:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2d:0x0].0x0 since=620s v=(0 0) 00010000:00010000:1.0:1789403574.122377:0:24926:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789403574.122385:0:24926:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000374ae10c/0x5fb08b1e5b762a0b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403574.122430:0:24926:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000374ae10c/0x5fb08b1e5b762a0b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403574.122440:0:24926:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000374ae10c/0x5fb08b1e5b762a0b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403574.122461:0:24926:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000374ae10c/0x5fb08b1e5b762a0b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403574.122481:0:24926:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789403574.122646:0:22774:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789403574.122654:0:22774:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000374ae10c/0x5fb08b1e5b762a0b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403574.122664:0:22774:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a281b04600 already unused, calling callback (ffffffffc0c0b8b0) 00010000:00010000:3.0:1789403574.122669:0:22774:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000374ae10c/0x5fb08b1e5b762a0b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403574.122690:0:22774:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000374ae10c/0x5fb08b1e5b762a0b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403574.122708:0:22774:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000374ae10c/0x5fb08b1e5b762a0b lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403574.122716:0:22774:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000374ae10c/0x5fb08b1e5b762a0b lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403574.122734:0:22774:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789403574.122736:0:22774:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789403574.122738:0:22774:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789403574.124854:0:24926:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1789403574.124867:0:24926:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000441099e9/0x5fb08b1e5b762a12 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403574.124895:0:24926:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2c:0x0].0x0 since=620s v=(0 0) 00010000:00010000:1.0:1789403574.124900:0:24926:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789403574.124906:0:24926:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000441099e9/0x5fb08b1e5b762a12 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403574.124920:0:24926:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000441099e9/0x5fb08b1e5b762a12 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403574.124931:0:24926:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000441099e9/0x5fb08b1e5b762a12 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403574.124939:0:24926:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000441099e9/0x5fb08b1e5b762a12 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403574.124959:0:24926:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789403574.125784:0:22775:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789403574.125793:0:22775:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000441099e9/0x5fb08b1e5b762a12 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403574.125803:0:22775:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a281b04800 already unused, calling callback (ffffffffc0c0b8b0) 00010000:00010000:3.0:1789403574.125808:0:22775:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000441099e9/0x5fb08b1e5b762a12 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403574.125819:0:22775:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000441099e9/0x5fb08b1e5b762a12 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403574.125837:0:22775:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000441099e9/0x5fb08b1e5b762a12 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403574.125856:0:22775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000441099e9/0x5fb08b1e5b762a12 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403574.125886:0:22775:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789403574.125889:0:22775:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789403574.125890:0:22775:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1789403574.134652:0:24926:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1789403574.134666:0:24926:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003840e913/0x5fb08b1e5b762a19 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403574.134686:0:24926:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2b:0x0].0x0 since=620s v=(0 0) 00010000:00010000:0.0:1789403574.134692:0:24926:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789403574.134698:0:24926:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003840e913/0x5fb08b1e5b762a19 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403574.134728:0:24926:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003840e913/0x5fb08b1e5b762a19 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403574.134740:0:24926:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003840e913/0x5fb08b1e5b762a19 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403574.134749:0:24926:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000003840e913/0x5fb08b1e5b762a19 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403574.134776:0:24926:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789403574.134786:0:25221:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789403574.134793:0:25221:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000003840e913/0x5fb08b1e5b762a19 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403574.134803:0:25221:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a2821e9c00 already unused, calling callback (ffffffffc0c0b8b0) 00010000:00010000:3.0:1789403574.134808:0:25221:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000003840e913/0x5fb08b1e5b762a19 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403574.134819:0:25221:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000003840e913/0x5fb08b1e5b762a19 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403574.134836:0:25221:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000003840e913/0x5fb08b1e5b762a19 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403574.134844:0:25221:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003840e913/0x5fb08b1e5b762a19 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403574.134861:0:25221:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789403574.134863:0:25221:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789403574.134865:0:25221:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1789403574.135798:0:24926:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1789403574.135808:0:24926:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000074c16ff0/0x5fb08b1e5b762a20 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403574.135830:0:24926:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2a:0x0].0x0 since=620s v=(0 0) 00010000:00010000:0.0:1789403574.135834:0:24926:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789403574.135844:0:24926:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000074c16ff0/0x5fb08b1e5b762a20 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403574.135856:0:24926:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000074c16ff0/0x5fb08b1e5b762a20 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403574.135865:0:24926:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000074c16ff0/0x5fb08b1e5b762a20 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403574.135893:0:24926:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000074c16ff0/0x5fb08b1e5b762a20 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403574.135912:0:24926:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1789403574.136864:0:24926:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x29:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1789403574.136885:0:24926:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b9e758bd/0x5fb08b1e5b762a27 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403574.136898:0:24926:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x29:0x0].0x0 since=620s v=(0 0) 00010000:00010000:0.0:1789403574.136901:0:24926:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x29:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789403574.136906:0:24926:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b9e758bd/0x5fb08b1e5b762a27 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403574.136918:0:24926:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b9e758bd/0x5fb08b1e5b762a27 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403574.136927:0:24926:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b9e758bd/0x5fb08b1e5b762a27 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403574.136933:0:24926:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b9e758bd/0x5fb08b1e5b762a27 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403574.136954:0:24926:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1789403574.137007:0:22775:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1789403574.137015:0:22775:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000074c16ff0/0x5fb08b1e5b762a20 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403574.137025:0:22775:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a2821e8c00 already unused, calling callback (ffffffffc0c0b8b0) 00010000:00010000:2.0:1789403574.137030:0:22775:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000074c16ff0/0x5fb08b1e5b762a20 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403574.137040:0:22775:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000074c16ff0/0x5fb08b1e5b762a20 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403574.137056:0:22775:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000074c16ff0/0x5fb08b1e5b762a20 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789403574.137450:0:24926:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x28:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1789403574.137457:0:24926:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000065153cd8/0x5fb08b1e5b762a2e lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403574.137471:0:24926:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x28:0x0].0x0 since=620s v=(0 0) 00010000:00010000:0.0:1789403574.137475:0:24926:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x28:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789403574.137479:0:24926:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000065153cd8/0x5fb08b1e5b762a2e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403574.137489:0:24926:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000065153cd8/0x5fb08b1e5b762a2e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403574.137497:0:24926:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000065153cd8/0x5fb08b1e5b762a2e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403574.137505:0:24926:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000065153cd8/0x5fb08b1e5b762a2e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403574.137522:0:24926:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1789403574.137530:0:25221:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1789403574.137535:0:25221:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b9e758bd/0x5fb08b1e5b762a27 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403574.137543:0:25221:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a2821e8600 already unused, calling callback (ffffffffc0c0b8b0) 00010000:00010000:0.0:1789403574.137546:0:25221:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b9e758bd/0x5fb08b1e5b762a27 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403574.137565:0:25221:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b9e758bd/0x5fb08b1e5b762a27 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403574.137589:0:25221:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b9e758bd/0x5fb08b1e5b762a27 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403574.137596:0:25221:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b9e758bd/0x5fb08b1e5b762a27 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x29:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403574.137734:0:25221:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789403574.137738:0:25221:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000065153cd8/0x5fb08b1e5b762a2e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403574.137746:0:25221:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a2821e8200 already unused, calling callback (ffffffffc0c0b8b0) 00010000:00010000:0.0:1789403574.137749:0:25221:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000065153cd8/0x5fb08b1e5b762a2e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403574.137757:0:25221:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000065153cd8/0x5fb08b1e5b762a2e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403574.137768:0:25221:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000065153cd8/0x5fb08b1e5b762a2e lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403574.137775:0:25221:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000065153cd8/0x5fb08b1e5b762a2e lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x28:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403574.137787:0:25221:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789403574.137789:0:25221:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789403574.137797:0:25221:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789403574.138603:0:22775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000074c16ff0/0x5fb08b1e5b762a20 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403574.138623:0:22775:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789403574.138625:0:22775:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789403574.138627:0:22775:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1789403574.139420:0:24287:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 12884901890 is committed 00000001:00100000:2.0:1789403574.139463:0:24287:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:1.0:1789403574.140691:0:24293:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a281913480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:22811:x1876325050862976:12345-0@lo:5:osp-pre-0-0.0 Request processed in 21585us (23464us total) trans 12884901890 rc 0/0 00000100:00100000:1.0:1789403574.140720:0:24293:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1789403574.140726:0:22811:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 12884901890 gen 2 00000100:00100000:0.0:1789403574.140737:0:22811:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a281913100 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:22811:1876325050862976:0@lo:5:osp-pre-0-0.0 00000004:00080000:0.0:1789403574.140755:0:22811:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x280000401:0x41:0x0]-[0x280000401:0x61:0x0] 00010000:00010000:3.0:1789403574.140882:0:22774:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1789403574.141329:0:24926:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x27:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1789403574.141338:0:24926:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000132bbff1/0x5fb08b1e5b762a35 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403574.141353:0:24926:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x27:0x0].0x0 since=620s v=(0 0) 00010000:00010000:2.0:1789403574.141357:0:24926:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x27:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789403574.141363:0:24926:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000132bbff1/0x5fb08b1e5b762a35 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403574.141378:0:24926:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000132bbff1/0x5fb08b1e5b762a35 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403574.141405:0:24926:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000132bbff1/0x5fb08b1e5b762a35 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403574.141414:0:24926:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000132bbff1/0x5fb08b1e5b762a35 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403574.141448:0:24926:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789403574.141766:0:25221:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789403574.141773:0:25221:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000132bbff1/0x5fb08b1e5b762a35 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403574.141781:0:25221:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a270185000 already unused, calling callback (ffffffffc0c0b8b0) 00010000:00010000:1.0:1789403574.141786:0:25221:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000132bbff1/0x5fb08b1e5b762a35 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403574.141795:0:25221:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000132bbff1/0x5fb08b1e5b762a35 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403574.141812:0:25221:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000132bbff1/0x5fb08b1e5b762a35 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403574.141819:0:25221:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000132bbff1/0x5fb08b1e5b762a35 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x27:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403574.141834:0:25221:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789403574.141835:0:25221:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789403574.141837:0:25221:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1789403574.146810:0:24926:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x26:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1789403574.146825:0:24926:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000065153cd8/0x5fb08b1e5b762a3c lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403574.146855:0:24926:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x26:0x0].0x0 since=620s v=(0 0) 00010000:00010000:0.0:1789403574.146860:0:24926:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x26:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789403574.146866:0:24926:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000065153cd8/0x5fb08b1e5b762a3c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403574.146890:0:24926:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000065153cd8/0x5fb08b1e5b762a3c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403574.146901:0:24926:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000065153cd8/0x5fb08b1e5b762a3c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403574.146909:0:24926:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000065153cd8/0x5fb08b1e5b762a3c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403574.146927:0:24926:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789403574.147803:0:22775:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789403574.147813:0:22775:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000065153cd8/0x5fb08b1e5b762a3c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403574.147824:0:22775:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a2821e8200 already unused, calling callback (ffffffffc0c0b8b0) 00010000:00010000:2.0:1789403574.147828:0:22775:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000065153cd8/0x5fb08b1e5b762a3c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403574.147839:0:22775:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000065153cd8/0x5fb08b1e5b762a3c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403574.147870:0:22775:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000065153cd8/0x5fb08b1e5b762a3c lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403574.147889:0:22775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000065153cd8/0x5fb08b1e5b762a3c lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x26:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403574.147906:0:22775:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789403574.147908:0:22775:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789403574.147909:0:22775:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1789403574.148363:0:24926:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x25:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1789403574.148370:0:24926:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003f5996ef/0x5fb08b1e5b762a43 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403574.148381:0:24926:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x25:0x0].0x0 since=620s v=(0 0) 00010000:00010000:2.0:1789403574.148427:0:24926:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x25:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789403574.148434:0:24926:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003f5996ef/0x5fb08b1e5b762a43 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403574.148446:0:24926:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003f5996ef/0x5fb08b1e5b762a43 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403574.148455:0:24926:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003f5996ef/0x5fb08b1e5b762a43 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403574.148462:0:24926:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000003f5996ef/0x5fb08b1e5b762a43 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403574.148480:0:24926:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1789403574.149524:0:24926:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x24:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1789403574.149534:0:24926:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f87a1435/0x5fb08b1e5b762a4a lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403574.149546:0:24926:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x24:0x0].0x0 since=620s v=(0 0) 00010000:00010000:1.0:1789403574.149550:0:24926:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x24:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789403574.149563:0:24926:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f87a1435/0x5fb08b1e5b762a4a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403574.149576:0:24926:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f87a1435/0x5fb08b1e5b762a4a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403574.149596:0:24926:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f87a1435/0x5fb08b1e5b762a4a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403574.149605:0:24926:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f87a1435/0x5fb08b1e5b762a4a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403574.149622:0:24926:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1789403574.149632:0:25221:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1789403574.149638:0:25221:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000003f5996ef/0x5fb08b1e5b762a43 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403574.149645:0:25221:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a270185a00 already unused, calling callback (ffffffffc0c0b8b0) 00010000:00010000:1.0:1789403574.149649:0:25221:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000003f5996ef/0x5fb08b1e5b762a43 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403574.149658:0:25221:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000003f5996ef/0x5fb08b1e5b762a43 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403574.149672:0:25221:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000003f5996ef/0x5fb08b1e5b762a43 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403574.149692:0:25221:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003f5996ef/0x5fb08b1e5b762a43 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x25:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403574.149711:0:25221:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789403574.149715:0:25221:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f87a1435/0x5fb08b1e5b762a4a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403574.149721:0:25221:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a281b05c00 already unused, calling callback (ffffffffc0c0b8b0) 00010000:00010000:1.0:1789403574.149725:0:25221:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f87a1435/0x5fb08b1e5b762a4a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403574.149732:0:25221:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f87a1435/0x5fb08b1e5b762a4a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403574.149744:0:25221:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f87a1435/0x5fb08b1e5b762a4a lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403574.149751:0:25221:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f87a1435/0x5fb08b1e5b762a4a lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x24:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403574.149764:0:25221:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789403574.149766:0:25221:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789403574.149769:0:25221:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789403574.149774:0:22774:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789403574.150845:0:24926:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x23:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1789403574.150855:0:24926:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bf41f918/0x5fb08b1e5b762a51 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403574.150871:0:24926:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x23:0x0].0x0 since=620s v=(0 0) 00010000:00010000:1.0:1789403574.150885:0:24926:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x23:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789403574.150890:0:24926:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000bf41f918/0x5fb08b1e5b762a51 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403574.150902:0:24926:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000bf41f918/0x5fb08b1e5b762a51 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403574.150911:0:24926:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bf41f918/0x5fb08b1e5b762a51 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403574.150919:0:24926:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000bf41f918/0x5fb08b1e5b762a51 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403574.150944:0:24926:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1789403574.151329:0:24926:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x22:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1789403574.151336:0:24926:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fb2676cd/0x5fb08b1e5b762a58 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403574.151344:0:24926:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=620s v=(0 0) 00010000:00010000:1.0:1789403574.151348:0:24926:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789403574.151352:0:24926:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fb2676cd/0x5fb08b1e5b762a58 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403574.151362:0:24926:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000fb2676cd/0x5fb08b1e5b762a58 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 24926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403574.151380:0:24926:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fb2676cd/0x5fb08b1e5b762a58 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 24926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403574.151416:0:24926:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000fb2676cd/0x5fb08b1e5b762a58 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 24926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403574.151449:0:24926:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1789403574.151459:0:25221:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1789403574.151464:0:25221:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000bf41f918/0x5fb08b1e5b762a51 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403574.151473:0:25221:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a281b04200 already unused, calling callback (ffffffffc0c0b8b0) 00010000:00010000:1.0:1789403574.151478:0:25221:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000bf41f918/0x5fb08b1e5b762a51 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403574.151486:0:25221:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000bf41f918/0x5fb08b1e5b762a51 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403574.151502:0:25221:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000bf41f918/0x5fb08b1e5b762a51 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403574.151509:0:25221:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000bf41f918/0x5fb08b1e5b762a51 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x23:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403574.151526:0:25221:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789403574.151536:0:25221:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000fb2676cd/0x5fb08b1e5b762a58 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403574.151542:0:25221:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a281b05600 already unused, calling callback (ffffffffc0c0b8b0) 00010000:00010000:1.0:1789403574.151546:0:25221:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000fb2676cd/0x5fb08b1e5b762a58 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 24926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403574.151554:0:25221:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000fb2676cd/0x5fb08b1e5b762a58 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 24926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403574.151565:0:25221:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000fb2676cd/0x5fb08b1e5b762a58 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403574.151572:0:25221:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fb2676cd/0x5fb08b1e5b762a58 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 24926 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403574.151595:0:25221:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789403574.151597:0:25221:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789403574.151599:0:25221:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00080000:1.0:1789403574.151852:0:24926:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0001: after destroy: set last_id to 0x2c0000401:5 00000100:00100000:1.0:1789403574.151951:0:24926:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a141aace00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:22813:x1876325050861952:12345-0@lo:5:osp-pre-1-0.0 Request processed in 146877us (146945us total) trans 0 rc 0/0 00000100:00100000:1.0:1789403574.151961:0:24926:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1789403574.152018:0:22813:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a141aaed80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:22813:1876325050861952:0@lo:5:osp-pre-1-0.0 00000004:00080000:1.0:1789403574.152042:0:22813:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x2c0000401:0x41:0x0] from OST, last_created [0x2c0000401:0x41:0x0]last_used is [0x2c0000401:0x5:0x0] 00000100:00100000:1.0:1789403574.152086:0:22813:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a144049880 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:22813:1876325050863104:0@lo:5:osp-pre-1-0.0 00000100:00100000:1.0:1789403574.152125:0:22813:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789403574.152153:0:22813:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a14259cd80 going to sleep for 11 seconds 00000100:00100000:3.0:1789403574.152154:0:24290:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050863104 00000100:00100000:3.0:1789403574.152161:0:24290:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050863104 00000100:00100000:3.0:1789403574.152209:0:24290:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1789403574.152218:0:24290:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a144049500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:22813:x1876325050863104:12345-0@lo:5:osp-pre-1-0.0 00002000:00080000:3.0:1789403574.152252:0:24290:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000401 at 66 00010000:00010000:2.0:1789403574.152609:0:22775:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789403574.155972:0:24290:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a144049500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:22813:x1876325050863104:12345-0@lo:5:osp-pre-1-0.0 Request processed in 3749us (3840us total) trans 12884901890 rc 0/0 00000100:00100000:2.0:1789403574.155985:0:24290:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1789403574.157135:0:22813:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a144049880 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:22813:1876325050863104:0@lo:5:osp-pre-1-0.0 00000004:00080000:1.0:1789403574.157152:0:22813:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x2c0000401:0x41:0x0]-[0x2c0000401:0x61:0x0] 00000040:00080000:2.0:1789403574.514195:0:23539:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1789403575.026255:0:22774:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789403576.051739:0:25221:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789403577.073571:0:22775:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789403578.109348:0:22774:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789403578.609743:0:3629:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a281911880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3629:1876325050863232:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1789403578.609808:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789403578.609887:0:22791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050863232 00000100:00100000:2.0:1789403578.609905:0:22791:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050863232 00000100:00100000:2.0:1789403578.609945:0:22791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1789403578.609953:0:22791:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a281913100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3629:x1876325050863232:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1789403578.609985:0:22791:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446309888 avail 1300070400 00000100:00100000:2.0:1789403578.610041:0:22791:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a281913100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3629:x1876325050863232:12345-0@lo:41:osp-pre-0-1.0 Request processed in 88us (232us total) trans 0 rc 0/0 00000100:00100000:2.0:1789403578.610048:0:22791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1789403578.610089:0:3629:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a281911880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3629:1876325050863232:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1789403578.610437:0:3627:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789403578.610447:0:3627:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a144befb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3627:1876325050863360:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1789403578.610475:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789403578.610506:0:24931:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050863360 00000100:00100000:3.0:1789403578.610510:0:24931:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050863360 00000100:00100000:3.0:1789403578.610533:0:24931:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1789403578.610539:0:24931:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a144beea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3627:x1876325050863360:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1789403578.610569:0:24931:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:3.0:1789403578.610600:0:24931:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a144beea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3627:x1876325050863360:12345-0@lo:41:osp-pre-1-0.0 Request processed in 61us (124us total) trans 0 rc 0/0 00000100:00100000:3.0:1789403578.610607:0:24931:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1789403578.610633:0:3627:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a144befb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3627:1876325050863360:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1789403578.610995:0:3627:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a281911880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3627:1876325050863488:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1789403578.611024:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789403578.611350:0:24295:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050863488 00000100:00100000:2.0:1789403578.611356:0:24295:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050863488 00000100:00100000:2.0:1789403578.611441:0:24295:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1789403578.611448:0:24295:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a144befb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3627:x1876325050863488:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1789403578.611468:0:24295:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3915849728 avail 3684327424 00000100:00100000:2.0:1789403578.611504:0:24295:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a144befb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3627:x1876325050863488:12345-0@lo:13:osp-pre-0-1.0 Request processed in 58us (480us total) trans 0 rc 0/0 00000100:00100000:2.0:1789403578.611510:0:24295:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00080000:3.0:1789403578.611645:0:22782:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789403578.611680:0:3627:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a281911880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3627:1876325050863488:0@lo:13:osp-pre-0-1.0 00000001:02000400:0.0:1789403578.748678:0:25464:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg343-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000100:00100000:1.0:1789403579.122312:0:3629:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789403579.122334:0:3629:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a14404a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3629:1876325050863616:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1789403579.122418:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789403579.122451:0:3626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a144bed180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3626:1876325050863872:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789403579.122451:0:3629:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a144beed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3629:1876325050863744:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789403579.122474:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789403579.122506:0:24295:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050863616 00000100:00100000:1.0:1789403579.122513:0:24295:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050863616 00000100:00100000:1.0:1789403579.122553:0:24295:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050863744 00000100:00100000:1.0:1789403579.122556:0:24295:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050863744 00000100:00100000:3.0:1789403579.122568:0:3627:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a144bedc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7ccb4038-daf9-4dcd-9b85-da9390181204:3627:1876325050864000:0@lo:400:kworker.0 00000100:00100000:1.0:1789403579.122572:0:24295:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1789403579.122580:0:24295:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a144049c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3629:x1876325050863616:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1789403579.122607:0:24295:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923513344 avail 3691991040 00000100:00100000:3.0:1789403579.122635:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789403579.122641:0:24295:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a144049c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3629:x1876325050863616:12345-0@lo:13:osp-pre-1-1.0 Request processed in 62us (224us total) trans 0 rc 0/0 00000100:00100000:1.0:1789403579.122648:0:24295:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1789403579.122663:0:3627:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a144b29500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3627:1876325050864512:0@lo:400:kworker.0 00000100:00100000:1.0:1789403579.122663:0:24295:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1789403579.122669:0:24295:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a14404b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3629:x1876325050863744:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789403579.122678:0:24295:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923513344 avail 3691991040 00000100:00100000:3.0:1789403579.122685:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789403579.122699:0:24295:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a14404b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3629:x1876325050863744:12345-0@lo:13:osp-pre-1-0.0 Request processed in 30us (224us total) trans 0 rc 0/0 00000100:00100000:3.0:1789403579.122701:0:3627:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a144b28a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3627:1876325050865024:0@lo:400:kworker.0 00000100:00100000:1.0:1789403579.122715:0:24295:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1789403579.122720:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1789403579.122734:0:22782:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789403579.122737:0:3627:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:3.0:1789403579.122742:0:3627:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a144b28700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3627:1876325050864384:0@lo:400:kworker.0 00000100:00100000:1.0:1789403579.122745:0:22781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050864000 00000100:00100000:1.0:1789403579.122748:0:22781:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050864000 00000100:00100000:3.0:1789403579.122759:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789403579.122772:0:22781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:3.0:1789403579.122774:0:3627:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a144b2a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3627:1876325050864896:0@lo:400:kworker.0 00000100:00100000:1.0:1789403579.122778:0:22781:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a27c940050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7ccb4038-daf9-4dcd-9b85-da9390181204+24:3627:x1876325050864000:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789403579.122792:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789403579.122807:0:22781:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a27c940050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7ccb4038-daf9-4dcd-9b85-da9390181204+24:3627:x1876325050864000:12345-0@lo:400:kworker.0 Request processed in 29us (180us total) trans 0 rc 0/0 00000100:00100000:1.0:1789403579.122812:0:22781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:3.0:1789403579.122817:0:3627:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a144bedc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7ccb4038-daf9-4dcd-9b85-da9390181204:3627:1876325050864000:0@lo:400:kworker.0 00000100:00100000:1.0:1789403579.122850:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789403579.122851:0:22792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050864512 00000100:00100000:3.0:1789403579.122854:0:22792:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050864512 00000100:00100000:3.0:1789403579.122877:0:22792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1789403579.122877:0:3629:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a141aac380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3629:1876325050864256:0@lo:400:kworker.0 00000100:00100000:3.0:1789403579.122883:0:22792:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a144b29f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3627:x1876325050864512:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789403579.122899:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789403579.122914:0:22792:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a144b29f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3627:x1876325050864512:12345-0@lo:400:kworker.0 Request processed in 31us (228us total) trans 0 rc 0/0 00000100:00100000:3.0:1789403579.122920:0:22792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1789403579.122921:0:3629:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a144b28380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3629:1876325050864768:0@lo:400:kworker.0 00000100:00100000:3.0:1789403579.122937:0:22788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050865024 00000100:00100000:1.0:1789403579.122939:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789403579.122940:0:22788:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050865024 00000100:00100000:1.0:1789403579.122949:0:3629:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a144b29c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3629:1876325050865280:0@lo:400:kworker.0 00000100:00100000:3.0:1789403579.122963:0:22788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050864384 00000100:00100000:3.0:1789403579.122965:0:22788:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050864384 00000100:00100000:3.0:1789403579.122975:0:22788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050864896 00000100:00100000:3.0:1789403579.122978:0:22788:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050864896 00000100:00100000:3.0:1789403579.122988:0:22788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050864768 00000100:00100000:3.0:1789403579.122991:0:22788:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050864768 00000100:00100000:3.0:1789403579.123001:0:22788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1789403579.123027:0:22788:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a144b2ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3627:x1876325050865024:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789403579.123059:0:22788:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a144b2ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3627:x1876325050865024:12345-0@lo:400:kworker.0 Request processed in 47us (337us total) trans 0 rc 0/0 00000100:00100000:3.0:1789403579.123065:0:22788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1789403579.123073:0:3628:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a141aaed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3628:1876325050864128:0@lo:400:kworker.0 00000100:00100000:3.0:1789403579.123088:0:22788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1789403579.123093:0:22788:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a144b2aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3627:x1876325050864384:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789403579.123107:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789403579.123115:0:22788:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a144b2aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3627:x1876325050864384:12345-0@lo:400:kworker.0 Request processed in 23us (355us total) trans 0 rc 0/0 00000100:00100000:3.0:1789403579.123120:0:22788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1789403579.123124:0:3628:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a144b2bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3628:1876325050864640:0@lo:400:kworker.0 00000100:00100000:3.0:1789403579.123130:0:22788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1789403579.123135:0:22788:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a14418d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3627:x1876325050864896:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789403579.123143:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789403579.123158:0:22788:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a14418d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3627:x1876325050864896:12345-0@lo:400:kworker.0 Request processed in 23us (365us total) trans 0 rc 0/0 00000100:00100000:0.0:1789403579.123158:0:3628:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a144b2b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3628:1876325050865152:0@lo:400:kworker.0 00000100:00100000:3.0:1789403579.123164:0:22788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1789403579.123175:0:22788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1789403579.123178:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789403579.123180:0:22788:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a144048e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3629:x1876325050864768:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789403579.123204:0:22788:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a144048e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3629:x1876325050864768:12345-0@lo:400:kworker.0 Request processed in 24us (264us total) trans 0 rc 0/0 00000100:00100000:3.0:1789403579.123210:0:22788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1789403579.123220:0:22788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050865152 00000100:00100000:3.0:1789403579.123222:0:22788:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050865152 00000100:00100000:1.0:1789403579.123226:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789403579.123236:0:22788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050865280 00000100:00100000:3.0:1789403579.123239:0:22788:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050865280 00000100:00100000:3.0:1789403579.123250:0:22788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1789403579.123252:0:3629:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a144beed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3629:1876325050863744:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789403579.123255:0:22788:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a1443e5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3628:x1876325050865152:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789403579.123265:0:3629:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a14404a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3629:1876325050863616:0@lo:13:osp-pre-1-1.0 00010000:00080000:1.0:1789403579.123286:0:3629:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90a144b28380 x1876325050864768/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789403595 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789403579.123293:0:22788:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a1443e5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3628:x1876325050865152:12345-0@lo:400:kworker.0 Request processed in 39us (114us total) trans 0 rc 0/0 00000100:00100000:1.0:1789403579.123297:0:3629:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a144b28380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3629:1876325050864768:0@lo:400:kworker.0 00000100:00100000:3.0:1789403579.123305:0:22788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1789403579.123316:0:22788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1789403579.123316:0:24293:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050864256 00000100:00100000:1.0:1789403579.123319:0:24293:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050864256 00000100:00100000:3.0:1789403579.123322:0:22788:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a14404a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3629:x1876325050865280:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789403579.123343:0:24293:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050864640 00000100:00100000:1.0:1789403579.123351:0:24293:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050864640 00000100:00100000:3.0:1789403579.123353:0:22788:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a14404a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3629:x1876325050865280:12345-0@lo:400:kworker.0 Request processed in 31us (126us total) trans 0 rc 0/0 00000100:00100000:3.0:1789403579.123358:0:22788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1789403579.123369:0:24293:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1789403579.123375:0:24293:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a14404ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3629:x1876325050864256:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789403579.123380:0:24931:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050864128 00000100:00100000:3.0:1789403579.123383:0:24931:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050864128 00000100:00100000:3.0:1789403579.123425:0:24931:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1789403579.123426:0:24293:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a14404ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3629:x1876325050864256:12345-0@lo:400:kworker.0 Request processed in 51us (526us total) trans 0 rc 0/0 00000100:00100000:3.0:1789403579.123430:0:24931:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a1443e6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3628:x1876325050864128:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789403579.123431:0:24293:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1789403579.123442:0:24293:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1789403579.123446:0:24293:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a1443e7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3628:x1876325050864640:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789403579.123457:0:24931:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a1443e6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3628:x1876325050864128:12345-0@lo:400:kworker.0 Request processed in 28us (350us total) trans 0 rc 0/0 00000100:00100000:3.0:1789403579.123463:0:24931:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1789403579.123466:0:24293:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a1443e7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3628:x1876325050864640:12345-0@lo:400:kworker.0 Request processed in 20us (322us total) trans 0 rc 0/0 00000100:00100000:1.0:1789403579.123471:0:24293:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00080000:1.0:1789403579.123486:0:22782:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1789403579.123490:0:3627:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90a144b28700 x1876325050864384/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789403595 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1789403579.123490:0:22782:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789403579.123492:0:22782:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1789403579.123498:0:24295:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050863872 00000100:00100000:3.0:1789403579.123499:0:3627:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a144b28700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3627:1876325050864384:0@lo:400:kworker.0 00000100:00100000:1.0:1789403579.123501:0:24295:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050863872 00010000:00080000:3.0:1789403579.123509:0:3627:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90a144b2a300 x1876325050864896/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789403595 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789403579.123517:0:3627:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a144b2a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3627:1876325050864896:0@lo:400:kworker.0 00000100:00100000:1.0:1789403579.123519:0:24295:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1789403579.123524:0:24295:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a144049180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3626:x1876325050863872:12345-0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789403579.123526:0:3627:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a144b29500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3627:1876325050864512:0@lo:400:kworker.0 00002000:00000024:1.0:1789403579.123533:0:24295:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3915849728 avail 3684327424 00010000:00080000:3.0:1789403579.123534:0:3627:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90a144b28a80 x1876325050865024/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789403595 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789403579.123540:0:3627:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a144b28a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3627:1876325050865024:0@lo:400:kworker.0 00000100:00100000:1.0:1789403579.123560:0:24295:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a144049180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3626:x1876325050863872:12345-0@lo:13:osp-pre-0-0.0 Request processed in 37us (710us total) trans 0 rc 0/0 00000100:00100000:1.0:1789403579.123566:0:24295:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1789403579.123594:0:3626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a144bed180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3626:1876325050863872:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789403579.123612:0:3629:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a141aac380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3629:1876325050864256:0@lo:400:kworker.0 00010000:00080000:1.0:1789403579.123621:0:3629:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90a144b29c00 x1876325050865280/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789403595 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789403579.123643:0:3629:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a144b29c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3629:1876325050865280:0@lo:400:kworker.0 00000100:00100000:0.0:1789403579.123791:0:3628:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a141aaed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3628:1876325050864128:0@lo:400:kworker.0 00000100:00100000:0.0:1789403579.123801:0:3628:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a144b2bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3628:1876325050864640:0@lo:400:kworker.0 00010000:00080000:0.0:1789403579.123809:0:3628:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90a144b2b800 x1876325050865152/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789403595 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789403579.123816:0:3628:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a144b2b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3628:1876325050865152:0@lo:400:kworker.0 00010000:00010000:1.0:1789403579.124775:0:25221:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:0.0:1789403579.636646:0:25516:0:(tgt_mount.c:2346:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1789403579.636964:0:25516:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:2.0:1789403580.145515:0:22775:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1789403580.152220:0:25106:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 12884901890 is committed 00000020:00000004:2.0:1789403580.554133:0:25566:0:(tgt_mount.c:2346:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1789403580.554494:0:25566:0:(tgt_mount.c:2361:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:2.0:1789403580.803291:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:0.0:1789403580.803556:0:22778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038177664 00000100:00100000:0.0:1789403580.803566:0:22778:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038177664 00000100:00100000:0.0:1789403580.803614:0:22778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 115 00000100:00100000:0.0:1789403580.803622:0:22778:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a27c755c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:2386:x1876325038177664:12345-192.168.203.43@tcp:250:mount.lustre.0 00010000:00080000:0.0:1789403580.803649:0:22778:0:(ldlm_lib.c:1453:target_handle_connect()) MGS: connection from 126a363a-19e5-4afb-856a-0efed33190d2@192.168.203.43@tcp t0 exp 0000000000000000 cur 626 last 0 00000020:00000080:0.0:1789403580.803676:0:22778:0:(genops.c:1384:class_connect()) connect: client 126a363a-19e5-4afb-856a-0efed33190d2, cookie 0x5fb08b1e5b762a5f 00000100:00080000:0.0:1789403580.803984:0:22778:0:(import.c:65:import_set_state_nolock()) ffff90a276eb2000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1789403580.804098:0:22778:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a27c755c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:126a363a-19e5-4afb-856a-0efed33190d2+5:2386:x1876325038177664:12345-192.168.203.43@tcp:250:mount.lustre.0 Request processed in 474us (816us total) trans 0 rc 0/0 00000100:00100000:0.0:1789403580.804107:0:22778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 115 00000100:00100000:3.0:1789403580.810599:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:0.0:1789403580.810730:0:22780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038177792 00000100:00100000:0.0:1789403580.810740:0:22780:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038177792 00000100:00100000:0.0:1789403580.810820:0:22780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 116 00000100:00100000:0.0:1789403580.810841:0:22780:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a27c757050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:126a363a-19e5-4afb-856a-0efed33190d2+5:18034:x1876325038177792:12345-192.168.203.43@tcp:101:mount.lustre.0 00010000:00010000:0.0:1789403580.810857:0:22780:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789403580.810873:0:22780:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90a2821e8c00/0x5fb08b1e5b762a66 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x1acb85b3eb128caf expref: -99 pid: 22780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403580.810900:0:22780:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90a2821e8c00/0x5fb08b1e5b762a66 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb128caf expref: 6 pid: 22780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403580.810912:0:22780:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90a2821e8c00/0x5fb08b1e5b762a66 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb128caf expref: 6 pid: 22780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403580.810921:0:22780:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a2821e8c00, rc 0) 00000100:00100000:0.0:1789403580.810990:0:22780:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a27c757050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:126a363a-19e5-4afb-856a-0efed33190d2+6:18034:x1876325038177792:12345-192.168.203.43@tcp:101:mount.lustre.0 Request processed in 151us (400us total) trans 0 rc 0/0 00000100:00100000:0.0:1789403580.810998:0:22780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 116 00000100:00100000:2.0:1789403580.817528:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:1.0:1789403580.819970:0:22781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038177920 00000100:00100000:1.0:1789403580.819985:0:22781:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038177920 00000100:00100000:1.0:1789403580.820042:0:22781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 117 00000100:00100000:1.0:1789403580.820053:0:22781:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a27c754c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:126a363a-19e5-4afb-856a-0efed33190d2+6:18034:x1876325038177920:12345-192.168.203.43@tcp:501:mount.lustre.0 00000100:00100000:1.0:1789403580.820201:0:22781:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a27c754c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:126a363a-19e5-4afb-856a-0efed33190d2+6:18034:x1876325038177920:12345-192.168.203.43@tcp:501:mount.lustre.0 Request processed in 149us (2680us total) trans 0 rc -2/-2 00000100:00100000:1.0:1789403580.820210:0:22781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 117 00000100:00100000:3.0:1789403580.823498:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:2.0:1789403580.824371:0:22778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038178048 00000100:00100000:2.0:1789403580.824382:0:22778:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038178048 00000100:00100000:2.0:1789403580.824573:0:22778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 118 00000100:00100000:2.0:1789403580.824584:0:22778:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a27c942850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:126a363a-19e5-4afb-856a-0efed33190d2+6:18034:x1876325038178048:12345-192.168.203.43@tcp:101:mount.lustre.0 00010000:00010000:2.0:1789403580.824600:0:22778:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789403580.824617:0:22778:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90a270184e00/0x5fb08b1e5b762a6d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: local remote: 0x1acb85b3eb128cb6 expref: -99 pid: 22778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403580.824646:0:22778:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90a270184e00/0x5fb08b1e5b762a6d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000000 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb128cb6 expref: 7 pid: 22778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403580.824676:0:22778:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90a270184e00/0x5fb08b1e5b762a6d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb128cb6 expref: 7 pid: 22778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403580.824685:0:22778:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a270184e00, rc 0) 00000100:00100000:2.0:1789403580.824752:0:22778:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a27c942850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:126a363a-19e5-4afb-856a-0efed33190d2+7:18034:x1876325038178048:12345-192.168.203.43@tcp:101:mount.lustre.0 Request processed in 170us (1265us total) trans 0 rc 0/0 00000100:00100000:2.0:1789403580.824759:0:22778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 118 00000100:00100000:3.0:1789403580.828668:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:0.0:1789403580.828947:0:22780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038178176 00000100:00100000:0.0:1789403580.828956:0:22780:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038178176 00000100:00100000:0.0:1789403580.829012:0:22780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 119 00000100:00100000:0.0:1789403580.829022:0:22780:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a27c755450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:126a363a-19e5-4afb-856a-0efed33190d2+7:18034:x1876325038178176:12345-192.168.203.43@tcp:501:mount.lustre.0 00000100:00100000:0.0:1789403580.829192:0:22780:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a27c755450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:126a363a-19e5-4afb-856a-0efed33190d2+8:18034:x1876325038178176:12345-192.168.203.43@tcp:501:mount.lustre.0 Request processed in 171us (532us total) trans 0 rc 0/0 00000100:00100000:0.0:1789403580.829200:0:22780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 119 00000100:00100000:3.0:1789403580.839093:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:2.0:1789403580.839253:0:22778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038178304 00000100:00100000:2.0:1789403580.839263:0:22778:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038178304 00000100:00100000:2.0:1789403580.839319:0:22778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 120 00000100:00100000:2.0:1789403580.839329:0:22778:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a27c755850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:126a363a-19e5-4afb-856a-0efed33190d2+8:18034:x1876325038178304:12345-192.168.203.43@tcp:503:mount.lustre.0 00000100:00100000:2.0:1789403580.839519:0:22778:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a27c755850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:126a363a-19e5-4afb-856a-0efed33190d2+8:18034:x1876325038178304:12345-192.168.203.43@tcp:503:mount.lustre.0 Request processed in 190us (435us total) trans 0 rc 0/0 00000100:00100000:2.0:1789403580.839527:0:22778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 120 00000100:00100000:3.0:1789403580.842694:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:1.0:1789403580.843168:0:22781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038178432 00000100:00100000:1.0:1789403580.843179:0:22781:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038178432 00000100:00100000:1.0:1789403580.843235:0:22781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 121 00000100:00100000:1.0:1789403580.843245:0:22781:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a27c755050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:126a363a-19e5-4afb-856a-0efed33190d2+8:18053:x1876325038178432:12345-192.168.203.43@tcp:502:llog_process_th.0 00000100:00100000:1.0:1789403580.843430:0:22781:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a27c755050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:126a363a-19e5-4afb-856a-0efed33190d2+8:18053:x1876325038178432:12345-192.168.203.43@tcp:502:llog_process_th.0 Request processed in 186us (745us total) trans 0 rc 0/0 00000100:00100000:1.0:1789403580.843442:0:22781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 121 00000100:00100000:3.0:1789403580.869197:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:0.0:1789403580.869328:0:22780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038178560 00000100:00100000:0.0:1789403580.869338:0:22780:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038178560 00000100:00100000:0.0:1789403580.869418:0:22780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 122 00000100:00100000:0.0:1789403580.869429:0:22780:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a27c757850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:126a363a-19e5-4afb-856a-0efed33190d2+8:18053:x1876325038178560:12345-192.168.203.43@tcp:502:llog_process_th.0 00000100:00100000:0.0:1789403580.869576:0:22780:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a27c757850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:126a363a-19e5-4afb-856a-0efed33190d2+8:18053:x1876325038178560:12345-192.168.203.43@tcp:502:llog_process_th.0 Request processed in 148us (388us total) trans 0 rc 0/0 00000100:00100000:0.0:1789403580.869584:0:22780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 122 00000100:00100000:3.0:1789403580.880954:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:2.0:1789403580.881385:0:22778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038178688 00000100:00100000:2.0:1789403580.881439:0:22778:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038178688 00000100:00100000:2.0:1789403580.881487:0:22778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 123 00000100:00100000:2.0:1789403580.881496:0:22778:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a27c756450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:126a363a-19e5-4afb-856a-0efed33190d2+8:18053:x1876325038178688:12345-192.168.203.43@tcp:502:llog_process_th.0 00000100:00100000:2.0:1789403580.881645:0:22778:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a27c756450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:126a363a-19e5-4afb-856a-0efed33190d2+8:18053:x1876325038178688:12345-192.168.203.43@tcp:502:llog_process_th.0 Request processed in 149us (698us total) trans 0 rc 0/0 00000100:00100000:2.0:1789403580.881652:0:22778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 123 00000100:00100000:3.0:1789403580.891843:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:1.0:1789403580.892058:0:22781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038178816 00000100:00100000:1.0:1789403580.892068:0:22781:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038178816 00000100:00100000:1.0:1789403580.892127:0:22781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 124 00000100:00100000:1.0:1789403580.892138:0:22781:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a27c754450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:126a363a-19e5-4afb-856a-0efed33190d2+8:18034:x1876325038178816:12345-192.168.203.43@tcp:101:mount.lustre.0 00010000:00010000:1.0:1789403580.892154:0:22781:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789403580.892171:0:22781:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90a281b05000/0x5fb08b1e5b762a74 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x1acb85b3eb128ce7 expref: -99 pid: 22781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403580.892201:0:22781:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90a281b05000/0x5fb08b1e5b762a74 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb128ce7 expref: 9 pid: 22781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403580.892226:0:22781:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90a281b05000/0x5fb08b1e5b762a74 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb128ce7 expref: 9 pid: 22781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403580.892235:0:22781:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a281b05000, rc 0) 00000100:00100000:1.0:1789403580.892295:0:22781:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a27c754450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:126a363a-19e5-4afb-856a-0efed33190d2+9:18034:x1876325038178816:12345-192.168.203.43@tcp:101:mount.lustre.0 Request processed in 160us (470us total) trans 0 rc 0/0 00000100:00100000:1.0:1789403580.892302:0:22781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 124 00000100:00100000:3.0:1789403580.896607:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:0.0:1789403580.896777:0:22780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038178944 00000100:00100000:0.0:1789403580.896787:0:22780:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038178944 00000100:00100000:0.0:1789403580.896847:0:22780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 125 00000100:00100000:0.0:1789403580.896857:0:22780:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a27c756c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:126a363a-19e5-4afb-856a-0efed33190d2+9:18034:x1876325038178944:12345-192.168.203.43@tcp:256:mount.lustre.0 20000000:01000000:0.0:1789403580.896881:0:22780:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:0.0:1789403580.896903:0:22780:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:0.0:1789403580.896907:0:22780:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:0.0:1789403580.896911:0:22780:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:0.0:1789403580.896914:0:22780:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/256/255. 20000000:01000000:0.0:1789403580.896916:0:22780:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 14 00000100:00100000:0.0:1789403580.902271:0:22780:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a27c756c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:126a363a-19e5-4afb-856a-0efed33190d2+9:18034:x1876325038178944:12345-192.168.203.43@tcp:256:mount.lustre.0 Request processed in 5406us (5664us total) trans 0 rc 0/0 00000100:00100000:0.0:1789403580.902286:0:22780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 125 00000100:00100000:3.0:1789403580.908630:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:2.0:1789403580.908848:0:22778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038179072 00000100:00100000:2.0:1789403580.908858:0:22778:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038179072 00000100:00100000:2.0:1789403580.908915:0:22778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 126 00000100:00100000:2.0:1789403580.908925:0:22778:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a27c757c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:126a363a-19e5-4afb-856a-0efed33190d2+9:18034:x1876325038179072:12345-192.168.203.43@tcp:101:mount.lustre.0 00010000:00010000:2.0:1789403580.908954:0:22778:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789403580.908972:0:22778:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90a270185000/0x5fb08b1e5b762a7b lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x1acb85b3eb128cee expref: -99 pid: 22778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403580.909001:0:22778:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90a270185000/0x5fb08b1e5b762a7b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb128cee expref: 10 pid: 22778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403580.909012:0:22778:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90a270185000/0x5fb08b1e5b762a7b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb128cee expref: 10 pid: 22778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403580.909020:0:22778:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a270185000, rc 0) 00000100:00100000:2.0:1789403580.909079:0:22778:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a27c757c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:126a363a-19e5-4afb-856a-0efed33190d2+10:18034:x1876325038179072:12345-192.168.203.43@tcp:101:mount.lustre.0 Request processed in 156us (457us total) trans 0 rc 0/0 00000100:00100000:2.0:1789403580.909087:0:22778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 126 00000100:00100000:3.0:1789403580.913793:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:0.0:1789403580.913916:0:22780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038179200 00000100:00100000:0.0:1789403580.913926:0:22780:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038179200 00000100:00100000:0.0:1789403580.913987:0:22780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 127 00000100:00100000:0.0:1789403580.913997:0:22780:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a27c754850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:126a363a-19e5-4afb-856a-0efed33190d2+10:18034:x1876325038179200:12345-192.168.203.43@tcp:501:mount.lustre.0 00000100:00100000:0.0:1789403580.914139:0:22780:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a27c754850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:126a363a-19e5-4afb-856a-0efed33190d2+10:18034:x1876325038179200:12345-192.168.203.43@tcp:501:mount.lustre.0 Request processed in 143us (354us total) trans 0 rc 0/0 00000100:00100000:0.0:1789403580.914147:0:22780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 127 00000100:00100000:2.0:1789403580.918985:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:1.0:1789403580.919104:0:22781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038179328 00000100:00100000:1.0:1789403580.919114:0:22781:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038179328 00000100:00100000:1.0:1789403580.919217:0:22781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 128 00000100:00100000:1.0:1789403580.919228:0:22781:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a277f41850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:126a363a-19e5-4afb-856a-0efed33190d2+10:18034:x1876325038179328:12345-192.168.203.43@tcp:503:mount.lustre.0 00000100:00100000:1.0:1789403580.919385:0:22781:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a277f41850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:126a363a-19e5-4afb-856a-0efed33190d2+10:18034:x1876325038179328:12345-192.168.203.43@tcp:503:mount.lustre.0 Request processed in 158us (408us total) trans 0 rc 0/0 00000100:00100000:1.0:1789403580.919426:0:22781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 128 00000100:00100000:2.0:1789403580.922174:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:0.0:1789403580.929749:0:22780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038179456 00000100:00100000:0.0:1789403580.929764:0:22780:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038179456 00000100:00100000:0.0:1789403580.929847:0:22780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 129 00000100:00100000:0.0:1789403580.929872:0:22780:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a277f43050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:126a363a-19e5-4afb-856a-0efed33190d2+10:18057:x1876325038179456:12345-192.168.203.43@tcp:502:llog_process_th.0 00000100:00100000:0.0:1789403580.930426:0:22780:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a277f43050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:126a363a-19e5-4afb-856a-0efed33190d2+10:18057:x1876325038179456:12345-192.168.203.43@tcp:502:llog_process_th.0 Request processed in 555us (8257us total) trans 0 rc 0/0 00000100:00100000:0.0:1789403580.930434:0:22780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 129 00000100:00100000:3.0:1789403580.935709:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:1.0:1789403580.936205:0:22778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038179584 00000100:00100000:1.0:1789403580.936215:0:22778:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038179584 00000100:00100000:1.0:1789403580.936277:0:22778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 130 00000100:00100000:1.0:1789403580.936287:0:22778:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a277f43c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:126a363a-19e5-4afb-856a-0efed33190d2+10:18057:x1876325038179584:12345-192.168.203.43@tcp:502:llog_process_th.0 00000100:00100000:1.0:1789403580.937644:0:22778:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a277f43c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:126a363a-19e5-4afb-856a-0efed33190d2+10:18057:x1876325038179584:12345-192.168.203.43@tcp:502:llog_process_th.0 Request processed in 1351us (1936us total) trans 0 rc 0/0 00000100:00100000:1.0:1789403580.937655:0:22778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 130 00000100:00100000:2.0:1789403580.946694:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:2.0:1789403580.946736:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:0.0:1789403580.950296:0:22787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038179712 00000100:00100000:0.0:1789403580.950447:0:22787:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038179712 00000100:00100000:0.0:1789403580.950794:0:22787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038179968 00000100:00100000:0.0:1789403580.950799:0:22787:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038179968 00000100:00100000:2.0:1789403580.955284:0:22786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 7 00000100:00100000:2.0:1789403580.955298:0:22786:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a281911880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2386:x1876325038179712:12345-192.168.203.43@tcp:38:mount.lustre.0 00010000:00080000:2.0:1789403580.955415:0:22786:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from 5aa3c32d-0021-4831-930f-6e88a8b78157@192.168.203.43@tcp t0 exp 0000000000000000 cur 626 last 0 00000020:00000080:2.0:1789403580.955728:0:22786:0:(genops.c:1384:class_connect()) connect: client 5aa3c32d-0021-4831-930f-6e88a8b78157, cookie 0x5fb08b1e5b762a82 00000004:00100000:2.0:1789403580.955754:0:22786:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:2.0:1789403580.958032:0:22786:0:(import.c:65:import_set_state_nolock()) ffff90a276e12800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1789403580.958109:0:22786:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a281911880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5aa3c32d-0021-4831-930f-6e88a8b78157+6:2386:x1876325038179712:12345-192.168.203.43@tcp:38:mount.lustre.0 Request processed in 2811us (11423us total) trans 0 rc 0/0 00000100:00100000:2.0:1789403580.958140:0:22786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 7 00000100:00100000:2.0:1789403580.958171:0:22786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 8 00000100:00100000:2.0:1789403580.958178:0:22786:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a27a64d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2386:x1876325038179968:12345-192.168.203.43@tcp:38:mount.lustre.0 00010000:00080000:2.0:1789403580.959039:0:22786:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0001: connection from 5aa3c32d-0021-4831-930f-6e88a8b78157@192.168.203.43@tcp t0 exp 0000000000000000 cur 626 last 0 00000020:00000080:2.0:1789403580.959087:0:22786:0:(genops.c:1384:class_connect()) connect: client 5aa3c32d-0021-4831-930f-6e88a8b78157, cookie 0x5fb08b1e5b762a89 00000004:00100000:2.0:1789403580.959108:0:22786:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0001: cli supports cksum type f7, return f7 00000100:00080000:2.0:1789403580.960372:0:22786:0:(import.c:65:import_set_state_nolock()) ffff90a275112800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1789403580.960459:0:22786:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a27a64d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5aa3c32d-0021-4831-930f-6e88a8b78157+6:2386:x1876325038179968:12345-192.168.203.43@tcp:38:mount.lustre.0 Request processed in 2278us (13719us total) trans 0 rc 0/0 00000100:00100000:2.0:1789403580.960469:0:22786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 8 00000100:00100000:2.0:1789403580.962070:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:2.0:1789403580.962109:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:0.0:1789403580.962193:0:22787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038180224 00000100:00100000:0.0:1789403580.962212:0:22787:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038180224 00000100:00100000:0.0:1789403580.962285:0:22787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038179840 00000100:00080000:1.0:1789403580.962289:0:22782:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789403580.962290:0:22787:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038179840 00000100:00100000:2.0:1789403580.962338:0:22786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 9 00000100:00100000:2.0:1789403580.965111:0:22786:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a142500000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5aa3c32d-0021-4831-930f-6e88a8b78157+7:18034:x1876325038180224:12345-192.168.203.43@tcp:41:mount.lustre.0 00000004:00000024:2.0:1789403580.965159:0:22786:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446309888 avail 1300070400 00000100:00100000:2.0:1789403580.965381:0:22786:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a142500000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5aa3c32d-0021-4831-930f-6e88a8b78157+7:18034:x1876325038180224:12345-192.168.203.43@tcp:41:mount.lustre.0 Request processed in 3033us (3320us total) trans 0 rc 0/0 00000100:00100000:2.0:1789403580.965406:0:22786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 9 00000100:00100000:1.0:1789403580.965635:0:22787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 10 00000100:00100000:1.0:1789403580.965646:0:22787:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a142502300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5aa3c32d-0021-4831-930f-6e88a8b78157+6:0:x1876325038179840:12345-192.168.203.43@tcp:41:mount.lustre.0 00000004:00000024:1.0:1789403580.965678:0:22787:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446309888 avail 1300070400 00000100:00100000:1.0:1789403580.965710:0:22787:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a142502300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5aa3c32d-0021-4831-930f-6e88a8b78157+6:0:x1876325038179840:12345-192.168.203.43@tcp:41:mount.lustre.0 Request processed in 67us (3601us total) trans 0 rc 0/0 00000100:00100000:1.0:1789403580.965717:0:22787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 10 00000100:00100000:0.0:1789403580.976226:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:0.0:1789403580.976271:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:2.0:1789403580.976372:0:22786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038180352 00000100:00100000:2.0:1789403580.976382:0:22786:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038180352 00000100:00100000:2.0:1789403580.976474:0:22786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038180096 00000100:00100000:2.0:1789403580.976477:0:22786:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038180096 00000100:00100000:2.0:1789403580.976508:0:22786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 11 00000100:00100000:2.0:1789403580.976517:0:22786:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a1443e4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5aa3c32d-0021-4831-930f-6e88a8b78157+6:18034:x1876325038180352:12345-192.168.203.43@tcp:40:mount.lustre.0 00000100:00080000:0.0:1789403580.976750:0:22782:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1789403580.976872:0:22786:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a1443e4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5aa3c32d-0021-4831-930f-6e88a8b78157+6:18034:x1876325038180352:12345-192.168.203.43@tcp:40:mount.lustre.0 Request processed in 356us (656us total) trans 0 rc 0/0 00000100:00100000:2.0:1789403580.976881:0:22786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 11 00000100:00100000:2.0:1789403580.976901:0:22786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 12 00000100:00100000:2.0:1789403580.976910:0:22786:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a1442ef800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5aa3c32d-0021-4831-930f-6e88a8b78157+6:0:x1876325038180096:12345-192.168.203.43@tcp:41:mount.lustre.0 00000004:00000024:2.0:1789403580.976945:0:22786:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446461440 avail 1300221952 00000100:00100000:2.0:1789403580.976998:0:22786:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a1442ef800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5aa3c32d-0021-4831-930f-6e88a8b78157+6:0:x1876325038180096:12345-192.168.203.43@tcp:41:mount.lustre.0 Request processed in 89us (726us total) trans 0 rc 0/0 00000100:00100000:2.0:1789403580.977005:0:22786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 12 00000100:00100000:3.0:1789403580.982706:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:0.0:1789403580.982889:0:22797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038180736 00000100:00100000:0.0:1789403580.982900:0:22797:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038180736 00000100:00100000:0.0:1789403580.982962:0:22797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 3 00000100:00100000:0.0:1789403580.982973:0:22797:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a14418fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:5aa3c32d-0021-4831-930f-6e88a8b78157+6:18034:x1876325038180736:12345-192.168.203.43@tcp:900:mount.lustre.0 00000100:00100000:0.0:1789403580.983065:0:22797:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a14418fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:5aa3c32d-0021-4831-930f-6e88a8b78157+6:18034:x1876325038180736:12345-192.168.203.43@tcp:900:mount.lustre.0 Request processed in 93us (366us total) trans 0 rc 0/0 00000100:00100000:0.0:1789403580.983073:0:22797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 3 00000100:00100000:3.0:1789403580.986090:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:3.0:1789403580.986139:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:1.0:1789403580.986838:0:24293:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038180480 00000100:00100000:1.0:1789403580.986849:0:24293:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038180480 00000100:00100000:1.0:1789403580.986894:0:24293:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038180608 00000100:00100000:1.0:1789403580.986898:0:24293:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038180608 00000100:00100000:1.0:1789403580.986917:0:24293:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 16 00000100:00100000:1.0:1789403580.986924:0:24293:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a14418e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2386:x1876325038180480:12345-192.168.203.43@tcp:8:mount.lustre.0 00010000:00080000:1.0:1789403580.986955:0:24293:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0000: connection from 5aa3c32d-0021-4831-930f-6e88a8b78157@192.168.203.43@tcp t0 exp 0000000000000000 cur 626 last 0 00000020:00000080:1.0:1789403580.986984:0:24293:0:(genops.c:1384:class_connect()) connect: client 5aa3c32d-0021-4831-930f-6e88a8b78157, cookie 0x5fb08b1e5b762a90 00002000:00100000:1.0:1789403580.986995:0:24293:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 5aa3c32d-0021-4831-930f-6e88a8b78157/ffff90a276e2b800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a27 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1789403580.987012:0:24293:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00000100:00100000:0.0:1789403580.987202:0:25213:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 17 00000100:00100000:0.0:1789403580.987209:0:25213:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a14418d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:0+-99:2386:x1876325038180608:12345-192.168.203.43@tcp:8:mount.lustre.0 00010000:00080000:0.0:1789403580.987228:0:25213:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0001: connection from 5aa3c32d-0021-4831-930f-6e88a8b78157@192.168.203.43@tcp t0 exp 0000000000000000 cur 626 last 0 00000020:00000080:0.0:1789403580.987247:0:25213:0:(genops.c:1384:class_connect()) connect: client 5aa3c32d-0021-4831-930f-6e88a8b78157, cookie 0x5fb08b1e5b762a97 00002000:00100000:0.0:1789403580.987253:0:25213:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 5aa3c32d-0021-4831-930f-6e88a8b78157/ffff90a276eb5800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a27 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1789403580.987272:0:25213:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:0.0:1789403580.987477:0:25213:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1789403580.987509:0:25213:0:(import.c:65:import_set_state_nolock()) ffff90a276eb2800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1789403580.987567:0:25213:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a14418d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:5aa3c32d-0021-4831-930f-6e88a8b78157+6:2386:x1876325038180608:12345-192.168.203.43@tcp:8:mount.lustre.0 Request processed in 356us (1427us total) trans 0 rc 0/0 00000100:00100000:0.0:1789403580.988226:0:25213:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 17 00002000:00080000:1.0:1789403580.988743:0:24293:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:1.0:1789403580.988772:0:24293:0:(import.c:65:import_set_state_nolock()) ffff90a276e2e000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1789403580.988838:0:24293:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a14418e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5aa3c32d-0021-4831-930f-6e88a8b78157+6:2386:x1876325038180480:12345-192.168.203.43@tcp:8:mount.lustre.0 Request processed in 1911us (2758us total) trans 0 rc 0/0 00000100:00100000:1.0:1789403580.988845:0:24293:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 16 00000100:00100000:0.0:1789403580.989331:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:3.0:1789403580.989890:0:22789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038180864 00000100:00100000:3.0:1789403580.989899:0:22789:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038180864 00000100:00100000:3.0:1789403580.990358:0:22789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 0 00000100:00100000:3.0:1789403580.990371:0:22789:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a1441d9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5aa3c32d-0021-4831-930f-6e88a8b78157+6:18034:x1876325038180864:12345-192.168.203.43@tcp:33:mount.lustre.0 00000004:00080000:2.0:1789403580.997944:0:22789:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 7453us 00000004:00200000:0.0:1789403581.026263:0:22789:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000100:00100000:0.0:1789403581.026429:0:22789:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a1441d9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5aa3c32d-0021-4831-930f-6e88a8b78157+6:18034:x1876325038180864:12345-192.168.203.43@tcp:33:mount.lustre.0 Request processed in 36053us (37092us total) trans 0 rc 0/0 00000100:00100000:0.0:1789403581.026443:0:22789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 0 00010000:00010000:0.0:1789403581.170557:0:22774:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789403581.309668:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:3.0:1789403581.309817:0:22788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038180992 00000100:00100000:3.0:1789403581.309848:0:22788:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038180992 00000100:00100000:3.0:1789403581.309911:0:22788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 13 00000100:00100000:3.0:1789403581.309922:0:22788:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a1441d8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5aa3c32d-0021-4831-930f-6e88a8b78157+6:18080:x1876325038180992:12345-192.168.203.43@tcp:101:mkdir.0 00010000:00010000:3.0:1789403581.309942:0:22788:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789403581.309967:0:22788:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a259947800/0x5fb08b1e5b762a9e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1acb85b3eb128d1f expref: -99 pid: 22788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403581.310066:0:22788:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a259946e00/0x5fb08b1e5b762aa5 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 22788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403581.310080:0:22788:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a259946e00/0x5fb08b1e5b762aa5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403581.310094:0:22788:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a259946e00/0x5fb08b1e5b762aa5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22788 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789403581.310136:0:22788:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1789403581.310140:0:22788:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1789403581.310187:0:22788:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90a259946e00/0x5fb08b1e5b762aa5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403581.310212:0:22788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a259947800/0x5fb08b1e5b762a9e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb128d1f expref: 8 pid: 22788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403581.310231:0:22788:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90a259946e00/0x5fb08b1e5b762aa5 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb128d1f expref: 7 pid: 22788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403581.310239:0:22788:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90a2609b8200) 00010000:00010000:3.0:1789403581.310242:0:22788:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789403581.310246:0:22788:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a259946e00, rc 0) 00000100:00100000:3.0:1789403581.310315:0:22788:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a1441d8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5aa3c32d-0021-4831-930f-6e88a8b78157+7:18080:x1876325038180992:12345-192.168.203.43@tcp:101:mkdir.0 Request processed in 394us (657us total) trans 0 rc 0/0 00000100:00100000:3.0:1789403581.310323:0:22788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 13 00000040:00080000:1.0:1789403581.747304:0:22826:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1789403582.193660:0:25221:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789403583.217568:0:22775:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789403583.467112:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:3.0:1789403583.467224:0:22787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038181120 00000100:00100000:3.0:1789403583.467234:0:22787:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038181120 00000100:00100000:3.0:1789403583.467325:0:22787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 14 00000100:00080000:0.0:1789403583.467326:0:22782:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789403583.467338:0:22787:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a14404a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5aa3c32d-0021-4831-930f-6e88a8b78157+7:18132:x1876325038181120:12345-192.168.203.43@tcp:41:lfs.0 00000004:00000024:3.0:1789403583.467378:0:22787:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446309888 avail 1300070400 00000100:00100000:3.0:1789403583.467500:0:22787:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a14404a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5aa3c32d-0021-4831-930f-6e88a8b78157+7:18132:x1876325038181120:12345-192.168.203.43@tcp:41:lfs.0 Request processed in 165us (396us total) trans 0 rc 0/0 00000100:00100000:3.0:1789403583.467507:0:22787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 14 00000100:00100000:1.0:1789403583.474742:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:3.0:1789403583.474914:0:22788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038181248 00000100:00100000:3.0:1789403583.474925:0:22788:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038181248 00000100:00100000:3.0:1789403583.475002:0:22788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 15 00000100:00100000:3.0:1789403583.475014:0:22788:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a144048a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5aa3c32d-0021-4831-930f-6e88a8b78157+6:18132:x1876325038181248:12345-192.168.203.43@tcp:41:lfs.0 00000100:00080000:0.0:1789403583.475024:0:22782:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000004:00000024:3.0:1789403583.475050:0:22788:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446461440 avail 1300221952 00000100:00100000:3.0:1789403583.475157:0:22788:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a144048a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5aa3c32d-0021-4831-930f-6e88a8b78157+6:18132:x1876325038181248:12345-192.168.203.43@tcp:41:lfs.0 Request processed in 146us (424us total) trans 0 rc 0/0 00000100:00100000:3.0:1789403583.475164:0:22788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 15 00000100:00100000:0.0:1789403583.478933:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:1.0:1789403583.479073:0:24295:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038181376 00000100:00100000:1.0:1789403583.479082:0:24295:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038181376 00000100:00100000:1.0:1789403583.479161:0:24295:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 9 00000100:00100000:1.0:1789403583.479313:0:24295:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a1441db800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:5aa3c32d-0021-4831-930f-6e88a8b78157+6:18132:x1876325038181376:12345-192.168.203.43@tcp:13:lfs.0 00002000:00000024:1.0:1789403583.479346:0:24295:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3915849728 avail 3684327424 00000100:00100000:1.0:1789403583.479478:0:24295:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a1441db800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:5aa3c32d-0021-4831-930f-6e88a8b78157+6:18132:x1876325038181376:12345-192.168.203.43@tcp:13:lfs.0 Request processed in 168us (552us total) trans 0 rc 0/0 00000100:00080000:0.0:1789403583.480914:0:22782:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789403583.481506:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:2.0:1789403583.482310:0:24294:0:(service.c:3467:ptlrpc_start_thread()) ost_create[0] started 2 min 2 max 16 00000100:00100000:2.0:1789403583.482323:0:24294:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_create00_002' 00000100:00100000:1.0:1789403583.483447:0:24295:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 9 00000100:00100000:1.0:1789403583.483599:0:24295:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038181504 00000100:00100000:1.0:1789403583.483608:0:24295:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038181504 00000100:00100000:1.0:1789403583.483733:0:24295:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 10 00000100:00100000:1.0:1789403583.483743:0:24295:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a14418f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:5aa3c32d-0021-4831-930f-6e88a8b78157+6:18132:x1876325038181504:12345-192.168.203.43@tcp:13:lfs.0 00002000:00000024:1.0:1789403583.483778:0:24295:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923513344 avail 3691991040 00000100:00100000:1.0:1789403583.483969:0:24295:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a14418f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:5aa3c32d-0021-4831-930f-6e88a8b78157+6:18132:x1876325038181504:12345-192.168.203.43@tcp:13:lfs.0 Request processed in 226us (2465us total) trans 0 rc 0/0 00000100:00100000:1.0:1789403583.483976:0:24295:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 10 00000100:00080000:0.0:1789403583.484969:0:22782:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789403583.729847:0:3627:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789403583.729875:0:3627:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a142503800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3627:1876325050865408:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1789403583.729953:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789403583.730044:0:24931:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050865408 00000100:00100000:3.0:1789403583.730051:0:24931:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050865408 00000100:00100000:3.0:1789403583.730093:0:24931:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1789403583.730102:0:24931:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a14418ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3627:x1876325050865408:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1789403583.730126:0:24931:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446309888 avail 1300070400 00000100:00100000:3.0:1789403583.730173:0:24931:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a14418ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3627:x1876325050865408:12345-0@lo:41:osp-pre-0-1.0 Request processed in 72us (220us total) trans 0 rc 0/0 00000100:00100000:3.0:1789403583.730179:0:24931:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1789403583.730219:0:3627:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a14418ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3627:1876325050865536:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1789403583.730244:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789403583.730285:0:3627:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a142503800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3627:1876325050865408:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1789403583.730310:0:22792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050865536 00000100:00100000:3.0:1789403583.730313:0:22792:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050865536 00000100:00100000:3.0:1789403583.730338:0:22792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1789403583.730343:0:22792:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a14418ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3627:x1876325050865536:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1789403583.730356:0:22792:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446461440 avail 1300221952 00000100:00100000:3.0:1789403583.730433:0:22792:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a14418ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3627:x1876325050865536:12345-0@lo:41:osp-pre-1-0.0 Request processed in 89us (188us total) trans 0 rc 0/0 00000100:00100000:3.0:1789403583.730439:0:22792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1789403583.730467:0:3627:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a14418ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3627:1876325050865536:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1789403583.730712:0:3629:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789403583.730724:0:3629:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a142500380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3629:1876325050865664:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1789403583.730759:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789403583.730789:0:24295:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050865664 00000100:00100000:1.0:1789403583.730794:0:24295:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050865664 00000100:00100000:1.0:1789403583.730843:0:24295:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1789403583.730850:0:24295:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a144048700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3629:x1876325050865664:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1789403583.730864:0:24295:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3915849728 avail 3684327424 00000100:00100000:1.0:1789403583.730898:0:24295:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a144048700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3629:x1876325050865664:12345-0@lo:13:osp-pre-0-1.0 Request processed in 49us (138us total) trans 0 rc 0/0 00000100:00100000:1.0:1789403583.730905:0:24295:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1789403583.730952:0:3629:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a142500380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3629:1876325050865664:0@lo:13:osp-pre-0-1.0 00000100:00080000:0.0:1789403583.731231:0:22782:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789403583.740860:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:1.0:1789403583.747198:0:22781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038181632 00000100:00100000:1.0:1789403583.747216:0:22781:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038181632 00000100:00100000:1.0:1789403583.747295:0:22781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 131 00000100:00100000:1.0:1789403583.747306:0:22781:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a277f40c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:126a363a-19e5-4afb-856a-0efed33190d2+10:18165:x1876325038181632:12345-192.168.203.43@tcp:101:mount.lustre.0 00010000:00010000:1.0:1789403583.747324:0:22781:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789403583.747341:0:22781:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90a281b04e00/0x5fb08b1e5b762aac lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: local remote: 0x1acb85b3eb128d26 expref: -99 pid: 22781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403583.747370:0:22781:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90a281b04e00/0x5fb08b1e5b762aac lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000000 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb128d26 expref: 11 pid: 22781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403583.747382:0:22781:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90a281b04e00/0x5fb08b1e5b762aac lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb128d26 expref: 11 pid: 22781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403583.747410:0:22781:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a281b04e00, rc 0) 00000100:00100000:1.0:1789403583.747484:0:22781:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a277f40c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:126a363a-19e5-4afb-856a-0efed33190d2+11:18165:x1876325038181632:12345-192.168.203.43@tcp:101:mount.lustre.0 Request processed in 179us (6634us total) trans 0 rc 0/0 00000100:00100000:1.0:1789403583.747491:0:22781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 131 00000100:00100000:3.0:1789403583.771304:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:0.0:1789403583.773284:0:22780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038181760 00000100:00100000:0.0:1789403583.773298:0:22780:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038181760 00000100:00100000:0.0:1789403583.773375:0:22780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 132 00000100:00100000:0.0:1789403583.773386:0:22780:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a277f42850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:126a363a-19e5-4afb-856a-0efed33190d2+11:18165:x1876325038181760:12345-192.168.203.43@tcp:501:mount.lustre.0 00000100:00100000:0.0:1789403583.773648:0:22780:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a277f42850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:126a363a-19e5-4afb-856a-0efed33190d2+11:18165:x1876325038181760:12345-192.168.203.43@tcp:501:mount.lustre.0 Request processed in 263us (2352us total) trans 0 rc 0/0 00000100:00100000:0.0:1789403583.773658:0:22780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 132 00000100:00100000:2.0:1789403583.785351:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:3.0:1789403583.785627:0:22778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038181888 00000100:00100000:3.0:1789403583.785637:0:22778:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038181888 00000100:00100000:3.0:1789403583.785698:0:22778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 133 00000100:00100000:3.0:1789403583.785709:0:22778:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a26c7fd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:126a363a-19e5-4afb-856a-0efed33190d2+11:18165:x1876325038181888:12345-192.168.203.43@tcp:503:mount.lustre.0 00000100:00100000:3.0:1789403583.785889:0:22778:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a26c7fd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:126a363a-19e5-4afb-856a-0efed33190d2+11:18165:x1876325038181888:12345-192.168.203.43@tcp:503:mount.lustre.0 Request processed in 181us (545us total) trans 0 rc 0/0 00000100:00100000:3.0:1789403583.785898:0:22778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 133 00000100:00100000:3.0:1789403583.792336:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:0.0:1789403583.792713:0:22780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038182016 00000100:00100000:0.0:1789403583.792738:0:22780:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038182016 00000100:00100000:0.0:1789403583.792794:0:22780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 134 00000100:00100000:0.0:1789403583.792814:0:22780:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a26c7ff050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:126a363a-19e5-4afb-856a-0efed33190d2+11:18171:x1876325038182016:12345-192.168.203.43@tcp:502:llog_process_th.0 00000100:00100000:0.0:1789403583.792976:0:22780:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a26c7ff050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:126a363a-19e5-4afb-856a-0efed33190d2+11:18171:x1876325038182016:12345-192.168.203.43@tcp:502:llog_process_th.0 Request processed in 172us (646us total) trans 0 rc 0/0 00000100:00100000:0.0:1789403583.792992:0:22780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 134 00000100:00100000:0.0:1789403583.818883:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:1.0:1789403583.819089:0:22781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038182144 00000100:00100000:1.0:1789403583.819101:0:22781:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038182144 00000100:00100000:1.0:1789403583.819196:0:22781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 135 00000100:00100000:1.0:1789403583.819206:0:22781:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a26c7fc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:126a363a-19e5-4afb-856a-0efed33190d2+11:18171:x1876325038182144:12345-192.168.203.43@tcp:502:llog_process_th.0 00000100:00100000:1.0:1789403583.819372:0:22781:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a26c7fc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:126a363a-19e5-4afb-856a-0efed33190d2+11:18171:x1876325038182144:12345-192.168.203.43@tcp:502:llog_process_th.0 Request processed in 166us (497us total) trans 0 rc 0/0 00000100:00100000:1.0:1789403583.819380:0:22781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 135 00000100:00100000:2.0:1789403583.821184:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:3.0:1789403583.821261:0:22778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038182272 00000100:00100000:3.0:1789403583.821269:0:22778:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038182272 00000100:00100000:3.0:1789403583.821320:0:22778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 136 00000100:00100000:3.0:1789403583.821330:0:22778:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a26c7fe050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:126a363a-19e5-4afb-856a-0efed33190d2+11:18171:x1876325038182272:12345-192.168.203.43@tcp:502:llog_process_th.0 00000100:00100000:3.0:1789403583.821504:0:22778:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a26c7fe050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:126a363a-19e5-4afb-856a-0efed33190d2+11:18171:x1876325038182272:12345-192.168.203.43@tcp:502:llog_process_th.0 Request processed in 175us (326us total) trans 0 rc 0/0 00000100:00100000:3.0:1789403583.821516:0:22778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 136 00000100:00100000:3.0:1789403583.831218:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:1.0:1789403583.831380:0:22781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038182400 00000100:00100000:1.0:1789403583.831415:0:22781:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038182400 00000100:00100000:1.0:1789403583.831486:0:22781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 137 00000100:00100000:1.0:1789403583.831496:0:22781:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a26c7fe450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:126a363a-19e5-4afb-856a-0efed33190d2+11:18165:x1876325038182400:12345-192.168.203.43@tcp:101:mount.lustre.0 00010000:00010000:1.0:1789403583.831521:0:22781:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789403583.831539:0:22781:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90a281b05200/0x5fb08b1e5b762ab3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x1acb85b3eb128d57 expref: -99 pid: 22781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403583.831566:0:22781:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90a281b05200/0x5fb08b1e5b762ab3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb128d57 expref: 12 pid: 22781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403583.831577:0:22781:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90a281b05200/0x5fb08b1e5b762ab3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb128d57 expref: 12 pid: 22781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403583.831585:0:22781:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a281b05200, rc 0) 00000100:00100000:1.0:1789403583.831656:0:22781:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a26c7fe450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:126a363a-19e5-4afb-856a-0efed33190d2+12:18165:x1876325038182400:12345-192.168.203.43@tcp:101:mount.lustre.0 Request processed in 162us (447us total) trans 0 rc 0/0 00000100:00100000:1.0:1789403583.831662:0:22781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 137 00000100:00100000:1.0:1789403583.843099:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:0.0:1789403583.843238:0:22780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038182528 00000100:00100000:0.0:1789403583.843248:0:22780:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038182528 00000100:00100000:0.0:1789403583.843302:0:22780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 138 00000100:00100000:0.0:1789403583.843313:0:22780:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a26c7fe850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:126a363a-19e5-4afb-856a-0efed33190d2+12:18165:x1876325038182528:12345-192.168.203.43@tcp:256:mount.lustre.0 20000000:01000000:0.0:1789403583.843337:0:22780:0:(mgs_nids.c:915:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:0.0:1789403583.843360:0:22780:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:0.0:1789403583.843364:0:22780:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:0.0:1789403583.843368:0:22780:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:0.0:1789403583.843371:0:22780:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/256/255. 20000000:01000000:0.0:1789403583.843374:0:22780:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 14 00000100:00100000:0.0:1789403583.845899:0:22780:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a26c7fe850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:126a363a-19e5-4afb-856a-0efed33190d2+12:18165:x1876325038182528:12345-192.168.203.43@tcp:256:mount.lustre.0 Request processed in 2579us (2799us total) trans 0 rc 0/0 00000100:00100000:0.0:1789403583.845914:0:22780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 138 00000100:00100000:3.0:1789403583.850584:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:1.0:1789403583.851014:0:22778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038182656 00000100:00100000:1.0:1789403583.851025:0:22778:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038182656 00000100:00100000:1.0:1789403583.851090:0:22778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 139 00000100:00100000:1.0:1789403583.851100:0:22778:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a26c7fdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:126a363a-19e5-4afb-856a-0efed33190d2+12:18165:x1876325038182656:12345-192.168.203.43@tcp:101:mount.lustre.0 00010000:00010000:1.0:1789403583.851118:0:22778:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789403583.851134:0:22778:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90a281b05a00/0x5fb08b1e5b762aba lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x1acb85b3eb128d5e expref: -99 pid: 22778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403583.851163:0:22778:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90a281b05a00/0x5fb08b1e5b762aba lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb128d5e expref: 13 pid: 22778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403583.851194:0:22778:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90a281b05a00/0x5fb08b1e5b762aba lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb128d5e expref: 13 pid: 22778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403583.851204:0:22778:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a281b05a00, rc 0) 00000100:00100000:1.0:1789403583.851268:0:22778:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a26c7fdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:126a363a-19e5-4afb-856a-0efed33190d2+13:18165:x1876325038182656:12345-192.168.203.43@tcp:101:mount.lustre.0 Request processed in 169us (693us total) trans 0 rc 0/0 00000100:00100000:1.0:1789403583.851275:0:22778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 139 00000100:00100000:1.0:1789403583.854288:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:0.0:1789403583.854435:0:22780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038182784 00000100:00100000:0.0:1789403583.854445:0:22780:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038182784 00000100:00100000:0.0:1789403583.854501:0:22780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 140 00000100:00100000:0.0:1789403583.854519:0:22780:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a26c7fec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:126a363a-19e5-4afb-856a-0efed33190d2+13:18165:x1876325038182784:12345-192.168.203.43@tcp:501:mount.lustre.0 00000100:00100000:0.0:1789403583.854844:0:22780:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a26c7fec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:126a363a-19e5-4afb-856a-0efed33190d2+13:18165:x1876325038182784:12345-192.168.203.43@tcp:501:mount.lustre.0 Request processed in 334us (563us total) trans 0 rc 0/0 00000100:00100000:0.0:1789403583.854869:0:22780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 140 00000100:00100000:3.0:1789403583.857790:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:2.0:1789403583.858235:0:22781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038182912 00000100:00100000:2.0:1789403583.858246:0:22781:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038182912 00000100:00100000:2.0:1789403583.858304:0:22781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 141 00000100:00100000:2.0:1789403583.858315:0:22781:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a26c7ffc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:126a363a-19e5-4afb-856a-0efed33190d2+13:18165:x1876325038182912:12345-192.168.203.43@tcp:503:mount.lustre.0 00000100:00100000:2.0:1789403583.858713:0:22781:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a26c7ffc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:126a363a-19e5-4afb-856a-0efed33190d2+13:18165:x1876325038182912:12345-192.168.203.43@tcp:503:mount.lustre.0 Request processed in 399us (930us total) trans 0 rc 0/0 00000100:00100000:2.0:1789403583.858721:0:22781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 141 00000100:00100000:1.0:1789403583.864782:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:3.0:1789403583.864973:0:22778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038183040 00000100:00100000:3.0:1789403583.864983:0:22778:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038183040 00000100:00100000:3.0:1789403583.865138:0:22778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 142 00000100:00100000:3.0:1789403583.865149:0:22778:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a26c7fc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:126a363a-19e5-4afb-856a-0efed33190d2+13:18174:x1876325038183040:12345-192.168.203.43@tcp:502:llog_process_th.0 00000100:00100000:3.0:1789403583.865317:0:22778:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a26c7fc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:126a363a-19e5-4afb-856a-0efed33190d2+13:18174:x1876325038183040:12345-192.168.203.43@tcp:502:llog_process_th.0 Request processed in 169us (543us total) trans 0 rc 0/0 00000100:00100000:3.0:1789403583.865324:0:22778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 142 00000100:00100000:1.0:1789403583.872345:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:2.0:1789403583.874642:0:22781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038183168 00000100:00100000:2.0:1789403583.874715:0:22781:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038183168 00000100:00100000:2.0:1789403583.874860:0:22781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 143 00000100:00100000:2.0:1789403583.874886:0:22781:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a26c7fcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:126a363a-19e5-4afb-856a-0efed33190d2+13:18174:x1876325038183168:12345-192.168.203.43@tcp:502:llog_process_th.0 00000100:00100000:2.0:1789403583.875064:0:22781:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a26c7fcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:126a363a-19e5-4afb-856a-0efed33190d2+13:18174:x1876325038183168:12345-192.168.203.43@tcp:502:llog_process_th.0 Request processed in 180us (2727us total) trans 0 rc 0/0 00000100:00100000:2.0:1789403583.875071:0:22781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 143 00000100:00100000:2.0:1789403583.884954:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:3.0:1789403583.885693:0:22787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038183296 00000100:00100000:3.0:1789403583.885705:0:22787:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038183296 00000100:00100000:3.0:1789403583.885758:0:22787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 16 00000100:00100000:3.0:1789403583.885766:0:22787:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a142501880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2386:x1876325038183296:12345-192.168.203.43@tcp:38:mount.lustre.0 00010000:00080000:3.0:1789403583.885797:0:22787:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0000: connection from 64a26033-a2bf-42a8-98b4-c36979dfd570@192.168.203.43@tcp t0 exp 0000000000000000 cur 629 last 0 00000020:00000080:3.0:1789403583.885846:0:22787:0:(genops.c:1384:class_connect()) connect: client 64a26033-a2bf-42a8-98b4-c36979dfd570, cookie 0x5fb08b1e5b762ac1 00000004:00100000:3.0:1789403583.885871:0:22787:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:3.0:1789403583.885961:0:22787:0:(import.c:65:import_set_state_nolock()) ffff90a276ec5800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1789403583.886046:0:22787:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a142501880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:64a26033-a2bf-42a8-98b4-c36979dfd570+6:2386:x1876325038183296:12345-192.168.203.43@tcp:38:mount.lustre.0 Request processed in 278us (1099us total) trans 0 rc 0/0 00000100:00100000:3.0:1789403583.886054:0:22787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 16 00000100:00100000:1.0:1789403583.893958:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:3.0:1789403583.898532:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:3.0:1789403583.900623:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:2.0:1789403583.900978:0:22786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038183552 00000100:00100000:2.0:1789403583.901173:0:22786:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038183552 00000100:00100000:2.0:1789403583.901230:0:22786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038183808 00000100:00100000:2.0:1789403583.901234:0:22786:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038183808 00000100:00100000:2.0:1789403583.901272:0:22786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 17 00000100:00100000:2.0:1789403583.901280:0:22786:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a14404b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2386:x1876325038183552:12345-192.168.203.43@tcp:38:mount.lustre.0 00010000:00080000:2.0:1789403583.901311:0:22786:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-MDT0001: connection from 64a26033-a2bf-42a8-98b4-c36979dfd570@192.168.203.43@tcp t0 exp 0000000000000000 cur 629 last 0 00000020:00000080:2.0:1789403583.901345:0:22786:0:(genops.c:1384:class_connect()) connect: client 64a26033-a2bf-42a8-98b4-c36979dfd570, cookie 0x5fb08b1e5b762ac8 00000004:00100000:2.0:1789403583.901371:0:22786:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0001: cli supports cksum type f7, return f7 00000100:00080000:2.0:1789403583.901490:0:22786:0:(import.c:65:import_set_state_nolock()) ffff90a275110800 : changing import state from RECOVER to FULL 00000100:00080000:0.0:1789403583.903869:0:22782:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789403583.904151:0:22786:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a14404b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:64a26033-a2bf-42a8-98b4-c36979dfd570+6:2386:x1876325038183552:12345-192.168.203.43@tcp:38:mount.lustre.0 Request processed in 2863us (10196us total) trans 0 rc 0/0 00000100:00100000:2.0:1789403583.904163:0:22786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 17 00000100:00100000:2.0:1789403583.904199:0:22786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 18 00000100:00100000:2.0:1789403583.904211:0:22786:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a14418ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:64a26033-a2bf-42a8-98b4-c36979dfd570+6:18165:x1876325038183808:12345-192.168.203.43@tcp:41:mount.lustre.0 00000004:00000024:2.0:1789403583.904886:0:22786:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446309888 avail 1300070400 00000100:00100000:2.0:1789403583.904940:0:22786:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a14418ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:64a26033-a2bf-42a8-98b4-c36979dfd570+6:18165:x1876325038183808:12345-192.168.203.43@tcp:41:mount.lustre.0 Request processed in 731us (6416us total) trans 0 rc 0/0 00000100:00100000:2.0:1789403583.904948:0:22786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 18 00000100:00100000:1.0:1789403583.905952:0:22787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038183424 00000100:00100000:1.0:1789403583.905964:0:22787:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038183424 00000100:00100000:0.0:1789403583.906134:0:22788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 19 00000100:00100000:0.0:1789403583.906147:0:22788:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a14418ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:64a26033-a2bf-42a8-98b4-c36979dfd570+6:0:x1876325038183424:12345-192.168.203.43@tcp:41:mount.lustre.0 00000004:00000024:0.0:1789403583.906195:0:22788:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446309888 avail 1300070400 00000100:00100000:0.0:1789403583.906339:0:22788:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a14418ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:64a26033-a2bf-42a8-98b4-c36979dfd570+6:0:x1876325038183424:12345-192.168.203.43@tcp:41:mount.lustre.0 Request processed in 196us (5724us total) trans 0 rc 0/0 00000100:00100000:0.0:1789403583.906348:0:22788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 19 00000100:00100000:0.0:1789403583.920848:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:2.0:1789403583.921043:0:22788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038183936 00000100:00100000:2.0:1789403583.921066:0:22788:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038183936 00000100:00100000:2.0:1789403583.921125:0:22788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 20 00000100:00100000:2.0:1789403583.921136:0:22788:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a1441d9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:64a26033-a2bf-42a8-98b4-c36979dfd570+6:18165:x1876325038183936:12345-192.168.203.43@tcp:40:mount.lustre.0 00000100:00100000:2.0:1789403583.921228:0:22788:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a1441d9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:64a26033-a2bf-42a8-98b4-c36979dfd570+6:18165:x1876325038183936:12345-192.168.203.43@tcp:40:mount.lustre.0 Request processed in 94us (389us total) trans 0 rc 0/0 00000100:00100000:2.0:1789403583.921236:0:22788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 20 00000100:00100000:0.0:1789403583.921365:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:2.0:1789403583.921547:0:22787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038183680 00000100:00100000:2.0:1789403583.921552:0:22787:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038183680 00000100:00100000:2.0:1789403583.921596:0:22787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 21 00000100:00100000:2.0:1789403583.921603:0:22787:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a1441db480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:64a26033-a2bf-42a8-98b4-c36979dfd570+6:0:x1876325038183680:12345-192.168.203.43@tcp:41:mount.lustre.0 00000004:00000024:2.0:1789403583.921620:0:22787:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:2.0:1789403583.921671:0:22787:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a1441db480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:64a26033-a2bf-42a8-98b4-c36979dfd570+6:0:x1876325038183680:12345-192.168.203.43@tcp:41:mount.lustre.0 Request processed in 68us (306us total) trans 0 rc 0/0 00000100:00100000:2.0:1789403583.921678:0:22787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 21 00000100:00080000:0.0:1789403583.922019:0:22782:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1789403583.924261:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:0.0:1789403583.924296:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:0.0:1789403583.924328:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:3.0:1789403583.924415:0:22797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038184320 00000100:00100000:3.0:1789403583.924424:0:22797:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038184320 00000100:00100000:3.0:1789403583.924478:0:22797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 4 00000100:00100000:3.0:1789403583.924488:0:22797:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a1441da300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:64a26033-a2bf-42a8-98b4-c36979dfd570+6:18165:x1876325038184320:12345-192.168.203.43@tcp:900:mount.lustre.0 00000100:00100000:3.0:1789403583.924564:0:22797:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a1441da300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:64a26033-a2bf-42a8-98b4-c36979dfd570+6:18165:x1876325038184320:12345-192.168.203.43@tcp:900:mount.lustre.0 Request processed in 77us (234us total) trans 0 rc 0/0 00000100:00100000:3.0:1789403583.924571:0:22797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 4 00000100:00100000:1.0:1789403583.924767:0:25213:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038184064 00000100:00100000:1.0:1789403583.924772:0:25213:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038184064 00000100:00100000:1.0:1789403583.924818:0:25213:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038184192 00000100:00100000:1.0:1789403583.924821:0:25213:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038184192 00000100:00100000:1.0:1789403583.924837:0:25213:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 18 00000100:00100000:1.0:1789403583.924843:0:25213:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a1441da680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:0+-99:2386:x1876325038184064:12345-192.168.203.43@tcp:8:mount.lustre.0 00010000:00080000:1.0:1789403583.924868:0:25213:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0000: connection from 64a26033-a2bf-42a8-98b4-c36979dfd570@192.168.203.43@tcp t0 exp 0000000000000000 cur 629 last 0 00000020:00000080:1.0:1789403583.924907:0:25213:0:(genops.c:1384:class_connect()) connect: client 64a26033-a2bf-42a8-98b4-c36979dfd570, cookie 0x5fb08b1e5b762acf 00002000:00100000:1.0:1789403583.924918:0:25213:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 64a26033-a2bf-42a8-98b4-c36979dfd570/ffff90a276e2f000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a27 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1789403583.924929:0:25213:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:1.0:1789403583.924984:0:25213:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:1.0:1789403583.925015:0:25213:0:(import.c:65:import_set_state_nolock()) ffff90a276e29000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1789403583.925052:0:25213:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a1441da680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:64a26033-a2bf-42a8-98b4-c36979dfd570+6:2386:x1876325038184064:12345-192.168.203.43@tcp:8:mount.lustre.0 Request processed in 207us (799us total) trans 0 rc 0/0 00000100:00100000:1.0:1789403583.925071:0:25213:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 18 00000100:00100000:1.0:1789403583.925085:0:25213:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 19 00000100:00100000:1.0:1789403583.925089:0:25213:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a1441d8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:0+-99:2386:x1876325038184192:12345-192.168.203.43@tcp:8:mount.lustre.0 00010000:00080000:1.0:1789403583.925104:0:25213:0:(ldlm_lib.c:1453:target_handle_connect()) lustre-OST0001: connection from 64a26033-a2bf-42a8-98b4-c36979dfd570@192.168.203.43@tcp t0 exp 0000000000000000 cur 629 last 0 00000020:00000080:1.0:1789403583.925121:0:25213:0:(genops.c:1384:class_connect()) connect: client 64a26033-a2bf-42a8-98b4-c36979dfd570, cookie 0x5fb08b1e5b762ad6 00002000:00100000:1.0:1789403583.925126:0:25213:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 64a26033-a2bf-42a8-98b4-c36979dfd570/ffff90a276e29800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113a27 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1789403583.925131:0:25213:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:1.0:1789403583.925163:0:25213:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:1.0:1789403583.925176:0:25213:0:(import.c:65:import_set_state_nolock()) ffff90a276e2d800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1789403583.925201:0:25213:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a1441d8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:64a26033-a2bf-42a8-98b4-c36979dfd570+6:2386:x1876325038184192:12345-192.168.203.43@tcp:8:mount.lustre.0 Request processed in 109us (904us total) trans 0 rc 0/0 00000100:00100000:1.0:1789403583.925207:0:25213:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 19 00000100:00100000:0.0:1789403583.933101:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:2.0:1789403583.935725:0:22790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038184448 00000100:00100000:2.0:1789403583.935740:0:22790:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038184448 00000100:00100000:2.0:1789403583.936041:0:22790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 1 00000100:00100000:2.0:1789403583.936051:0:22790:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a1441d9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:64a26033-a2bf-42a8-98b4-c36979dfd570+6:18165:x1876325038184448:12345-192.168.203.43@tcp:33:mount.lustre.0 00000004:00200000:2.0:1789403583.936136:0:22790:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000100:00100000:2.0:1789403583.936225:0:22790:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a1441d9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:64a26033-a2bf-42a8-98b4-c36979dfd570+6:18165:x1876325038184448:12345-192.168.203.43@tcp:33:mount.lustre.0 Request processed in 174us (3132us total) trans 0 rc 0/0 00000100:00100000:2.0:1789403583.936232:0:22790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 1 00000100:00100000:1.0:1789403584.144555:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:2.0:1789403584.145431:0:22787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038184576 00000100:00100000:2.0:1789403584.145443:0:22787:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038184576 00000100:00100000:2.0:1789403584.145511:0:22787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 22 00000100:00100000:2.0:1789403584.145521:0:22787:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a141aaed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:64a26033-a2bf-42a8-98b4-c36979dfd570+6:18197:x1876325038184576:12345-192.168.203.43@tcp:101:mkdir.0 00010000:00010000:2.0:1789403584.145555:0:22787:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789403584.145576:0:22787:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a270184600/0x5fb08b1e5b762add lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1acb85b3eb128d8f expref: -99 pid: 22787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403584.145639:0:22787:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a270184000/0x5fb08b1e5b762ae4 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 22787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403584.145652:0:22787:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a270184000/0x5fb08b1e5b762ae4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403584.145665:0:22787:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a270184000/0x5fb08b1e5b762ae4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22787 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789403584.145705:0:22787:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1789403584.145708:0:22787:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1789403584.145728:0:22787:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90a270184000/0x5fb08b1e5b762ae4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403584.145754:0:22787:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a270184600/0x5fb08b1e5b762add lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb128d8f expref: 8 pid: 22787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403584.145772:0:22787:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90a270184000/0x5fb08b1e5b762ae4 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb128d8f expref: 7 pid: 22787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403584.145781:0:22787:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90a2609b8200) 00010000:00010000:2.0:1789403584.145783:0:22787:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789403584.145787:0:22787:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a270184000, rc 0) 00000100:00100000:2.0:1789403584.145864:0:22787:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a141aaed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:64a26033-a2bf-42a8-98b4-c36979dfd570+7:18197:x1876325038184576:12345-192.168.203.43@tcp:101:mkdir.0 Request processed in 344us (1318us total) trans 0 rc 0/0 00000100:00100000:2.0:1789403584.145871:0:22787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 22 00000100:00100000:1.0:1789403584.242063:0:3628:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789403584.242087:0:3628:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a141aac380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3628:1876325050865792:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1789403584.242155:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789403584.242443:0:25580:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050865792 00000100:00100000:2.0:1789403584.242451:0:25580:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050865792 00000100:00100000:2.0:1789403584.242501:0:25580:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1789403584.242510:0:25580:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a144b2b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3628:x1876325050865792:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1789403584.242531:0:25580:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:2.0:1789403584.242575:0:25580:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a144b2b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3628:x1876325050865792:12345-0@lo:13:osp-pre-1-1.0 Request processed in 67us (420us total) trans 0 rc 0/0 00000100:00100000:2.0:1789403584.242583:0:25580:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1789403584.242831:0:3627:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a14418c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3627:1876325050866048:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1789403584.242840:0:22774:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1789403584.242850:0:22782:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789403584.242868:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789403584.242903:0:3627:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789403584.242910:0:3627:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a142503100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3627:1876325050865920:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789403584.242932:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789403584.242956:0:25580:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050866048 00000100:00100000:3.0:1789403584.242961:0:25580:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050866048 00000100:00100000:3.0:1789403584.242986:0:25580:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050865920 00000100:00100000:3.0:1789403584.242988:0:25580:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050865920 00000100:00100000:3.0:1789403584.243003:0:25580:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1789403584.243010:0:25580:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a14418d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3627:x1876325050866048:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789403584.243022:0:25580:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3915849728 avail 3684327424 00000100:00100000:3.0:1789403584.243054:0:25580:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a14418d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3627:x1876325050866048:12345-0@lo:13:osp-pre-0-0.0 Request processed in 44us (186us total) trans 0 rc 0/0 00000100:00100000:3.0:1789403584.243061:0:25580:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1789403584.243073:0:24294:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1789403584.243087:0:24294:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a14418dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3627:x1876325050865920:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789403584.243101:0:24294:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:3.0:1789403584.243105:0:3627:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a14418c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3627:1876325050866048:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789403584.243147:0:24294:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a14418dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3627:x1876325050865920:12345-0@lo:13:osp-pre-1-0.0 Request processed in 65us (213us total) trans 0 rc 0/0 00000100:00100000:0.0:1789403584.243154:0:24294:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1789403584.243181:0:3627:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 12884901890 gen 2 00000100:00100000:0.0:1789403584.243196:0:3627:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a142503100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3627:1876325050865920:0@lo:13:osp-pre-1-0.0 00000100:00080000:0.0:1789403584.243225:0:22782:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789403584.243228:0:22782:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789403584.243584:0:3628:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a141aac380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3628:1876325050865792:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1789403584.244030:0:3628:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a142500a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7ccb4038-daf9-4dcd-9b85-da9390181204:3628:1876325050866176:0@lo:400:kworker.0 00000100:00100000:3.0:1789403584.244071:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789403584.244120:0:3628:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a142503480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3628:1876325050866688:0@lo:400:kworker.0 00000100:00100000:3.0:1789403584.244144:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789403584.244160:0:3628:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a142501f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3628:1876325050867200:0@lo:400:kworker.0 00000100:00100000:3.0:1789403584.244180:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789403584.244198:0:3628:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:3.0:1789403584.244204:0:3628:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a142502680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3628:1876325050866304:0@lo:400:kworker.0 00000100:00100000:3.0:1789403584.244226:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789403584.244243:0:3628:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a142501500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3628:1876325050866816:0@lo:400:kworker.0 00000100:00100000:3.0:1789403584.244262:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789403584.244275:0:3628:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a142500e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3628:1876325050867328:0@lo:400:kworker.0 00000100:00100000:3.0:1789403584.244291:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789403584.244325:0:22791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050866304 00000100:00100000:3.0:1789403584.244330:0:22791:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050866304 00000100:00100000:3.0:1789403584.244363:0:22791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1789403584.244369:0:22791:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a14418f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3628:x1876325050866304:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789403584.244438:0:22791:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a14418f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3628:x1876325050866304:12345-0@lo:400:kworker.0 Request processed in 68us (211us total) trans 0 rc 0/0 00000100:00100000:3.0:1789403584.244445:0:22791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1789403584.244467:0:22786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050867200 00000100:00100000:3.0:1789403584.244471:0:22786:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050867200 00000100:00100000:3.0:1789403584.244493:0:22786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050866816 00000100:00100000:3.0:1789403584.244495:0:22786:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050866816 00000100:00100000:3.0:1789403584.244506:0:22786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050867328 00000100:00100000:3.0:1789403584.244508:0:22786:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050867328 00000100:00100000:3.0:1789403584.244532:0:22786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1789403584.244539:0:22786:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a14418c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3628:x1876325050867200:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789403584.244571:0:22786:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a14418c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3628:x1876325050867200:12345-0@lo:400:kworker.0 Request processed in 33us (390us total) trans 0 rc 0/0 00000100:00100000:3.0:1789403584.244584:0:22786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1789403584.244597:0:22786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1789403584.244603:0:22786:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a14418c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3628:x1876325050866816:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789403584.244643:0:22786:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a14418c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3628:x1876325050866816:12345-0@lo:400:kworker.0 Request processed in 40us (380us total) trans 0 rc 0/0 00000100:00100000:3.0:1789403584.244649:0:22786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1789403584.244660:0:22786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1789403584.244666:0:22786:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a14418f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3628:x1876325050867328:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789403584.244709:0:22786:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a14418f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3628:x1876325050867328:12345-0@lo:400:kworker.0 Request processed in 43us (416us total) trans 0 rc 0/0 00000100:00100000:3.0:1789403584.244714:0:22786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1789403584.244743:0:3628:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a142502680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3628:1876325050866304:0@lo:400:kworker.0 00000100:00100000:3.0:1789403584.244754:0:3628:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a142501500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3628:1876325050866816:0@lo:400:kworker.0 00010000:00080000:3.0:1789403584.244764:0:3628:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90a142500e00 x1876325050867328/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789403600 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789403584.244773:0:3628:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a142500e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3628:1876325050867328:0@lo:400:kworker.0 00000100:00100000:3.0:1789403584.244781:0:3628:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a142501f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3628:1876325050867200:0@lo:400:kworker.0 00000100:00100000:0.0:1789403584.245030:0:3627:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a142501180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3627:1876325050866560:0@lo:400:kworker.0 00000100:00100000:0.0:1789403584.245060:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789403584.245084:0:3627:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a142502d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3627:1876325050867072:0@lo:400:kworker.0 00000100:00100000:0.0:1789403584.245105:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789403584.245125:0:3627:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:0.0:1789403584.245132:0:3627:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a142502a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3627:1876325050866432:0@lo:400:kworker.0 00000100:00100000:0.0:1789403584.245153:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789403584.245164:0:3627:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a142503b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3627:1876325050866944:0@lo:400:kworker.0 00000100:00100000:0.0:1789403584.245184:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1789403584.245201:0:22782:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1789403584.245205:0:22782:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789403584.245213:0:22786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050867072 00000100:00100000:0.0:1789403584.245217:0:22786:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050867072 00000100:00100000:0.0:1789403584.245241:0:22786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050866432 00000100:00100000:0.0:1789403584.245244:0:22786:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050866432 00000100:00100000:0.0:1789403584.245255:0:22786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050866944 00000100:00100000:0.0:1789403584.245257:0:22786:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050866944 00000100:00100000:0.0:1789403584.245270:0:22786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1789403584.245275:0:22786:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a1441d8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3627:x1876325050867072:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789403584.245319:0:22786:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a1441d8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3627:x1876325050867072:12345-0@lo:400:kworker.0 Request processed in 33us (202us total) trans 0 rc 0/0 00000100:00100000:0.0:1789403584.245326:0:22786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1789403584.245340:0:22786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1789403584.245346:0:22786:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a1441d9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3627:x1876325050866432:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789403584.245373:0:22786:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a1441d9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3627:x1876325050866432:12345-0@lo:400:kworker.0 Request processed in 28us (219us total) trans 0 rc 0/0 00000100:00100000:0.0:1789403584.245406:0:22786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1789403584.245422:0:22786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1789403584.245428:0:22786:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a1441db100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3627:x1876325050866944:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789403584.245456:0:22786:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a1441db100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3627:x1876325050866944:12345-0@lo:400:kworker.0 Request processed in 29us (271us total) trans 0 rc 0/0 00000100:00100000:0.0:1789403584.245462:0:22786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00080000:0.0:1789403584.245475:0:22782:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789403584.245478:0:22782:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1789403584.245494:0:3627:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a142502a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3627:1876325050866432:0@lo:400:kworker.0 00000100:00100000:0.0:1789403584.245504:0:3627:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a142503b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3627:1876325050866944:0@lo:400:kworker.0 00010000:00080000:0.0:1789403584.245513:0:3627:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90a142502d80 x1876325050867072/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789403600 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789403584.245697:0:24931:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050866560 00000100:00100000:3.0:1789403584.245702:0:24931:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050866560 00000100:00100000:3.0:1789403584.245728:0:24931:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1789403584.245734:0:24931:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a1441daa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3627:x1876325050866560:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789403584.245767:0:24931:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a1441daa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3627:x1876325050866560:12345-0@lo:400:kworker.0 Request processed in 33us (706us total) trans 0 rc 0/0 00000100:00100000:3.0:1789403584.245781:0:24931:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1789403584.245863:0:3627:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a142502d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3627:1876325050867072:0@lo:400:kworker.0 00000100:00100000:0.0:1789403584.245888:0:3627:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a142501180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3627:1876325050866560:0@lo:400:kworker.0 00000100:00100000:2.0:1789403584.245955:0:22778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050866176 00000100:00100000:2.0:1789403584.245960:0:22778:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050866176 00000100:00100000:2.0:1789403584.245996:0:22778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:2.0:1789403584.246003:0:22778:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a26c7fc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7ccb4038-daf9-4dcd-9b85-da9390181204+24:3628:x1876325050866176:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789403584.246047:0:22778:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a26c7fc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7ccb4038-daf9-4dcd-9b85-da9390181204+24:3628:x1876325050866176:12345-0@lo:400:kworker.0 Request processed in 44us (1976us total) trans 0 rc 0/0 00000100:00100000:2.0:1789403584.246069:0:22778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:3.0:1789403584.246152:0:3628:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a142500a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:7ccb4038-daf9-4dcd-9b85-da9390181204:3628:1876325050866176:0@lo:400:kworker.0 00000100:00100000:1.0:1789403584.246232:0:24293:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050866688 00000100:00100000:1.0:1789403584.246236:0:24293:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050866688 00000100:00100000:1.0:1789403584.246280:0:24293:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1789403584.246288:0:24293:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a14418c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3628:x1876325050866688:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789403584.246341:0:24293:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a14418c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3628:x1876325050866688:12345-0@lo:400:kworker.0 Request processed in 54us (2196us total) trans 0 rc 0/0 00000100:00100000:1.0:1789403584.246347:0:24293:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1789403584.246554:0:3628:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a142503480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3628:1876325050866688:0@lo:400:kworker.0 00000040:00080000:3.0:1789403584.769080:0:23539:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1789403585.267459:0:25221:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789403586.290502:0:22775:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1789403586.811025:0:22766:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 64a26033-a2bf-42a8-98b4-c36979dfd570 00000001:00100000:0.0:1789403586.811038:0:22766:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 5aa3c32d-0021-4831-930f-6e88a8b78157 00000001:00100000:0.0:1789403586.812087:0:23519:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of 64a26033-a2bf-42a8-98b4-c36979dfd570 00000001:00100000:0.0:1789403586.812096:0:23519:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of 5aa3c32d-0021-4831-930f-6e88a8b78157 00000001:00100000:0.0:1789403586.812572:0:25106:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 64a26033-a2bf-42a8-98b4-c36979dfd570 00000001:00100000:0.0:1789403586.812579:0:25106:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 5aa3c32d-0021-4831-930f-6e88a8b78157 00000001:00100000:3.0:1789403586.822100:0:24287:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 64a26033-a2bf-42a8-98b4-c36979dfd570 00000001:00100000:3.0:1789403586.822113:0:24287:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 5aa3c32d-0021-4831-930f-6e88a8b78157 00000001:02000400:3.0:1789403586.841272:0:25665:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00010000:00010000:0.0:1789403587.314373:0:22774:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789403588.340604:0:25221:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789403588.850157:0:3626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a14418e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3626:1876325050867456:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1789403588.850218:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789403588.850271:0:3626:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789403588.850278:0:3626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a14418df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3626:1876325050867584:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1789403588.850298:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789403588.850332:0:22792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050867456 00000100:00100000:3.0:1789403588.850339:0:22792:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050867456 00000100:00100000:3.0:1789403588.850378:0:22792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050867584 00000100:00100000:3.0:1789403588.850381:0:22792:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050867584 00000100:00100000:3.0:1789403588.850412:0:22792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1789403588.850421:0:22792:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a144bed180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3626:x1876325050867456:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1789403588.850450:0:22792:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:3.0:1789403588.850491:0:22792:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a144bed180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3626:x1876325050867456:12345-0@lo:41:osp-pre-1-0.0 Request processed in 71us (273us total) trans 0 rc 0/0 00000100:00100000:3.0:1789403588.850497:0:22792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1789403588.850511:0:22792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1789403588.850517:0:22792:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a144beed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3626:x1876325050867584:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1789403588.850531:0:22792:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446309888 avail 1300070400 00000100:00100000:3.0:1789403588.850567:0:22792:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a144beed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3626:x1876325050867584:12345-0@lo:41:osp-pre-0-1.0 Request processed in 50us (268us total) trans 0 rc 0/0 00000100:00100000:3.0:1789403588.850572:0:22792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1789403588.850613:0:3626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a14418df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3626:1876325050867584:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1789403588.850624:0:3626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a14418e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3626:1876325050867456:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1789403588.851686:0:3629:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789403588.851699:0:3629:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a144bedc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3629:1876325050867712:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1789403588.851739:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789403588.851780:0:25580:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050867712 00000100:00100000:3.0:1789403588.851785:0:25580:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050867712 00000100:00100000:3.0:1789403588.851840:0:25580:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1789403588.851848:0:25580:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a14418e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3629:x1876325050867712:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1789403588.851869:0:25580:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3915849728 avail 3684327424 00000100:00100000:3.0:1789403588.851906:0:25580:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a14418e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3629:x1876325050867712:12345-0@lo:13:osp-pre-0-1.0 Request processed in 59us (166us total) trans 0 rc 0/0 00000100:00100000:3.0:1789403588.851912:0:25580:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00080000:3.0:1789403588.851929:0:22782:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789403588.851959:0:3629:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a144bedc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3629:1876325050867712:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1789403589.202345:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:3.0:1789403589.202411:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:3.0:1789403589.202440:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:3.0:1789403589.202463:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:3.0:1789403589.202477:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:3.0:1789403589.202492:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:3.0:1789403589.202506:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:3.0:1789403589.202521:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:3.0:1789403589.202554:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:3.0:1789403589.202579:0:22786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038184960 00000100:00100000:3.0:1789403589.202588:0:22786:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038184960 00000100:00100000:3.0:1789403589.202635:0:22786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038185472 00000100:00100000:3.0:1789403589.202639:0:22786:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038185472 00000100:00100000:3.0:1789403589.202652:0:22786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038184832 00000100:00100000:3.0:1789403589.202654:0:22786:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038184832 00000100:00100000:3.0:1789403589.202682:0:22786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038185344 00000100:00100000:3.0:1789403589.202684:0:22786:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038185344 00000100:00100000:3.0:1789403589.202702:0:22786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 44 00000100:00100000:3.0:1789403589.202712:0:22786:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a14418df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5aa3c32d-0021-4831-930f-6e88a8b78157+5:2387:x1876325038184960:12345-192.168.203.43@tcp:400:kworker.0 00000100:00100000:3.0:1789403589.202796:0:22786:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a14418df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5aa3c32d-0021-4831-930f-6e88a8b78157+5:2387:x1876325038184960:12345-192.168.203.43@tcp:400:kworker.0 Request processed in 85us (384us total) trans 0 rc 0/0 00000100:00100000:3.0:1789403589.202805:0:22786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 44 00000100:00100000:3.0:1789403589.202823:0:22786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 45 00000100:00100000:3.0:1789403589.202830:0:22786:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a14251fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:64a26033-a2bf-42a8-98b4-c36979dfd570+5:2387:x1876325038185472:12345-192.168.203.43@tcp:400:kworker.0 00000100:00100000:3.0:1789403589.202854:0:22786:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a14251fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:64a26033-a2bf-42a8-98b4-c36979dfd570+5:2387:x1876325038185472:12345-192.168.203.43@tcp:400:kworker.0 Request processed in 25us (390us total) trans 0 rc 0/0 00000100:00100000:3.0:1789403589.202859:0:22786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 45 00000100:00100000:3.0:1789403589.202871:0:22786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 46 00000100:00100000:3.0:1789403589.202877:0:22786:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a14251ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5aa3c32d-0021-4831-930f-6e88a8b78157+6:2387:x1876325038184832:12345-192.168.203.43@tcp:400:kworker.0 00000100:00100000:3.0:1789403589.202901:0:22786:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a14251ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5aa3c32d-0021-4831-930f-6e88a8b78157+6:2387:x1876325038184832:12345-192.168.203.43@tcp:400:kworker.0 Request processed in 24us (407us total) trans 0 rc 0/0 00000100:00100000:3.0:1789403589.202906:0:22786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 46 00000100:00100000:3.0:1789403589.202919:0:22786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 47 00000100:00100000:3.0:1789403589.202926:0:22786:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a14251df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:64a26033-a2bf-42a8-98b4-c36979dfd570+6:2387:x1876325038185344:12345-192.168.203.43@tcp:400:kworker.0 00000100:00100000:3.0:1789403589.202957:0:22786:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a14251df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:64a26033-a2bf-42a8-98b4-c36979dfd570+6:2387:x1876325038185344:12345-192.168.203.43@tcp:400:kworker.0 Request processed in 33us (435us total) trans 0 rc 0/0 00000100:00100000:3.0:1789403589.202964:0:22786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 47 00000100:00100000:3.0:1789403589.202988:0:24290:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038185216 00000100:00100000:3.0:1789403589.202992:0:24290:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038185216 00000100:00100000:3.0:1789403589.203020:0:24290:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038185728 00000100:00100000:3.0:1789403589.203022:0:24290:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038185728 00000100:00100000:3.0:1789403589.203035:0:24290:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038185088 00000100:00100000:3.0:1789403589.203037:0:24290:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038185088 00000100:00100000:3.0:1789403589.203048:0:24290:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038185600 00000100:00100000:3.0:1789403589.203050:0:24290:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038185600 00000100:00100000:3.0:1789403589.203063:0:24290:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 4 00000100:00100000:3.0:1789403589.203070:0:24290:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a144bedc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5aa3c32d-0021-4831-930f-6e88a8b78157+5:2387:x1876325038185216:12345-192.168.203.43@tcp:400:kworker.0 00000100:00100000:3.0:1789403589.203096:0:24290:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a144bedc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5aa3c32d-0021-4831-930f-6e88a8b78157+5:2387:x1876325038185216:12345-192.168.203.43@tcp:400:kworker.0 Request processed in 26us (655us total) trans 0 rc 0/0 00000100:00100000:3.0:1789403589.203102:0:24290:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 4 00000100:00100000:3.0:1789403589.203114:0:24290:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 5 00000100:00100000:3.0:1789403589.203120:0:24290:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a14251c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:64a26033-a2bf-42a8-98b4-c36979dfd570+5:2387:x1876325038185728:12345-192.168.203.43@tcp:400:kworker.0 00000100:00100000:3.0:1789403589.203141:0:24290:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a14251c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:64a26033-a2bf-42a8-98b4-c36979dfd570+5:2387:x1876325038185728:12345-192.168.203.43@tcp:400:kworker.0 Request processed in 21us (662us total) trans 0 rc 0/0 00000100:00100000:3.0:1789403589.203147:0:24290:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 5 00000100:00100000:3.0:1789403589.203157:0:24290:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 6 00000100:00100000:3.0:1789403589.203163:0:24290:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a14251c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5aa3c32d-0021-4831-930f-6e88a8b78157+5:2387:x1876325038185088:12345-192.168.203.43@tcp:400:kworker.0 00000100:00100000:3.0:1789403589.203187:0:24290:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a14251c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5aa3c32d-0021-4831-930f-6e88a8b78157+5:2387:x1876325038185088:12345-192.168.203.43@tcp:400:kworker.0 Request processed in 24us (679us total) trans 0 rc 0/0 00000100:00100000:3.0:1789403589.203203:0:24290:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 6 00000100:00100000:3.0:1789403589.203215:0:24290:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 7 00000100:00100000:3.0:1789403589.203221:0:24290:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a14251ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:64a26033-a2bf-42a8-98b4-c36979dfd570+5:2387:x1876325038185600:12345-192.168.203.43@tcp:400:kworker.0 00000100:00100000:3.0:1789403589.203246:0:24290:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a14251ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:64a26033-a2bf-42a8-98b4-c36979dfd570+5:2387:x1876325038185600:12345-192.168.203.43@tcp:400:kworker.0 Request processed in 25us (691us total) trans 0 rc 0/0 00000100:00100000:3.0:1789403589.203251:0:24290:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 7 00000100:00080000:3.0:1789403589.203278:0:22782:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1789403589.203282:0:22782:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789403589.203284:0:22782:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789403589.203287:0:22782:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1789403589.203575:0:22781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038184704 00000100:00100000:0.0:1789403589.203580:0:22781:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038184704 00000100:00100000:0.0:1789403589.203628:0:22781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 145 00000100:00100000:0.0:1789403589.203635:0:22781:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a26c7ff850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:126a363a-19e5-4afb-856a-0efed33190d2+13:2387:x1876325038184704:12345-192.168.203.43@tcp:400:kworker.0 00000100:00100000:0.0:1789403589.203686:0:22781:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a26c7ff850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:126a363a-19e5-4afb-856a-0efed33190d2+13:2387:x1876325038184704:12345-192.168.203.43@tcp:400:kworker.0 Request processed in 51us (1350us total) trans 0 rc 0/0 00000100:00100000:0.0:1789403589.203692:0:22781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 145 00010000:00010000:2.0:1789403589.362631:0:22775:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789403589.362858:0:3629:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a1441d8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:7ccb4038-daf9-4dcd-9b85-da9390181204:3629:1876325050867840:0@lo:400:kworker.0 00000100:00100000:0.0:1789403589.362922:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789403589.362960:0:3629:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a1441d9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3629:1876325050868352:0@lo:400:kworker.0 00000100:00100000:0.0:1789403589.362985:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789403589.363003:0:3629:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a144181500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3629:1876325050868864:0@lo:400:kworker.0 00000100:00100000:0.0:1789403589.363026:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789403589.363040:0:3629:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a144182300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3629:1876325050869376:0@lo:400:kworker.0 00000100:00100000:0.0:1789403589.363063:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789403589.363084:0:22786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050868352 00000100:00100000:0.0:1789403589.363085:0:3629:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:0.0:1789403589.363090:0:3629:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a1441dad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3629:1876325050868224:0@lo:400:kworker.0 00000100:00100000:3.0:1789403589.363091:0:22786:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050868352 00000100:00100000:0.0:1789403589.363113:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789403589.363125:0:22786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050868864 00000100:00100000:3.0:1789403589.363128:0:22786:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050868864 00000100:00100000:3.0:1789403589.363140:0:22786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050869376 00000100:00100000:3.0:1789403589.363143:0:22786:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050869376 00000100:00100000:0.0:1789403589.363149:0:3629:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a144180a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3629:1876325050868736:0@lo:400:kworker.0 00000100:00100000:3.0:1789403589.363168:0:22786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1789403589.363169:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789403589.363176:0:22786:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a144182680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3629:x1876325050868352:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789403589.363183:0:3629:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a144181c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3629:1876325050869248:0@lo:400:kworker.0 00000100:00100000:0.0:1789403589.363200:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789403589.363219:0:3626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a1441dbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3626:1876325050867968:0@lo:400:kworker.0 00000100:00100000:0.0:1789403589.363242:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789403589.363259:0:3626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a144049880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3626:1876325050868480:0@lo:400:kworker.0 00000100:00100000:0.0:1789403589.363279:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789403589.363317:0:3626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a144181f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3626:1876325050868992:0@lo:400:kworker.0 00000100:00100000:0.0:1789403589.363338:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789403589.363349:0:3626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a14251d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3626:1876325050869504:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789403589.363369:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789403589.365036:0:24295:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050869504 00000100:00100000:1.0:1789403589.365048:0:24295:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050869504 00000100:00100000:1.0:1789403589.365099:0:24295:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1789403589.365108:0:24295:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a144181180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3626:x1876325050869504:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789403589.365136:0:24295:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:1.0:1789403589.365195:0:24295:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a144181180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3626:x1876325050869504:12345-0@lo:13:osp-pre-1-0.0 Request processed in 88us (1824us total) trans 0 rc 0/0 00000100:00100000:1.0:1789403589.365202:0:24295:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1789403589.365347:0:24290:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050868224 00000100:00100000:2.0:1789403589.365353:0:24290:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050868224 00000100:00100000:2.0:1789403589.365383:0:24290:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050868736 00000100:00100000:2.0:1789403589.365419:0:24290:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050868736 00000100:00100000:2.0:1789403589.365445:0:24290:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1789403589.365452:0:24290:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a144182d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3629:x1876325050868224:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789403589.365810:0:22786:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a144182680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3629:x1876325050868352:12345-0@lo:400:kworker.0 Request processed in 2633us (2821us total) trans 0 rc 0/0 00000100:00100000:3.0:1789403589.365820:0:22786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1789403589.365908:0:22786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050869248 00000100:00100000:3.0:1789403589.365913:0:22786:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050869248 00000100:00100000:3.0:1789403589.365932:0:22786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050868992 00000100:00100000:3.0:1789403589.365935:0:22786:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050868992 00000100:00100000:3.0:1789403589.366027:0:22786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1789403589.366035:0:22786:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a144182a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3629:x1876325050868864:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789403589.366087:0:22786:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a144182a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3629:x1876325050868864:12345-0@lo:400:kworker.0 Request processed in 53us (3060us total) trans 0 rc 0/0 00000100:00100000:3.0:1789403589.366094:0:22786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1789403589.366107:0:22786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1789403589.366114:0:22786:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a144183480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3629:x1876325050869376:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789403589.366143:0:22786:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a144183480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3629:x1876325050869376:12345-0@lo:400:kworker.0 Request processed in 31us (3079us total) trans 0 rc 0/0 00000100:00100000:3.0:1789403589.366149:0:22786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1789403589.366160:0:22786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1789403589.366166:0:22786:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a144180700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3629:x1876325050869248:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789403589.366210:0:22786:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a144180700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3629:x1876325050869248:12345-0@lo:400:kworker.0 Request processed in 44us (3008us total) trans 0 rc 0/0 00000100:00100000:3.0:1789403589.366217:0:22786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1789403589.366229:0:22786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1789403589.366236:0:22786:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a144180000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3626:x1876325050868992:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789403589.366263:0:22786:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a144180000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3626:x1876325050868992:12345-0@lo:400:kworker.0 Request processed in 28us (2923us total) trans 0 rc 0/0 00000100:00100000:3.0:1789403589.366268:0:22786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00080000:3.0:1789403589.366288:0:22782:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789403589.366292:0:22782:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789403589.366294:0:22782:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1789403589.366306:0:24926:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1789403589.366313:0:24926:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a144181880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3629:x1876325050868736:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789403589.366343:0:24926:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a144181880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3629:x1876325050868736:12345-0@lo:400:kworker.0 Request processed in 31us (3172us total) trans 0 rc 0/0 00000100:00100000:3.0:1789403589.366358:0:24926:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1789403589.366381:0:22792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050867968 00000100:00100000:3.0:1789403589.366385:0:22792:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050867968 00000100:00100000:3.0:1789403589.366432:0:22792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050868480 00000100:00100000:3.0:1789403589.366436:0:22792:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050868480 00000100:00100000:3.0:1789403589.366448:0:22792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1789403589.366453:0:22792:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a144180e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3626:x1876325050867968:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789403589.366588:0:24290:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a144182d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3629:x1876325050868224:12345-0@lo:400:kworker.0 Request processed in 1136us (3472us total) trans 0 rc 0/0 00000100:00100000:2.0:1789403589.366597:0:24290:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1789403589.366681:0:24931:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1789403589.366695:0:24931:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a144180380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3626:x1876325050868480:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789403589.366727:0:24931:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a144180380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3626:x1876325050868480:12345-0@lo:400:kworker.0 Request processed in 34us (3447us total) trans 0 rc 0/0 00000100:00100000:2.0:1789403589.366733:0:24931:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1789403589.366966:0:22792:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a144180e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3626:x1876325050867968:12345-0@lo:400:kworker.0 Request processed in 512us (3723us total) trans 0 rc 0/0 00000100:00100000:3.0:1789403589.366974:0:22792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1789403589.370053:0:3626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a144181f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3626:1876325050868992:0@lo:400:kworker.0 00000100:00100000:0.0:1789403589.370080:0:3626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a14251d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3626:1876325050869504:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789403589.370100:0:3626:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [1->0] 00000100:00100000:0.0:1789403589.370118:0:3626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a1441d8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3626:1876325050868096:0@lo:400:kworker.0 00000100:00100000:2.0:1789403589.370461:0:22780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050867840 00000100:00100000:2.0:1789403589.370480:0:22780:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050867840 00000100:00100000:2.0:1789403589.370532:0:22780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:2.0:1789403589.370542:0:22780:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a26c7ff450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7ccb4038-daf9-4dcd-9b85-da9390181204+24:3629:x1876325050867840:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789403589.370617:0:22780:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a26c7ff450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7ccb4038-daf9-4dcd-9b85-da9390181204+24:3629:x1876325050867840:12345-0@lo:400:kworker.0 Request processed in 77us (7694us total) trans 0 rc 0/0 00000100:00100000:2.0:1789403589.370623:0:22780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:2.0:1789403589.370674:0:3629:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a1441dad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3629:1876325050868224:0@lo:400:kworker.0 00000100:00100000:2.0:1789403589.370685:0:3629:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a144180a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3629:1876325050868736:0@lo:400:kworker.0 00000100:00100000:2.0:1789403589.370696:0:3629:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a144181c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3629:1876325050869248:0@lo:400:kworker.0 00000100:00100000:2.0:1789403589.370705:0:3629:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a1441d8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:7ccb4038-daf9-4dcd-9b85-da9390181204:3629:1876325050867840:0@lo:400:kworker.0 00000100:00100000:2.0:1789403589.370716:0:3629:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a1441d9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3629:1876325050868352:0@lo:400:kworker.0 00000100:00100000:2.0:1789403589.370726:0:3629:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a144181500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3629:1876325050868864:0@lo:400:kworker.0 00010000:00080000:2.0:1789403589.370740:0:3629:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90a144182300 x1876325050869376/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789403605 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789403589.370750:0:3629:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a144182300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3629:1876325050869376:0@lo:400:kworker.0 00000100:00100000:0.0:1789403589.370785:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789403589.370809:0:3626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a144183100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3626:1876325050868608:0@lo:400:kworker.0 00000100:00100000:0.0:1789403589.370830:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789403589.370855:0:3626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a144183b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3626:1876325050869120:0@lo:400:kworker.0 00000100:00100000:0.0:1789403589.370879:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789403589.370897:0:3626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a144b2bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3626:1876325050869632:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1789403589.370918:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789403589.370943:0:3626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a1441dbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3626:1876325050867968:0@lo:400:kworker.0 00000100:00100000:0.0:1789403589.370954:0:3626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a144049880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3626:1876325050868480:0@lo:400:kworker.0 00000100:00100000:2.0:1789403589.370958:0:24926:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050868096 00000100:00100000:2.0:1789403589.370962:0:24926:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050868096 00000100:00100000:0.0:1789403589.370986:0:24294:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050869632 00000100:00100000:0.0:1789403589.370989:0:24294:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050869632 00000100:00100000:2.0:1789403589.370995:0:24926:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050868608 00000100:00100000:2.0:1789403589.371010:0:24926:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050868608 00000100:00100000:0.0:1789403589.371014:0:24294:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1789403589.371030:0:24926:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1789403589.371037:0:24926:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a144181f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3626:x1876325050868096:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789403589.371037:0:24294:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a144181500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3626:x1876325050869632:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1789403589.371051:0:24294:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:2.0:1789403589.371074:0:24926:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a144181f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3626:x1876325050868096:12345-0@lo:400:kworker.0 Request processed in 38us (289us total) trans 0 rc 0/0 00000100:00100000:0.0:1789403589.371076:0:24294:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a144181500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3626:x1876325050869632:12345-0@lo:13:osp-pre-1-1.0 Request processed in 41us (158us total) trans 0 rc 0/0 00000100:00100000:2.0:1789403589.371080:0:24926:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1789403589.371087:0:24294:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1789403589.371092:0:24926:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1789403589.371096:0:24926:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a144183800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3626:x1876325050868608:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789403589.371127:0:24926:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a144183800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3626:x1876325050868608:12345-0@lo:400:kworker.0 Request processed in 25us (290us total) trans 0 rc 0/0 00000100:00100000:2.0:1789403589.371133:0:24926:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00080000:3.0:1789403589.371269:0:22782:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789403589.371567:0:22786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050869120 00000100:00100000:3.0:1789403589.371573:0:22786:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050869120 00000100:00100000:3.0:1789403589.371613:0:22786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1789403589.371620:0:22786:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a144182300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3626:x1876325050869120:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789403589.371657:0:22786:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a144182300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3626:x1876325050869120:12345-0@lo:400:kworker.0 Request processed in 38us (777us total) trans 0 rc 0/0 00000100:00100000:3.0:1789403589.371663:0:22786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00080000:3.0:1789403589.371681:0:22782:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1789403589.372805:0:3628:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a142500700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3628:1876325050869760:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789403589.372932:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789403589.373182:0:25580:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050869760 00000100:00100000:3.0:1789403589.373190:0:25580:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050869760 00000100:00100000:3.0:1789403589.373237:0:25580:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1789403589.373245:0:25580:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a144b29c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3628:x1876325050869760:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789403589.373264:0:25580:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3915849728 avail 3684327424 00000100:00100000:3.0:1789403589.373307:0:25580:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a144b29c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3628:x1876325050869760:12345-0@lo:13:osp-pre-0-0.0 Request processed in 63us (375us total) trans 0 rc 0/0 00000100:00100000:3.0:1789403589.373313:0:25580:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1789403589.373441:0:3628:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a142500700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3628:1876325050869760:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789403589.383186:0:3626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a1441d8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3626:1876325050868096:0@lo:400:kworker.0 00000100:00100000:0.0:1789403589.383227:0:3626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a144183100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3626:1876325050868608:0@lo:400:kworker.0 00010000:00080000:0.0:1789403589.383244:0:3626:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90a144183b80 x1876325050869120/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789403605 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789403589.383256:0:3626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a144183b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3626:1876325050869120:0@lo:400:kworker.0 00000100:00100000:0.0:1789403589.383277:0:3626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a144b2bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3626:1876325050869632:0@lo:13:osp-pre-1-1.0 00010000:00010000:2.0:1789403590.388687:0:22774:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1789403590.459951:0:25813:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffc5b2ffbf0 20000000:00000080:2.0:1789403590.459969:0:25813:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff90a26698dc00 uarg=0000000000000000 20000000:01000000:2.0:1789403590.460012:0:25813:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:2.0:1789403590.460018:0:25813:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:2.0:1789403590.460022:0:25813:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:2.0:1789403590.466570:0:25814:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 13 20000000:00000400:3.0:1789403590.466790:0:25813:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:3.0:1789403590.475851:0:25813:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:3.0:1789403590.475880:0:25813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff90a259947800/0x5fb08b1e5b762aeb lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403590.475898:0:25813:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff90a144062200/0x5fb08b1e5b762748 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5fb08b1e5b762741 expref: 23 pid: 22778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403590.475907:0:25813:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff90a144063000/0x5fb08b1e5b762756 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5fb08b1e5b76274f expref: 23 pid: 22778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403590.475913:0:25813:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff90a259947400/0x5fb08b1e5b762795 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5fb08b1e5b76278e expref: 23 pid: 22778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403590.475919:0:25813:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff90a248af0000/0x5fb08b1e5b76282f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5fb08b1e5b762828 expref: 23 pid: 22780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403590.475928:0:25813:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff90a270185000/0x5fb08b1e5b762a7b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb128cee expref: 12 pid: 22778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403590.476619:0:25813:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff90a281b05a00/0x5fb08b1e5b762aba lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb128d5e expref: 12 pid: 22778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403590.476631:0:25813:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff90a259947800/0x5fb08b1e5b762aeb lrc: 9/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 25813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403590.476676:0:25813:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff90a281b05a00/0x5fb08b1e5b762aba lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb128d5e expref: 12 pid: 22778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403590.476691:0:25813:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff90a281b05a00/0x5fb08b1e5b762aba lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb128d5e expref: 12 pid: 22778 timeout: 736 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789403590.476736:0:25813:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a14251f480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25813:1876325050869888:192.168.203.43@tcp:104: 00010000:00010000:3.0:1789403590.476839:0:25813:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff90a270185000/0x5fb08b1e5b762a7b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb128cee expref: 12 pid: 22778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403590.476848:0:25813:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff90a270185000/0x5fb08b1e5b762a7b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb128cee expref: 12 pid: 22778 timeout: 736 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789403590.476857:0:25813:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a14251f800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25813:1876325050870016:192.168.203.43@tcp:104: 00010000:00010000:3.0:1789403590.476887:0:25813:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff90a248af0000/0x5fb08b1e5b76282f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5fb08b1e5b762828 expref: 23 pid: 22780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403590.476895:0:25813:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff90a248af0000/0x5fb08b1e5b76282f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5fb08b1e5b762828 expref: 23 pid: 22780 timeout: 736 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789403590.476904:0:25813:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a14251ed80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25813:1876325050870144:0@lo:104: 00000100:00100000:3.0:1789403590.476953:0:25813:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1789403590.477000:0:25813:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff90a259947400/0x5fb08b1e5b762795 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5fb08b1e5b76278e expref: 23 pid: 22778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403590.477008:0:25813:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff90a259947400/0x5fb08b1e5b762795 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5fb08b1e5b76278e expref: 23 pid: 22778 timeout: 736 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789403590.477015:0:25813:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a14251d180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25813:1876325050870272:0@lo:104: 00000100:00100000:3.0:1789403590.477034:0:25813:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1789403590.477056:0:25813:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff90a144063000/0x5fb08b1e5b762756 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5fb08b1e5b76274f expref: 23 pid: 22778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403590.477064:0:25813:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff90a144063000/0x5fb08b1e5b762756 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5fb08b1e5b76274f expref: 23 pid: 22778 timeout: 736 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789403590.477079:0:25813:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a14251e680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25813:1876325050870400:0@lo:104: 00000100:00100000:3.0:1789403590.477100:0:25813:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1789403590.477116:0:25813:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff90a144062200/0x5fb08b1e5b762748 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x5fb08b1e5b762741 expref: 23 pid: 22778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403590.477124:0:25813:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff90a144062200/0x5fb08b1e5b762748 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x5fb08b1e5b762741 expref: 23 pid: 22778 timeout: 736 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789403590.477131:0:25813:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a14251dc00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25813:1876325050870528:0@lo:104: 00000100:00100000:3.0:1789403590.477150:0:25813:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789403590.477158:0:25813:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a274cd29c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789403590.477585:0:22770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050870144 00000100:00100000:0.0:1789403590.477607:0:22770:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050870144 00000100:00100000:0.0:1789403590.477643:0:22770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050870272 00000100:00100000:0.0:1789403590.477647:0:22770:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050870272 00000100:00100000:0.0:1789403590.477657:0:22770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050870400 00000100:00100000:0.0:1789403590.477660:0:22770:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050870400 00000100:00100000:0.0:1789403590.477668:0:22770:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050870528 00000100:00100000:0.0:1789403590.477670:0:22770:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050870528 00000100:00100000:0.0:1789403590.477681:0:22770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1789403590.477689:0:22770:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a14251e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:7ccb4038-daf9-4dcd-9b85-da9390181204+6:25813:x1876325050870144:12345-0@lo:104: 00010000:00010000:0.0:1789403590.477700:0:22770:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.143@tcp lock: ffff90a270185800/0x5fb08b1e5b762828 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x5fb08b1e5b76282f expref: -99 pid: 25105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403590.477780:0:22770:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1789403590.477785:0:22770:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a14251e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:7ccb4038-daf9-4dcd-9b85-da9390181204+6:25813:x1876325050870144:12345-0@lo:104: Request processed in 98us (833us total) trans 0 rc 0/0 00000100:00100000:0.0:1789403590.477792:0:22770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1789403590.477809:0:22770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1789403590.477815:0:22770:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a14251f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:7ccb4038-daf9-4dcd-9b85-da9390181204+5:25813:x1876325050870272:12345-0@lo:104: 00010000:00010000:0.0:1789403590.477830:0:22770:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.143@tcp lock: ffff90a248af0600/0x5fb08b1e5b76278e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x5fb08b1e5b762795 expref: -99 pid: 24286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403590.477865:0:22770:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1789403590.477870:0:22770:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a14251f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:7ccb4038-daf9-4dcd-9b85-da9390181204+5:25813:x1876325050870272:12345-0@lo:104: Request processed in 56us (835us total) trans 0 rc 0/0 00000100:00100000:0.0:1789403590.477877:0:22770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1789403590.477889:0:22770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1789403590.477895:0:22770:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a14251ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:7ccb4038-daf9-4dcd-9b85-da9390181204+4:25813:x1876325050870400:12345-0@lo:104: 00010000:00010000:0.0:1789403590.477902:0:22770:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.143@tcp lock: ffff90a259946600/0x5fb08b1e5b76274f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x5fb08b1e5b762756 expref: -99 pid: 22783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403590.477930:0:22770:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:0.0:1789403590.477936:0:22770:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a14251ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:7ccb4038-daf9-4dcd-9b85-da9390181204+4:25813:x1876325050870400:12345-0@lo:104: Request processed in 42us (835us total) trans 0 rc 0/0 00000100:00100000:0.0:1789403590.477941:0:22770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1789403590.477953:0:22770:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1789403590.477958:0:22770:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a14251c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:7ccb4038-daf9-4dcd-9b85-da9390181204+3:25813:x1876325050870528:12345-0@lo:104: 00010000:00010000:0.0:1789403590.477965:0:22770:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.143@tcp lock: ffff90a144063800/0x5fb08b1e5b762741 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x5fb08b1e5b762748 expref: -99 pid: 22783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403590.478000:0:22770:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:0.0:1789403590.478004:0:22770:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a14251c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:7ccb4038-daf9-4dcd-9b85-da9390181204+3:25813:x1876325050870528:12345-0@lo:104: Request processed in 47us (854us total) trans 0 rc 0/0 00000100:00100000:0.0:1789403590.478009:0:22770:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00010000:1.0:1789403590.478440:0:22775:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:1.0:1789403590.478447:0:22775:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.143@tcp lock: ffff90a270185800/0x5fb08b1e5b762828 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x5fb08b1e5b76282f expref: -99 pid: 25105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403590.478455:0:22775:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a270185800 already unused, calling callback (ffffffffc120dc20) 10000000:00010000:1.0:1789403590.478471:0:22775:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.143@tcp lock: ffff90a270185800/0x5fb08b1e5b762828 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x5fb08b1e5b76282f expref: -99 pid: 25105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403590.478479:0:22775:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.143@tcp lock: ffff90a270185800/0x5fb08b1e5b762828 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x5fb08b1e5b76282f expref: -99 pid: 25105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789403590.478486:0:22775:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.143@tcp lock: ffff90a270185800/0x5fb08b1e5b762828 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x5fb08b1e5b76282f expref: -99 pid: 25105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789403590.478492:0:22775:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1789403590.478526:0:22775:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.143@tcp lock: ffff90a270185800/0x5fb08b1e5b762828 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5fb08b1e5b76282f expref: -99 pid: 25105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403590.478547:0:22775:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789403590.478572:0:22775:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.143@tcp lock: ffff90a270185800/0x5fb08b1e5b762828 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5fb08b1e5b76282f expref: -99 pid: 25105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403590.478582:0:22775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.143@tcp lock: ffff90a270185800/0x5fb08b1e5b762828 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5fb08b1e5b76282f expref: -99 pid: 25105 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403590.478610:0:22775:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1789403590.478614:0:22775:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.143@tcp lock: ffff90a248af0600/0x5fb08b1e5b76278e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x5fb08b1e5b762795 expref: -99 pid: 24286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403590.478621:0:22775:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a248af0600 already unused, calling callback (ffffffffc120dc20) 10000000:00010000:1.0:1789403590.478624:0:22775:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.143@tcp lock: ffff90a248af0600/0x5fb08b1e5b76278e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x5fb08b1e5b762795 expref: -99 pid: 24286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403590.478631:0:22775:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.143@tcp lock: ffff90a248af0600/0x5fb08b1e5b76278e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x5fb08b1e5b762795 expref: -99 pid: 24286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789403590.478637:0:22775:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.143@tcp lock: ffff90a248af0600/0x5fb08b1e5b76278e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x5fb08b1e5b762795 expref: -99 pid: 24286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789403590.478641:0:22775:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1789403590.478654:0:22775:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.143@tcp lock: ffff90a248af0600/0x5fb08b1e5b76278e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5fb08b1e5b762795 expref: -99 pid: 24286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403590.478659:0:22775:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789403590.478675:0:22775:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.143@tcp lock: ffff90a248af0600/0x5fb08b1e5b76278e lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5fb08b1e5b762795 expref: -99 pid: 24286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403590.478681:0:22775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.143@tcp lock: ffff90a248af0600/0x5fb08b1e5b76278e lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5fb08b1e5b762795 expref: -99 pid: 24286 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403590.478697:0:22775:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1789403590.478700:0:22775:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.143@tcp lock: ffff90a259946600/0x5fb08b1e5b76274f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x5fb08b1e5b762756 expref: -99 pid: 22783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403590.478705:0:22775:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a259946600 already unused, calling callback (ffffffffc120dc20) 10000000:00010000:1.0:1789403590.478708:0:22775:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.143@tcp lock: ffff90a259946600/0x5fb08b1e5b76274f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x5fb08b1e5b762756 expref: -99 pid: 22783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403590.478724:0:22775:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.143@tcp lock: ffff90a259946600/0x5fb08b1e5b76274f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x5fb08b1e5b762756 expref: -99 pid: 22783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789403590.478731:0:22775:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.143@tcp lock: ffff90a259946600/0x5fb08b1e5b76274f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x5fb08b1e5b762756 expref: -99 pid: 22783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789403590.478735:0:22775:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1789403590.478747:0:22775:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.143@tcp lock: ffff90a259946600/0x5fb08b1e5b76274f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5fb08b1e5b762756 expref: -99 pid: 22783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403590.478770:0:22775:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789403590.478777:0:22775:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.143@tcp lock: ffff90a259946600/0x5fb08b1e5b76274f lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5fb08b1e5b762756 expref: -99 pid: 22783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403590.478784:0:22775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.143@tcp lock: ffff90a259946600/0x5fb08b1e5b76274f lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5fb08b1e5b762756 expref: -99 pid: 22783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403590.478792:0:22775:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789403590.478795:0:22775:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.143@tcp lock: ffff90a144063800/0x5fb08b1e5b762741 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x5fb08b1e5b762748 expref: -99 pid: 22783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403590.478811:0:22775:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a144063800 already unused, calling callback (ffffffffc120dc20) 10000000:00010000:1.0:1789403590.478814:0:22775:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.143@tcp lock: ffff90a144063800/0x5fb08b1e5b762741 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x5fb08b1e5b762748 expref: -99 pid: 22783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403590.478821:0:22775:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.143@tcp lock: ffff90a144063800/0x5fb08b1e5b762741 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x5fb08b1e5b762748 expref: -99 pid: 22783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789403590.478826:0:22775:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.143@tcp lock: ffff90a144063800/0x5fb08b1e5b762741 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x5fb08b1e5b762748 expref: -99 pid: 22783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789403590.478831:0:22775:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1789403590.478844:0:22775:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.143@tcp lock: ffff90a144063800/0x5fb08b1e5b762741 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5fb08b1e5b762748 expref: -99 pid: 22783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403590.478849:0:22775:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789403590.478855:0:22775:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.143@tcp lock: ffff90a144063800/0x5fb08b1e5b762741 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5fb08b1e5b762748 expref: -99 pid: 22783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403590.478860:0:22775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.143@tcp lock: ffff90a144063800/0x5fb08b1e5b762741 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x5fb08b1e5b762748 expref: -99 pid: 22783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403590.478873:0:22775:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789403590.478875:0:22775:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789403590.478877:0:22775:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789403590.478884:0:25221:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789403590.478897:0:3629:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a144b28a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:7ccb4038-daf9-4dcd-9b85-da9390181204:3629:1876325050870656:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789403590.478935:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789403590.478982:0:3629:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789403590.478989:0:3629:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a144b28700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:7ccb4038-daf9-4dcd-9b85-da9390181204:3629:1876325050871040:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789403590.479018:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789403590.479046:0:3626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a144b29500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7ccb4038-daf9-4dcd-9b85-da9390181204:3626:1876325050870784:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789403590.479066:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789403590.479085:0:3626:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789403590.479090:0:3626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a144b2a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7ccb4038-daf9-4dcd-9b85-da9390181204:3626:1876325050870912:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789403590.479108:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789403590.479132:0:23939:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050870656 00000100:00100000:1.0:1789403590.479138:0:23939:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050870656 00010000:00010000:1.0:1789403590.479158:0:23939:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff90a248af0000/0x5fb08b1e5b76282f lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5fb08b1e5b762828 expref: 24 pid: 22780 timeout: 736 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789403590.479175:0:23939:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050871040 00000100:00100000:1.0:1789403590.479178:0:23939:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050871040 00010000:00010000:1.0:1789403590.479188:0:23939:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff90a144062200/0x5fb08b1e5b762748 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5fb08b1e5b762741 expref: 25 pid: 22778 timeout: 736 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789403590.479198:0:23939:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050870784 00000100:00100000:1.0:1789403590.479200:0:23939:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050870784 00010000:00010000:1.0:1789403590.479209:0:23939:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff90a259947400/0x5fb08b1e5b762795 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5fb08b1e5b76278e expref: 26 pid: 22778 timeout: 736 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789403590.479218:0:23939:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050870912 00000100:00100000:1.0:1789403590.479220:0:23939:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050870912 00010000:00010000:1.0:1789403590.479229:0:23939:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff90a144063000/0x5fb08b1e5b762756 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5fb08b1e5b76274f expref: 27 pid: 22778 timeout: 736 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789403590.479241:0:23939:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1789403590.479247:0:23939:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a144b28380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7ccb4038-daf9-4dcd-9b85-da9390181204+27:3629:x1876325050870656:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789403590.479258:0:23939:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789403590.479268:0:23939:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff90a248af0000/0x5fb08b1e5b76282f lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5fb08b1e5b762828 expref: 27 pid: 22780 timeout: 736 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403590.479276:0:23939:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff90a248af0000/0x5fb08b1e5b76282f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5fb08b1e5b762828 expref: 27 pid: 22780 timeout: 736 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403590.479291:0:23939:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789403590.479318:0:23939:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a144b28380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7ccb4038-daf9-4dcd-9b85-da9390181204+27:3629:x1876325050870656:12345-0@lo:103:ldlm_bl.0 Request processed in 71us (382us total) trans 0 rc 0/0 00000100:00100000:1.0:1789403590.479325:0:23939:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1789403590.479339:0:23939:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1789403590.479344:0:23939:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a144b2bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7ccb4038-daf9-4dcd-9b85-da9390181204+26:3629:x1876325050871040:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789403590.479350:0:23939:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789403590.479363:0:23939:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff90a144062200/0x5fb08b1e5b762748 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5fb08b1e5b762741 expref: 26 pid: 22778 timeout: 736 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403590.479371:0:23939:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff90a144062200/0x5fb08b1e5b762748 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5fb08b1e5b762741 expref: 26 pid: 22778 timeout: 736 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403590.479379:0:23939:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789403590.479427:0:23939:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a144b2bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7ccb4038-daf9-4dcd-9b85-da9390181204+26:3629:x1876325050871040:12345-0@lo:103:ldlm_bl.0 Request processed in 83us (408us total) trans 0 rc 0/0 00000100:00100000:1.0:1789403590.479438:0:23939:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1789403590.479450:0:23939:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1789403590.479455:0:23939:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a141aac380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7ccb4038-daf9-4dcd-9b85-da9390181204+25:3626:x1876325050870784:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789403590.479462:0:23939:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789403590.479472:0:23939:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff90a259947400/0x5fb08b1e5b762795 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5fb08b1e5b76278e expref: 25 pid: 22778 timeout: 736 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403590.479488:0:23939:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff90a259947400/0x5fb08b1e5b762795 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5fb08b1e5b76278e expref: 25 pid: 22778 timeout: 736 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403590.479502:0:23939:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789403590.479526:0:23939:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a141aac380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7ccb4038-daf9-4dcd-9b85-da9390181204+25:3626:x1876325050870784:12345-0@lo:103:ldlm_bl.0 Request processed in 71us (460us total) trans 0 rc 0/0 00000100:00100000:1.0:1789403590.479539:0:23939:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1789403590.479551:0:23939:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1789403590.479556:0:23939:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a1443fed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7ccb4038-daf9-4dcd-9b85-da9390181204+24:3626:x1876325050870912:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789403590.479567:0:23939:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789403590.479571:0:23939:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff90a144063000/0x5fb08b1e5b762756 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x5fb08b1e5b76274f expref: 24 pid: 22778 timeout: 736 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403590.479579:0:23939:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff90a144063000/0x5fb08b1e5b762756 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x5fb08b1e5b76274f expref: 24 pid: 22778 timeout: 736 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403590.479587:0:23939:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789403590.479604:0:23939:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a1443fed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:7ccb4038-daf9-4dcd-9b85-da9390181204+24:3626:x1876325050870912:12345-0@lo:103:ldlm_bl.0 Request processed in 49us (496us total) trans 0 rc 0/0 00000100:00100000:1.0:1789403590.479610:0:23939:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1789403590.479650:0:3626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a144b2a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7ccb4038-daf9-4dcd-9b85-da9390181204:3626:1876325050870912:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789403590.479659:0:3626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a144b29500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:7ccb4038-daf9-4dcd-9b85-da9390181204:3626:1876325050870784:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789403590.479681:0:3629:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a144b28700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:7ccb4038-daf9-4dcd-9b85-da9390181204:3629:1876325050871040:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789403590.479687:0:3629:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a144b28a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:7ccb4038-daf9-4dcd-9b85-da9390181204:3629:1876325050870656:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789403590.479712:0:22774:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789403590.480330:0:25813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90a248af0000/0x5fb08b1e5b76282f lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5fb08b1e5b762828 expref: 23 pid: 22780 timeout: 736 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789403590.480344:0:25813:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a14251ed80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25813:1876325050870144:0@lo:104: 00010000:00010000:3.0:1789403590.480358:0:25813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90a259947400/0x5fb08b1e5b762795 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5fb08b1e5b76278e expref: 22 pid: 22778 timeout: 736 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789403590.480366:0:25813:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a14251d180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25813:1876325050870272:0@lo:104: 00010000:00010000:3.0:1789403590.480379:0:25813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90a144063000/0x5fb08b1e5b762756 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5fb08b1e5b76274f expref: 21 pid: 22778 timeout: 736 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789403590.480390:0:25813:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a14251e680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25813:1876325050870400:0@lo:104: 00010000:00010000:3.0:1789403590.480436:0:25813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90a144062200/0x5fb08b1e5b762748 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x5fb08b1e5b762741 expref: 20 pid: 22778 timeout: 736 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789403590.480449:0:25813:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a14251dc00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25813:1876325050870528:0@lo:104: 00000100:00100000:3.0:1789403590.487318:0:25813:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a14251f480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25813:1876325050869888:192.168.203.43@tcp:104: 00000100:00100000:3.0:1789403590.487349:0:25813:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a14251f800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:25813:1876325050870016:192.168.203.43@tcp:104: 00010000:00010000:3.0:1789403590.487413:0:25813:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff90a259947800/0x5fb08b1e5b762aeb lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 25813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789403590.491139:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:0.0:1789403590.491844:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:2.0:1789403590.495875:0:22772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038185984 00000100:00100000:2.0:1789403590.495891:0:22772:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038185984 00010000:00010000:2.0:1789403590.496527:0:22772:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff90a270185000/0x5fb08b1e5b762a7b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb128cee expref: 13 pid: 22778 timeout: 736 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789403590.496585:0:22772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038185856 00000100:00100000:2.0:1789403590.496657:0:22772:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038185856 00010000:00010000:2.0:1789403590.496681:0:22772:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff90a281b05a00/0x5fb08b1e5b762aba lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb128d5e expref: 14 pid: 22778 timeout: 736 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789403590.496799:0:22772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 13 00000100:00100000:2.0:1789403590.496824:0:22772:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a248410450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:126a363a-19e5-4afb-856a-0efed33190d2+14:2390:x1876325038185984:12345-192.168.203.43@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789403590.496844:0:22772:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789403590.496851:0:22772:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff90a270185000/0x5fb08b1e5b762a7b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb128cee expref: 14 pid: 22778 timeout: 736 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403590.496862:0:22772:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff90a270185000/0x5fb08b1e5b762a7b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb128cee expref: 14 pid: 22778 timeout: 736 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403590.496880:0:22772:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90a270185000/0x5fb08b1e5b762a7b lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb128cee expref: 14 pid: 22778 timeout: 736 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403590.496896:0:22772:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789403590.496966:0:22772:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a248410450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:126a363a-19e5-4afb-856a-0efed33190d2+13:2390:x1876325038185984:12345-192.168.203.43@tcp:103:ldlm_bl.0 Request processed in 145us (5836us total) trans 0 rc 0/0 00000100:00100000:2.0:1789403590.496984:0:22772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 13 00000100:00100000:2.0:1789403590.497036:0:22772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 14 00000100:00100000:2.0:1789403590.497044:0:22772:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a144183b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:126a363a-19e5-4afb-856a-0efed33190d2+12:2389:x1876325038185856:12345-192.168.203.43@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789403590.497052:0:22772:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789403590.497056:0:22772:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff90a281b05a00/0x5fb08b1e5b762aba lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb128d5e expref: 12 pid: 22778 timeout: 736 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403590.497066:0:22772:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff90a281b05a00/0x5fb08b1e5b762aba lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb128d5e expref: 12 pid: 22778 timeout: 736 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403590.497076:0:22772:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90a281b05a00/0x5fb08b1e5b762aba lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb128d5e expref: 12 pid: 22778 timeout: 736 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403590.497086:0:22772:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff90a259947800/0x5fb08b1e5b762aeb lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 25813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403590.497101:0:22772:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90a259947800/0x5fb08b1e5b762aeb lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 25813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403590.497116:0:22772:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff90a259947800/0x5fb08b1e5b762aeb lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 25813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403590.497124:0:22772:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff90a259947800/0x5fb08b1e5b762aeb lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 25813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403590.497132:0:22772:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff90a259947800/0x5fb08b1e5b762aeb lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 25813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403590.497139:0:22772:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff90a259947800/0x5fb08b1e5b762aeb lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 25813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403590.497144:0:22772:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a259947800 already unused, calling callback (ffffffffc0c0b8b0) 00010000:00010000:2.0:1789403590.497148:0:22772:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff90a259947800/0x5fb08b1e5b762aeb lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 25813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403590.497156:0:22772:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff90a259947800/0x5fb08b1e5b762aeb lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 25813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403590.497171:0:22772:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff90a259947800/0x5fb08b1e5b762aeb lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 25813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403590.497181:0:22772:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789403590.497201:0:22772:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a144183b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:126a363a-19e5-4afb-856a-0efed33190d2+11:2389:x1876325038185856:12345-192.168.203.43@tcp:103:ldlm_bl.0 Request processed in 157us (5359us total) trans 0 rc 0/0 00000100:00100000:2.0:1789403590.497208:0:22772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 14 00010000:00010000:3.0:1789403590.500316:0:25813:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff90a259947800/0x5fb08b1e5b762aeb lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 25813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403590.500334:0:25813:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff90a259947800/0x5fb08b1e5b762aeb lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 25813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403590.500342:0:25813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff90a259947800/0x5fb08b1e5b762aeb lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 25813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403591.410629:0:22775:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789403591.945274:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:2.0:1789403591.946034:0:22788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038186112 00000100:00100000:2.0:1789403591.946057:0:22788:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038186112 00000100:00100000:2.0:1789403591.946192:0:22788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 23 00000100:00100000:2.0:1789403591.946203:0:22788:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a14251f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5aa3c32d-0021-4831-930f-6e88a8b78157+6:18664:x1876325038186112:12345-192.168.203.43@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789403591.946222:0:22788:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789403591.946242:0:22788:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a270185000/0x5fb08b1e5b762af2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1acb85b3eb128d96 expref: -99 pid: 22788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403591.946303:0:22788:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a270185e00/0x5fb08b1e5b762af9 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 22788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403591.946329:0:22788:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a270185e00/0x5fb08b1e5b762af9 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403591.946341:0:22788:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a270185e00/0x5fb08b1e5b762af9 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403591.946356:0:22788:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a270184600/0x5fb08b1e5b762b00 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 22788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403591.946363:0:22788:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a270184600/0x5fb08b1e5b762b00 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403591.946369:0:22788:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a270184600/0x5fb08b1e5b762b00 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403591.946465:0:22788:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a270184400/0x5fb08b1e5b762b07 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 22788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403591.946473:0:22788:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a270184400/0x5fb08b1e5b762b07 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403591.946480:0:22788:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a270184400/0x5fb08b1e5b762b07 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22788 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789403591.946515:0:22788:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1789403591.946519:0:22788:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1789403591.946557:0:22788:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90a270184400/0x5fb08b1e5b762b07 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403591.946568:0:22788:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a270185e00/0x5fb08b1e5b762af9 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403591.946574:0:22788:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a270185e00/0x5fb08b1e5b762af9 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 22788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403591.946590:0:22788:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90a270185e00/0x5fb08b1e5b762af9 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403591.946596:0:22788:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a270185e00 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:2.0:1789403591.946600:0:22788:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a270185e00/0x5fb08b1e5b762af9 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403591.946607:0:22788:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a270185e00/0x5fb08b1e5b762af9 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 22788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403591.946619:0:22788:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90a2609b8200) 00010000:00010000:2.0:1789403591.946622:0:22788:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789403591.946627:0:22788:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90a270185e00/0x5fb08b1e5b762af9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403591.946633:0:22788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a270185e00/0x5fb08b1e5b762af9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403591.946645:0:22788:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a270184600/0x5fb08b1e5b762b00 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403591.946660:0:22788:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a270184600/0x5fb08b1e5b762b00 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 22788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403591.946665:0:22788:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90a270184600/0x5fb08b1e5b762b00 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403591.946669:0:22788:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a270184600 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:2.0:1789403591.946672:0:22788:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a270184600/0x5fb08b1e5b762b00 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403591.946677:0:22788:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a270184600/0x5fb08b1e5b762b00 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 22788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403591.946684:0:22788:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffff90a142163300) 00010000:00010000:2.0:1789403591.946687:0:22788:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789403591.946689:0:22788:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90a270184600/0x5fb08b1e5b762b00 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403591.946699:0:22788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a270184600/0x5fb08b1e5b762b00 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22788 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:3.0:1789403591.946732:0:22782:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1789403591.946733:0:22788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a270185000/0x5fb08b1e5b762af2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb128d96 expref: 8 pid: 22788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403591.946762:0:22788:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90a270184400/0x5fb08b1e5b762b07 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb128d96 expref: 7 pid: 22788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403591.946770:0:22788:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff90a142163200) 00010000:00010000:2.0:1789403591.946772:0:22788:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789403591.946780:0:22788:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a270184400, rc 0) 00000100:00100000:2.0:1789403591.946840:0:22788:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a14251f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5aa3c32d-0021-4831-930f-6e88a8b78157+7:18664:x1876325038186112:12345-192.168.203.43@tcp:101:lhsmtool_posix.0 Request processed in 640us (1574us total) trans 0 rc 0/0 00000100:00100000:2.0:1789403591.946847:0:22788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 23 00000100:00100000:1.0:1789403591.948829:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:0.0:1789403591.949094:0:22798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038186240 00000100:00100000:0.0:1789403591.949104:0:22798:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038186240 00000100:00100000:0.0:1789403591.949161:0:22798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 5 00000100:00100000:0.0:1789403591.949171:0:22798:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a1443fe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:5aa3c32d-0021-4831-930f-6e88a8b78157+7:18664:x1876325038186240:12345-192.168.203.43@tcp:900:lhsmtool_posix.0 00000100:00100000:0.0:1789403591.949338:0:22798:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a1443fe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:5aa3c32d-0021-4831-930f-6e88a8b78157+7:18664:x1876325038186240:12345-192.168.203.43@tcp:900:lhsmtool_posix.0 Request processed in 168us (517us total) trans 0 rc 0/0 00000100:00100000:0.0:1789403591.949346:0:22798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 5 00000100:00100000:1.0:1789403591.980810:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:3.0:1789403591.980893:0:22787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038186496 00000100:00100000:3.0:1789403591.980903:0:22787:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038186496 00000100:00100000:3.0:1789403591.980964:0:22787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 24 00000100:00100000:3.0:1789403591.980974:0:22787:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a1443ff100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5aa3c32d-0021-4831-930f-6e88a8b78157+7:18664:x1876325038186496:12345-192.168.203.43@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789403591.980993:0:22787:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789403591.981011:0:22787:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a259947800/0x5fb08b1e5b762b0e lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1acb85b3eb128d9d expref: -99 pid: 22787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403591.981083:0:22787:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a259947400/0x5fb08b1e5b762b15 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 22787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403591.981098:0:22787:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a259947400/0x5fb08b1e5b762b15 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403591.981127:0:22787:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a259947400/0x5fb08b1e5b762b15 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403591.981143:0:22787:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a259946200/0x5fb08b1e5b762b1c lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 22787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403591.981151:0:22787:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a259946200/0x5fb08b1e5b762b1c lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403591.981157:0:22787:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a259946200/0x5fb08b1e5b762b1c lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403591.981265:0:22787:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a259946a00/0x5fb08b1e5b762b23 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 22787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403591.981274:0:22787:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a259946a00/0x5fb08b1e5b762b23 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403591.981281:0:22787:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a259946a00/0x5fb08b1e5b762b23 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22787 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00020000:3.0:1789403591.981288:0:22787:0:(mdt_open.c:1779:mdt_reint_open()) 2 open_flags 2199023255553 00000040:00080000:2.0:1789403591.986149:0:22826:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000004:00200000:3.0:1789403592.001089:0:22787:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 4096 00010000:00010000:3.0:1789403592.003163:0:22787:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a259947400/0x5fb08b1e5b762b15 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403592.003179:0:22787:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a259947400/0x5fb08b1e5b762b15 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 22787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403592.003187:0:22787:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90a259947400/0x5fb08b1e5b762b15 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 22787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403592.003202:0:22787:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a259947400 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:3.0:1789403592.003206:0:22787:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a259947400/0x5fb08b1e5b762b15 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 22787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403592.003214:0:22787:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a259947400/0x5fb08b1e5b762b15 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 22787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403592.003231:0:22787:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff90a142163200) 00010000:00010000:3.0:1789403592.003234:0:22787:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789403592.003239:0:22787:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90a259947400/0x5fb08b1e5b762b15 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 22787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403592.003245:0:22787:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a259947400/0x5fb08b1e5b762b15 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 22787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403592.003259:0:22787:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a259946200/0x5fb08b1e5b762b1c lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403592.003265:0:22787:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a259946200/0x5fb08b1e5b762b1c lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 22787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403592.003271:0:22787:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90a259946200/0x5fb08b1e5b762b1c lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403592.003276:0:22787:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a259946200 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:3.0:1789403592.003279:0:22787:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a259946200/0x5fb08b1e5b762b1c lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403592.003285:0:22787:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a259946200/0x5fb08b1e5b762b1c lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 22787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403592.003300:0:22787:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff90a1434a7200) 00010000:00010000:3.0:1789403592.003302:0:22787:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789403592.003305:0:22787:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90a259946200/0x5fb08b1e5b762b1c lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403592.003310:0:22787:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a259946200/0x5fb08b1e5b762b1c lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403592.004044:0:22787:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a259947800/0x5fb08b1e5b762b0e lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb128d9d expref: 10 pid: 22787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403592.004063:0:22787:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90a259946a00/0x5fb08b1e5b762b23 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb128d9d expref: 9 pid: 22787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403592.004070:0:22787:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff90a1434a7c00) 00010000:00010000:3.0:1789403592.004073:0:22787:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789403592.004075:0:22787:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a259946a00, rc 0) 00000100:00100000:3.0:1789403592.004133:0:22787:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a1443ff100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5aa3c32d-0021-4831-930f-6e88a8b78157+9:18664:x1876325038186496:12345-192.168.203.43@tcp:101:lhsmtool_posix.0 Request processed in 23161us (23333us total) trans 12884901889 rc 0/0 00000100:00100000:3.0:1789403592.004141:0:22787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 24 00000100:00100000:1.0:1789403592.028520:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:0.0:1789403592.028682:0:22786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038186624 00000100:00100000:0.0:1789403592.028692:0:22786:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038186624 00000100:00100000:0.0:1789403592.028763:0:22786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 25 00000100:00100000:0.0:1789403592.028773:0:22786:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a1443fd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5aa3c32d-0021-4831-930f-6e88a8b78157+9:18664:x1876325038186624:12345-192.168.203.43@tcp:59:lhsmtool_posix.0 00000100:00100000:0.0:1789403592.028878:0:22786:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a1443fd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5aa3c32d-0021-4831-930f-6e88a8b78157+9:18664:x1876325038186624:12345-192.168.203.43@tcp:59:lhsmtool_posix.0 Request processed in 105us (366us total) trans 0 rc 0/0 00000100:00100000:0.0:1789403592.028885:0:22786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 25 00000100:00100000:1.0:1789403592.033339:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:3.0:1789403592.033434:0:22787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038186752 00000100:00100000:3.0:1789403592.033444:0:22787:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038186752 00000100:00100000:3.0:1789403592.033533:0:22787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 26 00000100:00100000:3.0:1789403592.033545:0:22787:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a1443ff800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5aa3c32d-0021-4831-930f-6e88a8b78157+5:18664:x1876325038186752:12345-192.168.203.43@tcp:59:lhsmtool_posix.0 00000100:00080000:0.0:1789403592.033714:0:22782:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000004:00080000:2.0:1789403592.034631:0:22787:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0001: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0001 0, time 1047us 00000100:00100000:1.0:1789403592.049315:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:2.0:1789403592.049534:0:22788:0:(service.c:3467:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:2.0:1789403592.049545:0:22788:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'mdt00_003' 00000100:00100000:3.0:1789403592.050007:0:22788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038186880 00000100:00100000:3.0:1789403592.050018:0:22788:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038186880 00000100:00100000:2.0:1789403592.050249:0:25827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 27 00000100:00100000:2.0:1789403592.050259:0:25827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a1443fce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5aa3c32d-0021-4831-930f-6e88a8b78157+9:18670:x1876325038186880:12345-192.168.203.43@tcp:101:lfs.0 00010000:00010000:2.0:1789403592.050279:0:25827:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789403592.050297:0:25827:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a270185000/0x5fb08b1e5b762b31 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1acb85b3eb128da4 expref: -99 pid: 25827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403592.050353:0:25827:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a270184600/0x5fb08b1e5b762b38 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 25827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403592.050367:0:25827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a270184600/0x5fb08b1e5b762b38 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 25827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403592.050377:0:25827:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a270184600/0x5fb08b1e5b762b38 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 25827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403592.050444:0:25827:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a270185e00/0x5fb08b1e5b762b3f lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 25827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403592.050615:0:25827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a270185e00/0x5fb08b1e5b762b3f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403592.050624:0:25827:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a270185e00/0x5fb08b1e5b762b3f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 25827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403592.050670:0:25827:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a270184600/0x5fb08b1e5b762b38 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 25827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403592.050677:0:25827:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a270184600/0x5fb08b1e5b762b38 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 25827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403592.050684:0:25827:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90a270184600/0x5fb08b1e5b762b38 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 25827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403592.050690:0:25827:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a270184600 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:2.0:1789403592.050694:0:25827:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a270184600/0x5fb08b1e5b762b38 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 25827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403592.050701:0:25827:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a270184600/0x5fb08b1e5b762b38 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 25827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403592.050711:0:25827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90a2609b8200) 00010000:00010000:2.0:1789403592.050714:0:25827:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789403592.050718:0:25827:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90a270184600/0x5fb08b1e5b762b38 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 25827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403592.050724:0:25827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a270184600/0x5fb08b1e5b762b38 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 25827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403592.050735:0:25827:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a270185e00/0x5fb08b1e5b762b3f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 25827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403592.050752:0:25827:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a270185e00/0x5fb08b1e5b762b3f lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 25827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403592.050756:0:25827:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90a270185e00/0x5fb08b1e5b762b3f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403592.050767:0:25827:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a270185e00 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:2.0:1789403592.050770:0:25827:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a270185e00/0x5fb08b1e5b762b3f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 25827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403592.050776:0:25827:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a270185e00/0x5fb08b1e5b762b3f lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 25827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403592.050784:0:25827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa6028a67 (ffff90a142163300) 00010000:00010000:2.0:1789403592.050787:0:25827:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789403592.050789:0:25827:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90a270185e00/0x5fb08b1e5b762b3f lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403592.050796:0:25827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a270185e00/0x5fb08b1e5b762b3f lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 25827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403592.050825:0:25827:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90a270185000/0x5fb08b1e5b762b31 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb128da4 expref: 10 pid: 25827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403592.050834:0:25827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90a2609b8200) 00010000:00010000:2.0:1789403592.050836:0:25827:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789403592.050839:0:25827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a270185000/0x5fb08b1e5b762b31 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb128da4 expref: 10 pid: 25827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403592.050848:0:25827:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a270185000, rc 0) 00000100:00100000:2.0:1789403592.050908:0:25827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a1443fce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5aa3c32d-0021-4831-930f-6e88a8b78157+9:18670:x1876325038186880:12345-192.168.203.43@tcp:101:lfs.0 Request processed in 650us (1601us total) trans 0 rc 301/301 00000100:00100000:2.0:1789403592.050914:0:25827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 27 00000100:00100000:1.0:1789403592.057878:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:3.0:1789403592.058048:0:22795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038187008 00000100:00100000:3.0:1789403592.058072:0:22795:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038187008 00000100:00100000:3.0:1789403592.058131:0:22795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 0 00000100:00100000:3.0:1789403592.058141:0:22795:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a1443fe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:5aa3c32d-0021-4831-930f-6e88a8b78157+9:18670:x1876325038187008:12345-192.168.203.43@tcp:700:lfs.0 00000100:00100000:3.0:1789403592.058239:0:22795:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a1443fe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:5aa3c32d-0021-4831-930f-6e88a8b78157+9:18670:x1876325038187008:12345-192.168.203.43@tcp:700:lfs.0 Request processed in 99us (374us total) trans 0 rc 0/0 00000100:00100000:3.0:1789403592.058246:0:22795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 0 00000100:00100000:3.0:1789403592.064138:0:22787:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a1443ff800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5aa3c32d-0021-4831-930f-6e88a8b78157+5:18664:x1876325038186752:12345-192.168.203.43@tcp:59:lhsmtool_posix.0 Request processed in 30588us (30802us total) trans 0 rc 0/0 00000100:00100000:3.0:1789403592.064152:0:22787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 26 00000100:00100000:1.0:1789403592.069132:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:3.0:1789403592.069210:0:22788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038187264 00000100:00100000:3.0:1789403592.069221:0:22788:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038187264 00000100:00100000:3.0:1789403592.069283:0:22788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 28 00000100:00100000:3.0:1789403592.069293:0:22788:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a1443fc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5aa3c32d-0021-4831-930f-6e88a8b78157+9:18670:x1876325038187264:12345-192.168.203.43@tcp:36:lfs.0 00010000:00010000:3.0:1789403592.069347:0:22788:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789403592.069373:0:22788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a259946e00/0x5fb08b1e5b762aa5 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb128d1f expref: 9 pid: 22788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403592.069427:0:22788:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90a2609b8200) 00010000:00010000:3.0:1789403592.069432:0:22788:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789403592.069506:0:22788:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90a259947800/0x5fb08b1e5b762b46 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 22788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403592.069522:0:22788:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90a270184000/0x5fb08b1e5b762ae4 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb128d8f expref: 5 pid: 22787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403592.069531:0:22788:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a259947800/0x5fb08b1e5b762b46 lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403592.069584:0:22788:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90a270184000/0x5fb08b1e5b762ae4 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb128d8f expref: 5 pid: 22787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403592.069609:0:22788:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90a270184000/0x5fb08b1e5b762ae4 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb128d8f expref: 5 pid: 22787 timeout: 738 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789403592.069625:0:22788:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a14251f480 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:22788:1876325050871168:192.168.203.43@tcp:104: 00000100:00100000:3.0:1789403592.069709:0:22788:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a274cd2000 going to sleep for 11 seconds 00000100:00100000:1.0:1789403592.072152:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:3.0:1789403592.072246:0:22788:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a14251f480 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:22788:1876325050871168:192.168.203.43@tcp:104: 00010000:00010000:3.0:1789403592.072270:0:22788:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90a259947800/0x5fb08b1e5b762b46 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22788 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789403592.072335:0:23939:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038187392 00000100:00100000:2.0:1789403592.072354:0:23939:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038187392 00010000:00010000:2.0:1789403592.073626:0:23939:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a270184000/0x5fb08b1e5b762ae4 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb128d8f expref: 6 pid: 22787 timeout: 738 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789403592.073672:0:23939:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 15 00000100:00100000:2.0:1789403592.073685:0:23939:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a1443fd180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:64a26033-a2bf-42a8-98b4-c36979dfd570+6:2390:x1876325038187392:12345-192.168.203.43@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789403592.073701:0:23939:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789403592.073708:0:23939:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90a270184000/0x5fb08b1e5b762ae4 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb128d8f expref: 6 pid: 22787 timeout: 738 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403592.073721:0:23939:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90a270184000/0x5fb08b1e5b762ae4 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb128d8f expref: 6 pid: 22787 timeout: 738 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403592.073799:0:23939:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a270184000/0x5fb08b1e5b762ae4 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb128d8f expref: 6 pid: 22787 timeout: 738 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403592.073815:0:23939:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90a2609b8200) 00010000:00010000:2.0:1789403592.073820:0:23939:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff90a259947800/0x5fb08b1e5b762b46 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403592.073829:0:23939:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90a259947800/0x5fb08b1e5b762b46 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 22788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403592.073837:0:23939:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a259947800/0x5fb08b1e5b762b46 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 22788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403592.073874:0:23939:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789403592.073935:0:23939:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a1443fd180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:64a26033-a2bf-42a8-98b4-c36979dfd570+5:2390:x1876325038187392:12345-192.168.203.43@tcp:103:ldlm_bl.0 Request processed in 243us (1781us total) trans 0 rc 0/0 00000100:00100000:2.0:1789403592.073958:0:23939:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 15 00010000:00010000:1.0:1789403592.074226:0:22788:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90a259947800/0x5fb08b1e5b762b46 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403592.074237:0:22788:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a259947800/0x5fb08b1e5b762b46 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403592.074262:0:22788:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90a281b05400/0x5fb08b1e5b762b4d lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 22788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403592.074273:0:22788:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a281b05400/0x5fb08b1e5b762b4d lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403592.074282:0:22788:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a281b05400/0x5fb08b1e5b762b4d lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22788 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1789403592.074922:0:22782:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1789403592.076848:0:22788:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90a281b05800/0x5fb08b1e5b762b54 lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 22788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403592.076868:0:22788:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a281b05800/0x5fb08b1e5b762b54 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403592.076880:0:22788:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a281b05800/0x5fb08b1e5b762b54 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22788 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789403592.076911:0:22788:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000050f30a17 reply state 000000004c720876 transno 12884901890 ns: mdt-lustre-MDT0000_UUID lock: ffff90a281b05800/0x5fb08b1e5b762b54 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403592.077040:0:22788:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a281b05800/0x5fb08b1e5b762b54 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403592.077052:0:22788:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff90a142629000) 00010000:00010000:1.0:1789403592.077055:0:22788:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1789403592.077060:0:22788:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:1.0:1789403592.077066:0:22788:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 4096 00010000:00010000:1.0:1789403592.077075:0:22788:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90a259947800/0x5fb08b1e5b762b46 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403592.077083:0:22788:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a259947800/0x5fb08b1e5b762b46 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 22788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403592.077090:0:22788:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90a259947800/0x5fb08b1e5b762b46 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403592.077096:0:22788:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a259947800 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:1.0:1789403592.077101:0:22788:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a259947800/0x5fb08b1e5b762b46 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403592.077108:0:22788:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a259947800/0x5fb08b1e5b762b46 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 22788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403592.077117:0:22788:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90a2609b8200) 00010000:00010000:1.0:1789403592.077120:0:22788:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789403592.077124:0:22788:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90a259947800/0x5fb08b1e5b762b46 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403592.077141:0:22788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a259947800/0x5fb08b1e5b762b46 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22788 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789403592.077162:0:22788:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000050f30a17 reply state 000000004c720876 transno 12884901890 ns: mdt-lustre-MDT0000_UUID lock: ffff90a281b05400/0x5fb08b1e5b762b4d lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403592.077173:0:22788:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a281b05400/0x5fb08b1e5b762b4d lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403592.077179:0:22788:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa6028a67 (ffff90a142629800) 00010000:00010000:1.0:1789403592.077182:0:22788:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1789403592.077184:0:22788:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000100:00100000:1.0:1789403592.077334:0:22788:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a1443fc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5aa3c32d-0021-4831-930f-6e88a8b78157+10:18670:x1876325038187264:12345-192.168.203.43@tcp:36:lfs.0 Request processed in 8039us (8207us total) trans 12884901890 rc 0/0 00000100:00100000:1.0:1789403592.077343:0:22788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 28 00000100:00100000:0.0:1789403592.198025:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:2.0:1789403592.201079:0:25827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038187520 00000100:00100000:2.0:1789403592.201095:0:25827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038187520 00000100:00100000:3.0:1789403592.201357:0:22787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 29 00000100:00100000:3.0:1789403592.201371:0:22787:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a144183100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5aa3c32d-0021-4831-930f-6e88a8b78157+10:18678:x1876325038187520:12345-192.168.203.43@tcp:101:lctl.0 00010000:00010000:3.0:1789403592.201952:0:22787:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789403592.201976:0:22787:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a259946e00/0x5fb08b1e5b762b5b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1acb85b3eb128dab expref: -99 pid: 22787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403592.202042:0:22787:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a259946200/0x5fb08b1e5b762b62 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 22787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403592.202057:0:22787:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a259946200/0x5fb08b1e5b762b62 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403592.202068:0:22787:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a259946200/0x5fb08b1e5b762b62 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22787 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789403592.202129:0:22787:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1789403592.202133:0:22787:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1789403592.202336:0:22787:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90a259946200/0x5fb08b1e5b762b62 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403592.202363:0:22787:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a259946e00/0x5fb08b1e5b762b5b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb128dab expref: 12 pid: 22787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403592.202945:0:22787:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90a259946200/0x5fb08b1e5b762b62 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb128dab expref: 11 pid: 22787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403592.202956:0:22787:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90a1434a7200) 00010000:00010000:3.0:1789403592.202958:0:22787:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789403592.202961:0:22787:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a259946200, rc 0) 00000100:00100000:3.0:1789403592.203097:0:22787:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a144183100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5aa3c32d-0021-4831-930f-6e88a8b78157+11:18678:x1876325038187520:12345-192.168.203.43@tcp:101:lctl.0 Request processed in 1728us (5079us total) trans 0 rc 0/0 00000100:00100000:3.0:1789403592.203105:0:22787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 29 00000100:00100000:3.0:1789403592.243980:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:1.0:1789403592.244091:0:22786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038187648 00000100:00100000:1.0:1789403592.244100:0:22786:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038187648 00000100:00100000:1.0:1789403592.244160:0:22786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 30 00000100:00100000:1.0:1789403592.244185:0:22786:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a14251f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:64a26033-a2bf-42a8-98b4-c36979dfd570+5:18679:x1876325038187648:12345-192.168.203.43@tcp:101:lfs.0 00010000:00010000:1.0:1789403592.244208:0:22786:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789403592.244228:0:22786:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a281b05e00/0x5fb08b1e5b762b69 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1acb85b3eb128db2 expref: -99 pid: 22786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403592.244299:0:22786:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a281b04c00/0x5fb08b1e5b762b70 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 22786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403592.244313:0:22786:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a281b04c00/0x5fb08b1e5b762b70 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403592.244342:0:22786:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a281b04c00/0x5fb08b1e5b762b70 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22786 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789403592.244384:0:22786:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1789403592.244427:0:22786:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1789403592.244447:0:22786:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90a281b04c00/0x5fb08b1e5b762b70 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403592.244619:0:22786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a281b05e00/0x5fb08b1e5b762b69 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb128db2 expref: 7 pid: 22786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403592.244638:0:22786:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90a281b04c00/0x5fb08b1e5b762b70 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb128db2 expref: 6 pid: 22786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403592.244647:0:22786:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90a1434a7200) 00010000:00010000:1.0:1789403592.244650:0:22786:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1789403592.244654:0:22786:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a281b04c00, rc 0) 00000100:00100000:1.0:1789403592.244708:0:22786:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a14251f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:64a26033-a2bf-42a8-98b4-c36979dfd570+6:18679:x1876325038187648:12345-192.168.203.43@tcp:101:lfs.0 Request processed in 539us (736us total) trans 0 rc 0/0 00000100:00100000:1.0:1789403592.244715:0:22786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 30 00000100:00100000:1.0:1789403592.246806:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:2.0:1789403592.252733:0:25827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038187776 00000100:00100000:2.0:1789403592.252759:0:25827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038187776 00000100:00100000:2.0:1789403592.253054:0:25827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 31 00000100:00100000:2.0:1789403592.253068:0:25827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a1443fca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:64a26033-a2bf-42a8-98b4-c36979dfd570+6:18679:x1876325038187776:12345-192.168.203.43@tcp:101:lfs.0 00010000:00010000:2.0:1789403592.253089:0:25827:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789403592.253110:0:25827:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a270184000/0x5fb08b1e5b762b77 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1acb85b3eb128db9 expref: -99 pid: 25827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403592.253370:0:25827:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a270185000/0x5fb08b1e5b762b7e lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 25827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403592.253414:0:25827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a270185000/0x5fb08b1e5b762b7e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 25827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403592.253427:0:25827:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a270185000/0x5fb08b1e5b762b7e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 25827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403592.253440:0:25827:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a270185e00/0x5fb08b1e5b762b85 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 25827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403592.254356:0:25827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a270185e00/0x5fb08b1e5b762b85 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 25827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403592.254369:0:25827:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a270185e00/0x5fb08b1e5b762b85 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 25827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403592.254969:0:25827:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a270184600/0x5fb08b1e5b762b8c lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 25827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403592.254995:0:25827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a270184600/0x5fb08b1e5b762b8c lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 25827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403592.255003:0:25827:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a270184600/0x5fb08b1e5b762b8c lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 25827 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789403592.255048:0:25827:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1789403592.255052:0:25827:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1789403592.255075:0:25827:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90a270184600/0x5fb08b1e5b762b8c lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 25827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403592.255087:0:25827:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a270185000/0x5fb08b1e5b762b7e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 25827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403592.255094:0:25827:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a270185000/0x5fb08b1e5b762b7e lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 25827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403592.255101:0:25827:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90a270185000/0x5fb08b1e5b762b7e lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 25827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403592.255106:0:25827:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a270185000 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:2.0:1789403592.255110:0:25827:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a270185000/0x5fb08b1e5b762b7e lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 25827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403592.255117:0:25827:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a270185000/0x5fb08b1e5b762b7e lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 25827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403592.255128:0:25827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90a1434a7200) 00010000:00010000:2.0:1789403592.255131:0:25827:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789403592.255137:0:25827:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90a270185000/0x5fb08b1e5b762b7e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 25827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403592.255154:0:25827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a270185000/0x5fb08b1e5b762b7e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 25827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403592.255648:0:25827:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a270185e00/0x5fb08b1e5b762b85 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 25827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403592.255657:0:25827:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a270185e00/0x5fb08b1e5b762b85 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 25827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403592.255663:0:25827:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90a270185e00/0x5fb08b1e5b762b85 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 25827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403592.255667:0:25827:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a270185e00 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:2.0:1789403592.255670:0:25827:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a270185e00/0x5fb08b1e5b762b85 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 25827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403592.255676:0:25827:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a270185e00/0x5fb08b1e5b762b85 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 25827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403592.255686:0:25827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa6028a67 (ffff90a142629800) 00010000:00010000:2.0:1789403592.255688:0:25827:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789403592.255692:0:25827:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90a270185e00/0x5fb08b1e5b762b85 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 25827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403592.255697:0:25827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a270185e00/0x5fb08b1e5b762b85 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 25827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403592.255732:0:25827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a270184000/0x5fb08b1e5b762b77 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb128db9 expref: 8 pid: 25827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403592.255772:0:25827:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90a270184600/0x5fb08b1e5b762b8c lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb128db9 expref: 7 pid: 25827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403592.255779:0:25827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff90a142629000) 00010000:00010000:2.0:1789403592.255781:0:25827:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789403592.255784:0:25827:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a270184600, rc 0) 00000100:00100000:2.0:1789403592.255863:0:25827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a1443fca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:64a26033-a2bf-42a8-98b4-c36979dfd570+7:18679:x1876325038187776:12345-192.168.203.43@tcp:101:lfs.0 Request processed in 2798us (9064us total) trans 0 rc 0/0 00000100:00100000:2.0:1789403592.255872:0:25827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 31 00000100:00100000:0.0:1789403592.264672:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:3.0:1789403592.264871:0:22797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038187904 00000100:00100000:3.0:1789403592.264880:0:22797:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038187904 00000100:00100000:3.0:1789403592.264956:0:22797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 6 00000100:00100000:3.0:1789403592.264966:0:22797:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a144181c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:64a26033-a2bf-42a8-98b4-c36979dfd570+5:18679:x1876325038187904:12345-192.168.203.43@tcp:900:lfs.0 00000100:00100000:3.0:1789403592.265045:0:22797:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a144181c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:64a26033-a2bf-42a8-98b4-c36979dfd570+5:18679:x1876325038187904:12345-192.168.203.43@tcp:900:lfs.0 Request processed in 81us (383us total) trans 0 rc 0/0 00000100:00100000:3.0:1789403592.265053:0:22797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 6 00000100:00080000:1.0:1789403592.266128:0:22782:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1789403592.289699:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:1.0:1789403592.289876:0:22786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038188160 00000100:00100000:1.0:1789403592.289886:0:22786:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038188160 00000100:00100000:1.0:1789403592.289952:0:22786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 32 00000100:00100000:1.0:1789403592.289963:0:22786:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a14251dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:64a26033-a2bf-42a8-98b4-c36979dfd570+7:18679:x1876325038188160:12345-192.168.203.43@tcp:101:lfs.0 00010000:00010000:1.0:1789403592.289984:0:22786:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789403592.290010:0:22786:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a281b05e00/0x5fb08b1e5b762b93 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1acb85b3eb128dc0 expref: -99 pid: 22786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789403592.290107:0:22786:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 4096 00010000:00010000:1.0:1789403592.290212:0:22786:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90a281b05e00/0x5fb08b1e5b762b93 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb128dc0 expref: 9 pid: 22786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403592.290226:0:22786:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90a1434a7200) 00010000:00010000:1.0:1789403592.290229:0:22786:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1789403592.290611:0:22786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a281b05e00/0x5fb08b1e5b762b93 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb128dc0 expref: 9 pid: 22786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403592.290626:0:22786:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a281b05e00, rc 0) 00000100:00100000:1.0:1789403592.290681:0:22786:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a14251dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:64a26033-a2bf-42a8-98b4-c36979dfd570+8:18679:x1876325038188160:12345-192.168.203.43@tcp:101:lfs.0 Request processed in 719us (994us total) trans 12884901891 rc 301/301 00000100:00100000:1.0:1789403592.290689:0:22786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 32 00000100:00100000:3.0:1789403592.296778:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:2.0:1789403592.296938:0:22787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038188416 00000100:00100000:2.0:1789403592.296948:0:22787:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038188416 00000100:00100000:2.0:1789403592.297005:0:22787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 33 00000100:00100000:2.0:1789403592.297015:0:22787:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a14251e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:64a26033-a2bf-42a8-98b4-c36979dfd570+8:18679:x1876325038188416:12345-192.168.203.43@tcp:36:lfs.0 00010000:00010000:2.0:1789403592.297067:0:22787:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789403592.297094:0:22787:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a270184600/0x5fb08b1e5b762b8c lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb128db9 expref: 8 pid: 25827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403592.297112:0:22787:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff90a142629000) 00010000:00010000:2.0:1789403592.297117:0:22787:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789403592.297137:0:22787:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90a270184000/0x5fb08b1e5b762ba1 lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 22787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403592.297150:0:22787:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a270184000/0x5fb08b1e5b762ba1 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403592.297160:0:22787:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a270184000/0x5fb08b1e5b762ba1 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22787 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789403592.297373:0:22787:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000005dc7a06d reply state 00000000792eaca9 transno 12884901892 ns: mdt-lustre-MDT0000_UUID lock: ffff90a270184000/0x5fb08b1e5b762ba1 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403592.297434:0:22787:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a270184000/0x5fb08b1e5b762ba1 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403592.297442:0:22787:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff90a142629000) 00010000:00010000:2.0:1789403592.297445:0:22787:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00000100:00100000:2.0:1789403592.297458:0:22787:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:2.0:1789403592.297468:0:22787:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 4096 00000100:00100000:2.0:1789403592.297545:0:22787:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a14251e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:64a26033-a2bf-42a8-98b4-c36979dfd570+9:18679:x1876325038188416:12345-192.168.203.43@tcp:36:lfs.0 Request processed in 531us (777us total) trans 12884901892 rc 0/0 00000100:00100000:2.0:1789403592.297552:0:22787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 33 00000100:00100000:0.0:1789403592.301593:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:2.0:1789403592.301748:0:22790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038188672 00000100:00100000:2.0:1789403592.301757:0:22790:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038188672 00000100:00100000:2.0:1789403592.301806:0:22790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 2 00000100:00100000:2.0:1789403592.301815:0:22790:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a144180a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:64a26033-a2bf-42a8-98b4-c36979dfd570+9:18679:x1876325038188672:12345-192.168.203.43@tcp:35:lfs.0 00000100:00100000:2.0:1789403592.302186:0:22790:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a144180a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:64a26033-a2bf-42a8-98b4-c36979dfd570+10:18679:x1876325038188672:12345-192.168.203.43@tcp:35:lfs.0 Request processed in 371us (602us total) trans 12884901893 rc 0/0 00000100:00100000:2.0:1789403592.302195:0:22790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 2 00000100:00100000:1.0:1789403592.306293:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:0.0:1789403592.306649:0:22786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038188928 00000100:00100000:0.0:1789403592.306658:0:22786:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038188928 00000100:00100000:0.0:1789403592.306714:0:22786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 34 00000100:00100000:0.0:1789403592.306724:0:22786:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a1443fdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:64a26033-a2bf-42a8-98b4-c36979dfd570+10:18679:x1876325038188928:12345-192.168.203.43@tcp:101:lfs.0 00010000:00010000:0.0:1789403592.306757:0:22786:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789403592.306779:0:22786:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a2821e8200/0x5fb08b1e5b762ba8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1acb85b3eb128dc7 expref: -99 pid: 22786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403592.307022:0:22786:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a2821e9c00/0x5fb08b1e5b762baf lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 22786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403592.307036:0:22786:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a2821e9c00/0x5fb08b1e5b762baf lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403592.307048:0:22786:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a2821e9c00/0x5fb08b1e5b762baf lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403592.307058:0:22786:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a2821e8e00/0x5fb08b1e5b762bb6 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 22786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403592.307064:0:22786:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a2821e8e00/0x5fb08b1e5b762bb6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403592.307071:0:22786:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a2821e8e00/0x5fb08b1e5b762bb6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22786 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00020000:0.0:1789403592.307170:0:22786:0:(mdt_open.c:1779:mdt_reint_open()) 2 open_flags 2207613255681 00000004:00200000:0.0:1789403592.307175:0:22786:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 4096 00010000:00010000:0.0:1789403592.307256:0:22786:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a2821e9c00/0x5fb08b1e5b762baf lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403592.307263:0:22786:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a2821e9c00/0x5fb08b1e5b762baf lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 22786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403592.307269:0:22786:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90a2821e9c00/0x5fb08b1e5b762baf lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403592.307274:0:22786:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a2821e9c00 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:0.0:1789403592.307278:0:22786:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a2821e9c00/0x5fb08b1e5b762baf lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403592.307291:0:22786:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a2821e9c00/0x5fb08b1e5b762baf lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 22786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403592.307302:0:22786:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90a1434a7200) 00010000:00010000:0.0:1789403592.307305:0:22786:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789403592.307309:0:22786:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90a2821e9c00/0x5fb08b1e5b762baf lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403592.307315:0:22786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a2821e9c00/0x5fb08b1e5b762baf lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403592.307327:0:22786:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a2821e8e00/0x5fb08b1e5b762bb6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403592.307331:0:22786:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a2821e8e00/0x5fb08b1e5b762bb6 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 22786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403592.307336:0:22786:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90a2821e8e00/0x5fb08b1e5b762bb6 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 22786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403592.307341:0:22786:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a2821e8e00 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:0.0:1789403592.307343:0:22786:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a2821e8e00/0x5fb08b1e5b762bb6 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 22786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403592.307347:0:22786:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a2821e8e00/0x5fb08b1e5b762bb6 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 22786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403592.307353:0:22786:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa6028a67 (ffff90a142629800) 00010000:00010000:0.0:1789403592.307355:0:22786:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789403592.307357:0:22786:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90a2821e8e00/0x5fb08b1e5b762bb6 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 22786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403592.307370:0:22786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a2821e8e00/0x5fb08b1e5b762bb6 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 22786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403592.307614:0:22786:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90a2821e8200/0x5fb08b1e5b762ba8 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb128dc7 expref: 12 pid: 22786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403592.307624:0:22786:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90a1434a7200) 00010000:00010000:0.0:1789403592.307626:0:22786:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1789403592.307630:0:22786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a2821e8200/0x5fb08b1e5b762ba8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb128dc7 expref: 12 pid: 22786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403592.307639:0:22786:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a2821e8200, rc 0) 00000100:00100000:0.0:1789403592.307706:0:22786:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a1443fdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:64a26033-a2bf-42a8-98b4-c36979dfd570+11:18679:x1876325038188928:12345-192.168.203.43@tcp:101:lfs.0 Request processed in 983us (1422us total) trans 12884901894 rc 301/301 00000100:00100000:0.0:1789403592.307714:0:22786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 34 00000100:00100000:3.0:1789403592.311381:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:2.0:1789403592.311697:0:22787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038189056 00000100:00100000:2.0:1789403592.311707:0:22787:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038189056 00000100:00100000:2.0:1789403592.311775:0:22787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 35 00000100:00100000:2.0:1789403592.311786:0:22787:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a14251d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:64a26033-a2bf-42a8-98b4-c36979dfd570+11:18679:x1876325038189056:12345-192.168.203.43@tcp:101:lfs.0 00010000:00010000:2.0:1789403592.311809:0:22787:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789403592.311829:0:22787:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a270184600/0x5fb08b1e5b762bc4 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1acb85b3eb128dce expref: -99 pid: 22787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403592.311976:0:22787:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a270185e00/0x5fb08b1e5b762bcb lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 22787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403592.311990:0:22787:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a270185e00/0x5fb08b1e5b762bcb lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403592.312001:0:22787:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a270185e00/0x5fb08b1e5b762bcb lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22787 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789403592.312028:0:22787:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1789403592.312032:0:22787:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1789403592.312050:0:22787:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90a270185e00/0x5fb08b1e5b762bcb lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403592.312076:0:22787:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a270184600/0x5fb08b1e5b762bc4 lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb128dce expref: 13 pid: 22787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403592.312094:0:22787:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90a270185e00/0x5fb08b1e5b762bcb lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb128dce expref: 12 pid: 22787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403592.312102:0:22787:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff90a142629000) 00010000:00010000:2.0:1789403592.312104:0:22787:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789403592.312108:0:22787:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a270185e00, rc 0) 00000100:00100000:2.0:1789403592.312159:0:22787:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a14251d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:64a26033-a2bf-42a8-98b4-c36979dfd570+12:18679:x1876325038189056:12345-192.168.203.43@tcp:101:lfs.0 Request processed in 375us (790us total) trans 0 rc 0/0 00000100:00100000:2.0:1789403592.312167:0:22787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 35 00000100:00100000:1.0:1789403592.319634:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:0.0:1789403592.319803:0:22789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038189184 00000100:00100000:0.0:1789403592.319813:0:22789:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038189184 00000100:00100000:0.0:1789403592.319877:0:22789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 3 00000100:00100000:0.0:1789403592.319888:0:22789:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a1443fea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:64a26033-a2bf-42a8-98b4-c36979dfd570+12:18679:x1876325038189184:12345-192.168.203.43@tcp:37:lfs.0 00000100:00100000:0.0:1789403592.325749:0:22789:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a1443fea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:64a26033-a2bf-42a8-98b4-c36979dfd570+12:18679:x1876325038189184:12345-192.168.203.43@tcp:37:lfs.0 Request processed in 5842us (6104us total) trans 0 rc 0/0 00000100:00100000:0.0:1789403592.325764:0:22789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 3 00000100:00100000:3.0:1789403592.331577:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:1.0:1789403592.332053:0:22790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038189440 00000100:00100000:1.0:1789403592.332069:0:22790:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038189440 00000100:00100000:1.0:1789403592.332151:0:22790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 4 00000100:00100000:1.0:1789403592.332163:0:22790:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a281baf050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:64a26033-a2bf-42a8-98b4-c36979dfd570+12:18679:x1876325038189440:12345-192.168.203.43@tcp:35:lfs.0 00000100:00100000:1.0:1789403592.332465:0:22790:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a281baf050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:64a26033-a2bf-42a8-98b4-c36979dfd570+13:18679:x1876325038189440:12345-192.168.203.43@tcp:35:lfs.0 Request processed in 298us (892us total) trans 12884901895 rc 0/0 00000100:00100000:1.0:1789403592.332473:0:22790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 4 00000100:00100000:1.0:1789403592.397582:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:3.0:1789403592.399698:0:22778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038189568 00000100:00100000:3.0:1789403592.399714:0:22778:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038189568 00000100:00100000:3.0:1789403592.399799:0:22778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 147 00000100:00100000:3.0:1789403592.399810:0:22778:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a24344e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:126a363a-19e5-4afb-856a-0efed33190d2+11:18048:x1876325038189568:12345-192.168.203.43@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789403592.399828:0:22778:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789403592.399848:0:22778:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90a259946e00/0x5fb08b1e5b762bd2 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x1acb85b3eb128dd5 expref: -99 pid: 22778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403592.399877:0:22778:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90a259946e00/0x5fb08b1e5b762bd2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb128dd5 expref: 12 pid: 22778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403592.399888:0:22778:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90a259946e00/0x5fb08b1e5b762bd2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb128dd5 expref: 12 pid: 22778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403592.399897:0:22778:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a259946e00, rc 0) 00000100:00100000:3.0:1789403592.401580:0:22778:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a24344e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:126a363a-19e5-4afb-856a-0efed33190d2+12:18048:x1876325038189568:12345-192.168.203.43@tcp:101:ll_cfg_requeue.0 Request processed in 1760us (3998us total) trans 0 rc 0/0 00000100:00100000:3.0:1789403592.401593:0:22778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 147 00000100:00100000:3.0:1789403592.410715:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:0.0:1789403592.411055:0:22781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038189696 00000100:00100000:0.0:1789403592.411067:0:22781:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038189696 00000100:00100000:0.0:1789403592.411132:0:22781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 148 00000100:00100000:0.0:1789403592.411143:0:22781:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a24344f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:126a363a-19e5-4afb-856a-0efed33190d2+12:18048:x1876325038189696:12345-192.168.203.43@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789403592.411307:0:22781:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a24344f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:126a363a-19e5-4afb-856a-0efed33190d2+12:18048:x1876325038189696:12345-192.168.203.43@tcp:501:ll_cfg_requeue.0 Request processed in 165us (600us total) trans 0 rc 0/0 00000100:00100000:0.0:1789403592.411316:0:22781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 148 00000100:00100000:0.0:1789403592.413240:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:3.0:1789403592.413328:0:22788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038189824 00000100:00100000:3.0:1789403592.413337:0:22788:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038189824 00000100:00100000:3.0:1789403592.413422:0:22788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 36 00000100:00100000:3.0:1789403592.413433:0:22788:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a144180a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5aa3c32d-0021-4831-930f-6e88a8b78157+11:18685:x1876325038189824:12345-192.168.203.43@tcp:101:bash.0 00010000:00010000:3.0:1789403592.413451:0:22788:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789403592.413471:0:22788:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a259947400/0x5fb08b1e5b762bd9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1acb85b3eb128ddc expref: -99 pid: 22788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403592.413547:0:22788:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a259947800/0x5fb08b1e5b762be0 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 22788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403592.413561:0:22788:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a259947800/0x5fb08b1e5b762be0 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403592.413573:0:22788:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a259947800/0x5fb08b1e5b762be0 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403592.413589:0:22788:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a259946600/0x5fb08b1e5b762be7 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 22788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403592.413606:0:22788:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a259946600/0x5fb08b1e5b762be7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403592.413613:0:22788:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a259946600/0x5fb08b1e5b762be7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403592.413693:0:22788:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a259947000/0x5fb08b1e5b762bee lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 22788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403592.413702:0:22788:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a259947000/0x5fb08b1e5b762bee lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403592.413710:0:22788:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a259947000/0x5fb08b1e5b762bee lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22788 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789403592.413752:0:22788:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1789403592.413757:0:22788:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1789403592.413796:0:22788:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90a259947000/0x5fb08b1e5b762bee lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403592.413819:0:22788:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a259947800/0x5fb08b1e5b762be0 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403592.413826:0:22788:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a259947800/0x5fb08b1e5b762be0 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 22788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403592.413833:0:22788:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90a259947800/0x5fb08b1e5b762be0 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403592.413840:0:22788:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a259947800 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:3.0:1789403592.413845:0:22788:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a259947800/0x5fb08b1e5b762be0 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403592.413853:0:22788:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a259947800/0x5fb08b1e5b762be0 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 22788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403592.413866:0:22788:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90a1434a7200) 00010000:00010000:3.0:1789403592.413869:0:22788:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789403592.413873:0:22788:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90a259947800/0x5fb08b1e5b762be0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403592.413878:0:22788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a259947800/0x5fb08b1e5b762be0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403592.413891:0:22788:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a259946600/0x5fb08b1e5b762be7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403592.413898:0:22788:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a259946600/0x5fb08b1e5b762be7 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 22788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403592.413904:0:22788:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90a259946600/0x5fb08b1e5b762be7 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 22788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403592.413916:0:22788:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a259946600 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:3.0:1789403592.413920:0:22788:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a259946600/0x5fb08b1e5b762be7 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 22788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403592.413937:0:22788:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a259946600/0x5fb08b1e5b762be7 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 22788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403592.413948:0:22788:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa6028a67 (ffff90a142629800) 00010000:00010000:3.0:1789403592.413950:0:22788:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789403592.413953:0:22788:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90a259946600/0x5fb08b1e5b762be7 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 22788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403592.413959:0:22788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a259946600/0x5fb08b1e5b762be7 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 22788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403592.413986:0:22788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a259947400/0x5fb08b1e5b762bd9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb128ddc expref: 13 pid: 22788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403592.414000:0:22788:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90a259947000/0x5fb08b1e5b762bee lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb128ddc expref: 12 pid: 22788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403592.414008:0:22788:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff90a142629000) 00010000:00010000:3.0:1789403592.414010:0:22788:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1789403592.414012:0:22788:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a259947000, rc 0) 00000100:00100000:3.0:1789403592.414067:0:22788:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a144180a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5aa3c32d-0021-4831-930f-6e88a8b78157+12:18685:x1876325038189824:12345-192.168.203.43@tcp:101:bash.0 Request processed in 636us (833us total) trans 0 rc 0/0 00000100:00100000:3.0:1789403592.414076:0:22788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 36 00000100:00100000:1.0:1789403592.416952:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:3.0:1789403592.417083:0:22797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038189952 00000100:00100000:3.0:1789403592.417100:0:22797:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038189952 00000100:00100000:3.0:1789403592.417160:0:22797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 7 00000100:00100000:3.0:1789403592.417171:0:22797:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a1443fea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:5aa3c32d-0021-4831-930f-6e88a8b78157+5:18685:x1876325038189952:12345-192.168.203.43@tcp:900:bash.0 00000100:00100000:3.0:1789403592.417255:0:22797:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a1443fea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:5aa3c32d-0021-4831-930f-6e88a8b78157+5:18685:x1876325038189952:12345-192.168.203.43@tcp:900:bash.0 Request processed in 86us (312us total) trans 0 rc 0/0 00000100:00100000:3.0:1789403592.417263:0:22797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 7 00000100:00100000:1.0:1789403592.419567:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:3.0:1789403592.419649:0:22778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038190080 00000100:00100000:3.0:1789403592.419659:0:22778:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038190080 00000100:00100000:3.0:1789403592.419710:0:22778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 149 00000100:00100000:3.0:1789403592.419720:0:22778:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a24344ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:126a363a-19e5-4afb-856a-0efed33190d2+12:18048:x1876325038190080:12345-192.168.203.43@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789403592.419871:0:22778:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a24344ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:126a363a-19e5-4afb-856a-0efed33190d2+12:18048:x1876325038190080:12345-192.168.203.43@tcp:503:ll_cfg_requeue.0 Request processed in 152us (312us total) trans 0 rc 0/0 00000100:00100000:3.0:1789403592.419879:0:22778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 149 00000100:00100000:1.0:1789403592.423130:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:2.0:1789403592.423221:0:22787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038190336 00000100:00100000:2.0:1789403592.423231:0:22787:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038190336 00000100:00100000:2.0:1789403592.423305:0:22787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 37 00000100:00100000:2.0:1789403592.423315:0:22787:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a1443fdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5aa3c32d-0021-4831-930f-6e88a8b78157+12:18685:x1876325038190336:12345-192.168.203.43@tcp:101:bash.0 00010000:00010000:2.0:1789403592.423334:0:22787:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789403592.423352:0:22787:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a270184600/0x5fb08b1e5b762bf5 lrc: 2/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1acb85b3eb128de3 expref: -99 pid: 22787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403592.423491:0:22787:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90a270185000/0x5fb08b1e5b762bfc lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 22787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403592.423506:0:22787:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90a270185e00/0x5fb08b1e5b762bcb lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb128dce expref: 12 pid: 22787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403592.423515:0:22787:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a270185000/0x5fb08b1e5b762bfc lrc: 4/0,1 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 22787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403592.423547:0:22787:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90a270185e00/0x5fb08b1e5b762bcb lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb128dce expref: 12 pid: 22787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403592.423560:0:22787:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90a270185e00/0x5fb08b1e5b762bcb lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb128dce expref: 12 pid: 22787 timeout: 738 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789403592.423574:0:22787:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a142501c00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:22787:1876325050871296:192.168.203.43@tcp:104: 00000100:00100000:2.0:1789403592.423657:0:22787:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a25ecdf600 going to sleep for 11 seconds 00000100:00100000:1.0:1789403592.427059:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:3.0:1789403592.427150:0:22772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038190464 00000100:00100000:3.0:1789403592.427159:0:22772:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038190464 00010000:00010000:3.0:1789403592.427197:0:22772:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a270185e00/0x5fb08b1e5b762bcb lrc: 5/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb128dce expref: 13 pid: 22787 timeout: 738 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789403592.427239:0:22772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 16 00000100:00100000:3.0:1789403592.427249:0:22772:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a1443fc380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:64a26033-a2bf-42a8-98b4-c36979dfd570+13:2390:x1876325038190464:12345-192.168.203.43@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789403592.427265:0:22772:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789403592.427272:0:22772:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90a270185e00/0x5fb08b1e5b762bcb lrc: 5/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb128dce expref: 13 pid: 22787 timeout: 738 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403592.427285:0:22772:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90a270185e00/0x5fb08b1e5b762bcb lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb128dce expref: 13 pid: 22787 timeout: 738 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403592.427325:0:22772:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff90a142629000) 00010000:00010000:3.0:1789403592.427331:0:22772:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff90a270185000/0x5fb08b1e5b762bfc lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 22787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403592.427342:0:22772:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90a270185000/0x5fb08b1e5b762bfc lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50290000000000 pid: 22787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403592.427350:0:22772:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a270185000/0x5fb08b1e5b762bfc lrc: 4/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50290000000000 pid: 22787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403592.427369:0:22772:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789403592.427447:0:22772:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a1443fc380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:64a26033-a2bf-42a8-98b4-c36979dfd570+13:2390:x1876325038190464:12345-192.168.203.43@tcp:103:ldlm_bl.0 Request processed in 199us (396us total) trans 0 rc 0/0 00000100:00100000:3.0:1789403592.427466:0:22772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 16 00010000:00010000:2.0:1789403592.428036:0:22787:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a270185e00/0x5fb08b1e5b762bcb lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb128dce expref: 12 pid: 22787 timeout: 738 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789403592.428056:0:22787:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a142501c00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:22787:1876325050871296:192.168.203.43@tcp:104: 00010000:00010000:2.0:1789403592.428076:0:22787:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90a270185000/0x5fb08b1e5b762bfc lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 22787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403592.428095:0:22787:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90a270185000/0x5fb08b1e5b762bfc lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 22787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403592.428101:0:22787:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a270185000/0x5fb08b1e5b762bfc lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 22787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403592.428170:0:22787:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90a270185800/0x5fb08b1e5b762c03 lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 22787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403592.428181:0:22787:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a270185800/0x5fb08b1e5b762c03 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403592.428190:0:22787:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a270185800/0x5fb08b1e5b762c03 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403592.428822:0:22787:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a270185a00/0x5fb08b1e5b762c0a lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 22787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403592.428834:0:22787:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a270185a00/0x5fb08b1e5b762c0a lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403592.428844:0:22787:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a270185a00/0x5fb08b1e5b762c0a lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22787 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00020000:2.0:1789403592.428851:0:22787:0:(mdt_open.c:1779:mdt_reint_open()) 2 open_flags 2749852811842 00000004:00200000:2.0:1789403592.428858:0:22787:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00000004:00020000:2.0:1789403592.428865:0:22787:0:(mdt_open.c:646:mdt_finish_open()) 4 open_flags 2749852811842 00000100:00100000:3.0:1789403592.434123:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:0.0:1789403592.434200:0:22780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038190592 00000100:00100000:0.0:1789403592.434210:0:22780:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038190592 00000100:00100000:0.0:1789403592.434265:0:22780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 150 00000100:00100000:0.0:1789403592.434275:0:22780:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a24344d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:126a363a-19e5-4afb-856a-0efed33190d2+12:18048:x1876325038190592:12345-192.168.203.43@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789403592.434291:0:22780:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789403592.434308:0:22780:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90a2821e8e00/0x5fb08b1e5b762c11 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x1acb85b3eb128dea expref: -99 pid: 22780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403592.434336:0:22780:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90a2821e8e00/0x5fb08b1e5b762c11 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb128dea expref: 13 pid: 22780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403592.434347:0:22780:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90a2821e8e00/0x5fb08b1e5b762c11 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb128dea expref: 13 pid: 22780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403592.434356:0:22780:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a2821e8e00, rc 0) 00000100:00100000:0.0:1789403592.434437:0:22780:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a24344d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:126a363a-19e5-4afb-856a-0efed33190d2+13:18048:x1876325038190592:12345-192.168.203.43@tcp:101:ll_cfg_requeue.0 Request processed in 162us (322us total) trans 0 rc 0/0 00000100:00100000:0.0:1789403592.434456:0:22780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 150 00000100:00100000:1.0:1789403592.437336:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:0.0:1789403592.437420:0:22781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038190720 00000100:00100000:0.0:1789403592.437430:0:22781:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038190720 00000100:00100000:0.0:1789403592.437537:0:22781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 151 00000100:00100000:0.0:1789403592.437548:0:22781:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a242b64450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:126a363a-19e5-4afb-856a-0efed33190d2+13:18048:x1876325038190720:12345-192.168.203.43@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789403592.437726:0:22781:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a242b64450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:126a363a-19e5-4afb-856a-0efed33190d2+13:18048:x1876325038190720:12345-192.168.203.43@tcp:501:ll_cfg_requeue.0 Request processed in 179us (397us total) trans 0 rc 0/0 00000100:00100000:0.0:1789403592.437733:0:22781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 151 00010000:00010000:2.0:1789403592.448905:0:22787:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90a270185000/0x5fb08b1e5b762bfc lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 22787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403592.448921:0:22787:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a270185000/0x5fb08b1e5b762bfc lrc: 2/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 22787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403592.448947:0:22787:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90a270185000/0x5fb08b1e5b762bfc lrc: 3/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 22787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403592.448953:0:22787:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a270185000 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:2.0:1789403592.448957:0:22787:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a270185000/0x5fb08b1e5b762bfc lrc: 3/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 22787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403592.448966:0:22787:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a270185000/0x5fb08b1e5b762bfc lrc: 4/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 22787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403592.448979:0:22787:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff90a142629000) 00010000:00010000:2.0:1789403592.448983:0:22787:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789403592.448988:0:22787:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90a270185000/0x5fb08b1e5b762bfc lrc: 2/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 22787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403592.448994:0:22787:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a270185000/0x5fb08b1e5b762bfc lrc: 0/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 22787 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789403592.449012:0:22787:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000003740d349 reply state 00000000aebbd9f8 transno 12884901896 ns: mdt-lustre-MDT0000_UUID lock: ffff90a270185800/0x5fb08b1e5b762c03 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403592.449024:0:22787:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a270185800/0x5fb08b1e5b762c03 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403592.449031:0:22787:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0xb42112bc (ffff90a142163300) 00010000:00010000:2.0:1789403592.449034:0:22787:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1789403592.449037:0:22787:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1789403592.449085:0:22787:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a270184600/0x5fb08b1e5b762bf5 lrc: 0/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb128de3 expref: 15 pid: 22787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403592.449101:0:22787:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90a270185a00/0x5fb08b1e5b762c0a lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb128de3 expref: 14 pid: 22787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403592.449116:0:22787:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff90a142163600) 00010000:00010000:2.0:1789403592.449118:0:22787:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 9 00010000:00010000:2.0:1789403592.449120:0:22787:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a270185a00, rc 0) 00000100:00100000:2.0:1789403592.449189:0:22787:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a1443fdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5aa3c32d-0021-4831-930f-6e88a8b78157+15:18685:x1876325038190336:12345-192.168.203.43@tcp:101:bash.0 Request processed in 25875us (26068us total) trans 12884901896 rc 0/0 00000100:00100000:2.0:1789403592.449198:0:22787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 37 00010000:00010000:1.0:1789403592.449567:0:25221:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789403592.455218:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:3.0:1789403592.455282:0:22778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038190848 00000100:00100000:3.0:1789403592.455291:0:22778:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038190848 00000100:00100000:3.0:1789403592.455342:0:22778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 152 00000100:00100000:3.0:1789403592.455350:0:22778:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a276a74450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:126a363a-19e5-4afb-856a-0efed33190d2+13:18048:x1876325038190848:12345-192.168.203.43@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789403592.455532:0:22778:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a276a74450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:126a363a-19e5-4afb-856a-0efed33190d2+13:18048:x1876325038190848:12345-192.168.203.43@tcp:503:ll_cfg_requeue.0 Request processed in 181us (321us total) trans 0 rc 0/0 00000100:00100000:3.0:1789403592.455539:0:22778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 152 00000100:00100000:1.0:1789403592.496285:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:3.0:1789403592.496374:0:22788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038190976 00000100:00100000:3.0:1789403592.496384:0:22788:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038190976 00000100:00100000:3.0:1789403592.496473:0:22788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 38 00000100:00100000:3.0:1789403592.496484:0:22788:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a1443fc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5aa3c32d-0021-4831-930f-6e88a8b78157+15:18685:x1876325038190976:12345-192.168.203.43@tcp:101:bash.0 00010000:00010000:3.0:1789403592.496524:0:22788:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789403592.496545:0:22788:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a259947400/0x5fb08b1e5b762c1f lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1acb85b3eb128df1 expref: -99 pid: 22788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403592.496613:0:22788:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a259946600/0x5fb08b1e5b762c26 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 22788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403592.496628:0:22788:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a259946600/0x5fb08b1e5b762c26 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403592.496640:0:22788:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a259946600/0x5fb08b1e5b762c26 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22788 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789403592.496685:0:22788:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00000004:00200000:3.0:1789403592.496689:0:22788:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1789403592.496707:0:22788:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90a259946600/0x5fb08b1e5b762c26 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403592.496718:0:22788:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a259946600/0x5fb08b1e5b762c26 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403592.496754:0:22788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a259947400/0x5fb08b1e5b762c1f lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb128df1 expref: 17 pid: 22788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403592.496775:0:22788:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90a259946600/0x5fb08b1e5b762c26 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb128df1 expref: 16 pid: 22788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403592.496784:0:22788:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff90a142163600) 00010000:00010000:3.0:1789403592.496787:0:22788:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789403592.496792:0:22788:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a259946600, rc 0) 00000100:00100000:3.0:1789403592.496861:0:22788:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a1443fc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5aa3c32d-0021-4831-930f-6e88a8b78157+16:18685:x1876325038190976:12345-192.168.203.43@tcp:101:bash.0 Request processed in 379us (585us total) trans 0 rc 0/0 00000100:00100000:3.0:1789403592.496869:0:22788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 38 10000000:01000000:0.0:1789403592.498457:0:22783:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1789403592.498464:0:22783:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff90a276eb8800 from 13 10000000:01000000:0.0:1789403592.498470:0:22783:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1789403592.498527:0:22783:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.143@tcp lock: ffff90a2821e9c00/0x5fb08b1e5b762c2d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403592.498539:0:22783:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.143@tcp lock: ffff90a2821e9c00/0x5fb08b1e5b762c2d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403592.498549:0:22783:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.143@tcp lock: ffff90a2821e9c00/0x5fb08b1e5b762c2d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789403592.498573:0:22783:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a144049880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7ccb4038-daf9-4dcd-9b85-da9390181204:22783:1876325050871424:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1789403592.498633:0:22783:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789403592.498675:0:22783:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a25278d000 going to sleep for 11 seconds 00000100:00100000:3.0:1789403592.499151:0:22781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050871424 00000100:00100000:3.0:1789403592.499160:0:22781:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050871424 00000100:00100000:3.0:1789403592.499222:0:22781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:3.0:1789403592.499231:0:22781:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a276a75850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7ccb4038-daf9-4dcd-9b85-da9390181204+20:22783:x1876325050871424:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789403592.499244:0:22781:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789403592.499257:0:22781:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90a259947800/0x5fb08b1e5b762c34 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x5fb08b1e5b762c2d expref: -99 pid: 22781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403592.499279:0:22781:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90a259947800/0x5fb08b1e5b762c34 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5fb08b1e5b762c2d expref: 21 pid: 22781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403592.499289:0:22781:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90a259947800/0x5fb08b1e5b762c34 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5fb08b1e5b762c2d expref: 21 pid: 22781 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403592.499297:0:22781:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a259947800, rc 0) 00000100:00100000:3.0:1789403592.499424:0:22781:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a276a75850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7ccb4038-daf9-4dcd-9b85-da9390181204+21:22783:x1876325050871424:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 193us (789us total) trans 0 rc 0/0 00000100:00100000:3.0:1789403592.499431:0:22781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:2.0:1789403592.500647:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:3.0:1789403592.500719:0:22790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038191232 00000100:00100000:3.0:1789403592.500728:0:22790:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038191232 00000100:00100000:3.0:1789403592.500787:0:22790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 5 00000100:00100000:3.0:1789403592.500796:0:22790:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a142501c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5aa3c32d-0021-4831-930f-6e88a8b78157+16:18685:x1876325038191232:12345-192.168.203.43@tcp:35:bash.0 00000100:00100000:3.0:1789403592.501108:0:22790:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a142501c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5aa3c32d-0021-4831-930f-6e88a8b78157+17:18685:x1876325038191232:12345-192.168.203.43@tcp:35:bash.0 Request processed in 313us (468us total) trans 12884901897 rc 0/0 00000100:00100000:3.0:1789403592.501116:0:22790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 5 00000100:00100000:1.0:1789403592.501330:0:22783:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a144049880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7ccb4038-daf9-4dcd-9b85-da9390181204:22783:1876325050871424:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789403592.501350:0:22783:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.143@tcp lock: ffff90a2821e9c00/0x5fb08b1e5b762c2d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb08b1e5b762c34 expref: -99 pid: 22783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403592.501362:0:22783:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.143@tcp lock: ffff90a2821e9c00/0x5fb08b1e5b762c2d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x5fb08b1e5b762c34 expref: -99 pid: 22783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789403592.501488:0:22783:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a1443ffb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7ccb4038-daf9-4dcd-9b85-da9390181204:22783:1876325050871552:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789403592.501526:0:22783:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789403592.501554:0:22783:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a26d155900 going to sleep for 11 seconds 00000100:00100000:0.0:1789403592.501676:0:22780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050871552 00000100:00100000:0.0:1789403592.501681:0:22780:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050871552 00000100:00100000:0.0:1789403592.501713:0:22780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:0.0:1789403592.501720:0:22780:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a276a76450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7ccb4038-daf9-4dcd-9b85-da9390181204+21:22783:x1876325050871552:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789403592.501834:0:22780:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a276a76450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7ccb4038-daf9-4dcd-9b85-da9390181204+21:22783:x1876325050871552:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 114us (306us total) trans 0 rc 0/0 00000100:00100000:0.0:1789403592.501841:0:22780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:1.0:1789403592.502101:0:22783:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a1443ffb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7ccb4038-daf9-4dcd-9b85-da9390181204:22783:1876325050871552:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789403592.502134:0:22783:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a1443ffb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7ccb4038-daf9-4dcd-9b85-da9390181204:22783:1876325050871680:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789403592.502177:0:22783:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789403592.502210:0:22783:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a26d155900 going to sleep for 11 seconds 00000100:00100000:0.0:1789403592.502263:0:22778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050871680 00000100:00100000:0.0:1789403592.502268:0:22778:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050871680 00000100:00100000:0.0:1789403592.502299:0:22778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:0.0:1789403592.502314:0:22778:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a276a74050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7ccb4038-daf9-4dcd-9b85-da9390181204+21:22783:x1876325050871680:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789403592.502435:0:22778:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a276a74050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7ccb4038-daf9-4dcd-9b85-da9390181204+21:22783:x1876325050871680:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 121us (257us total) trans 0 rc 0/0 00000100:00100000:0.0:1789403592.502442:0:22778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:1.0:1789403592.502713:0:22783:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a1443ffb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7ccb4038-daf9-4dcd-9b85-da9390181204:22783:1876325050871680:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1789403592.503785:0:25828:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:3.0:1789403592.504055:0:22783:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:3.0:1789403592.504077:0:22783:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.143@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1789403592.504087:0:22783:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.143@tcp lock: ffff90a2821e9c00/0x5fb08b1e5b762c2d lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb08b1e5b762c34 expref: -99 pid: 22783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403592.504098:0:22783:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.143@tcp lock: ffff90a2821e9c00/0x5fb08b1e5b762c2d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb08b1e5b762c34 expref: -99 pid: 22783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789403592.504107:0:22783:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1789403592.504110:0:22783:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff90a2669be000 from 13 10000000:01000000:3.0:1789403592.504112:0:22783:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1789403592.504146:0:22783:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.143@tcp lock: ffff90a259946000/0x5fb08b1e5b762c3b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403592.504154:0:22783:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.143@tcp lock: ffff90a259946000/0x5fb08b1e5b762c3b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403592.504164:0:22783:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.143@tcp lock: ffff90a259946000/0x5fb08b1e5b762c3b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789403592.504187:0:22783:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a14251ed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7ccb4038-daf9-4dcd-9b85-da9390181204:22783:1876325050871808:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1789403592.504235:0:22783:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789403592.504266:0:22783:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a281bb6300 going to sleep for 11 seconds 00000100:00100000:0.0:1789403592.504341:0:22778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050871808 00000100:00100000:0.0:1789403592.504348:0:22778:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050871808 00000100:00100000:0.0:1789403592.504411:0:22778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:0.0:1789403592.504420:0:22778:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a276a76050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7ccb4038-daf9-4dcd-9b85-da9390181204+21:22783:x1876325050871808:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789403592.504431:0:22778:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789403592.504443:0:22778:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90a2821e9000/0x5fb08b1e5b762c42 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x5fb08b1e5b762c3b expref: -99 pid: 22778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403592.504477:0:22778:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90a2821e9000/0x5fb08b1e5b762c42 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5fb08b1e5b762c3b expref: 22 pid: 22778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403592.504486:0:22778:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90a2821e9000/0x5fb08b1e5b762c42 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5fb08b1e5b762c3b expref: 22 pid: 22778 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403592.504495:0:22778:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a2821e9000, rc 0) 00000100:00100000:0.0:1789403592.504537:0:22778:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a276a76050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7ccb4038-daf9-4dcd-9b85-da9390181204+22:22783:x1876325050871808:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 118us (301us total) trans 0 rc 0/0 00000100:00100000:0.0:1789403592.504544:0:22778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:1.0:1789403592.504879:0:22783:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a14251ed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7ccb4038-daf9-4dcd-9b85-da9390181204:22783:1876325050871808:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789403592.504894:0:22783:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.143@tcp lock: ffff90a259946000/0x5fb08b1e5b762c3b lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb08b1e5b762c42 expref: -99 pid: 22783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403592.504914:0:22783:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.143@tcp lock: ffff90a259946000/0x5fb08b1e5b762c3b lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x5fb08b1e5b762c42 expref: -99 pid: 22783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789403592.505077:0:22783:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a1443ffb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7ccb4038-daf9-4dcd-9b85-da9390181204:22783:1876325050871936:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789403592.505107:0:22783:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789403592.505231:0:22783:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a26d155900 going to sleep for 11 seconds 00000100:00100000:0.0:1789403592.508763:0:22780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050871936 00000100:00100000:0.0:1789403592.508780:0:22780:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050871936 00000100:00100000:0.0:1789403592.508888:0:22780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:0.0:1789403592.508900:0:22780:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a276a77c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7ccb4038-daf9-4dcd-9b85-da9390181204+22:22783:x1876325050871936:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789403592.509079:0:22780:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a276a77c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7ccb4038-daf9-4dcd-9b85-da9390181204+22:22783:x1876325050871936:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 182us (3970us total) trans 0 rc 0/0 00000100:00100000:0.0:1789403592.509100:0:22780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:1.0:1789403592.509184:0:22783:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a1443ffb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7ccb4038-daf9-4dcd-9b85-da9390181204:22783:1876325050871936:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789403592.509242:0:22783:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a1443ffb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7ccb4038-daf9-4dcd-9b85-da9390181204:22783:1876325050872064:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789403592.509294:0:22783:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789403592.509611:0:22783:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a26d155900 going to sleep for 11 seconds 00000100:00100000:2.0:1789403592.509855:0:22778:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050872064 00000100:00100000:2.0:1789403592.509862:0:22778:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050872064 00000100:00100000:2.0:1789403592.509896:0:22778:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:2.0:1789403592.509904:0:22778:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a276a76850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7ccb4038-daf9-4dcd-9b85-da9390181204+22:22783:x1876325050872064:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789403592.510255:0:22778:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a276a76850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:7ccb4038-daf9-4dcd-9b85-da9390181204+22:22783:x1876325050872064:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 350us (959us total) trans 0 rc 0/0 00000100:00100000:2.0:1789403592.510263:0:22778:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:1.0:1789403592.510365:0:22783:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a1443ffb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7ccb4038-daf9-4dcd-9b85-da9390181204:22783:1876325050872064:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1789403592.514132:0:25829:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:2.0:1789403592.514316:0:22783:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:2.0:1789403592.514338:0:22783:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.143@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1789403592.514349:0:22783:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.143@tcp lock: ffff90a259946000/0x5fb08b1e5b762c3b lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb08b1e5b762c42 expref: -99 pid: 22783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403592.514361:0:22783:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.143@tcp lock: ffff90a259946000/0x5fb08b1e5b762c3b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb08b1e5b762c42 expref: -99 pid: 22783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789403592.514372:0:22783:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1789403592.514374:0:22783:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff90a144165800 from 13 10000000:01000000:2.0:1789403592.514377:0:22783:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1789403592.514443:0:22783:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.143@tcp lock: ffff90a270185000/0x5fb08b1e5b762c49 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403592.514474:0:22783:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.143@tcp lock: ffff90a270185000/0x5fb08b1e5b762c49 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403592.514486:0:22783:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.143@tcp lock: ffff90a270185000/0x5fb08b1e5b762c49 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789403592.514512:0:22783:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a142500700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7ccb4038-daf9-4dcd-9b85-da9390181204:22783:1876325050872192:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1789403592.514577:0:22783:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789403592.514633:0:22783:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a274cc03c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789403592.516623:0:22780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050872192 00000100:00100000:0.0:1789403592.516639:0:22780:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050872192 00000100:00100000:0.0:1789403592.516701:0:22780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:0.0:1789403592.516711:0:22780:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a276a74c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7ccb4038-daf9-4dcd-9b85-da9390181204+22:22783:x1876325050872192:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789403592.516729:0:22780:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789403592.516756:0:22780:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90a2821e9800/0x5fb08b1e5b762c50 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x5fb08b1e5b762c49 expref: -99 pid: 22780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403592.516785:0:22780:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90a2821e9800/0x5fb08b1e5b762c50 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5fb08b1e5b762c49 expref: 23 pid: 22780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403592.516796:0:22780:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90a2821e9800/0x5fb08b1e5b762c50 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5fb08b1e5b762c49 expref: 23 pid: 22780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403592.516805:0:22780:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a2821e9800, rc 0) 00000100:00100000:0.0:1789403592.516889:0:22780:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a276a74c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7ccb4038-daf9-4dcd-9b85-da9390181204+23:22783:x1876325050872192:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 178us (2310us total) trans 0 rc 0/0 00000100:00100000:0.0:1789403592.516895:0:22780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:2.0:1789403592.517295:0:22783:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a142500700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7ccb4038-daf9-4dcd-9b85-da9390181204:22783:1876325050872192:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789403592.517315:0:22783:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.143@tcp lock: ffff90a270185000/0x5fb08b1e5b762c49 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb08b1e5b762c50 expref: -99 pid: 22783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403592.517325:0:22783:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.143@tcp lock: ffff90a270185000/0x5fb08b1e5b762c49 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x5fb08b1e5b762c50 expref: -99 pid: 22783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789403592.517425:0:22783:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a142500700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7ccb4038-daf9-4dcd-9b85-da9390181204:22783:1876325050872320:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789403592.517472:0:22783:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789403592.517514:0:22783:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a274cc03c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789403592.517671:0:22780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050872320 00000100:00100000:1.0:1789403592.517676:0:22780:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050872320 00000100:00100000:1.0:1789403592.517706:0:22780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:1.0:1789403592.517714:0:22780:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a276a75450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7ccb4038-daf9-4dcd-9b85-da9390181204+23:22783:x1876325050872320:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789403592.517849:0:22780:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a276a75450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7ccb4038-daf9-4dcd-9b85-da9390181204+23:22783:x1876325050872320:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 136us (377us total) trans 0 rc 0/0 00000100:00100000:1.0:1789403592.517856:0:22780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:1.0:1789403592.517889:0:22783:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a142500700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7ccb4038-daf9-4dcd-9b85-da9390181204:22783:1876325050872320:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789403592.517915:0:22783:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a1443ffb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7ccb4038-daf9-4dcd-9b85-da9390181204:22783:1876325050872448:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789403592.517973:0:22783:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789403592.517992:0:22783:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a245ca7780 going to sleep for 11 seconds 00000100:00100000:1.0:1789403592.518013:0:22780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050872448 00000100:00100000:1.0:1789403592.518017:0:22780:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050872448 00000100:00100000:1.0:1789403592.518034:0:22780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:1.0:1789403592.518039:0:22780:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a276a77850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7ccb4038-daf9-4dcd-9b85-da9390181204+23:22783:x1876325050872448:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789403592.518116:0:22780:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a276a77850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7ccb4038-daf9-4dcd-9b85-da9390181204+23:22783:x1876325050872448:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 75us (142us total) trans 0 rc 0/0 00000100:00100000:1.0:1789403592.518123:0:22780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:1.0:1789403592.518162:0:22783:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a1443ffb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7ccb4038-daf9-4dcd-9b85-da9390181204:22783:1876325050872448:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1789403592.518848:0:25830:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:1.0:1789403592.518901:0:22783:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:1.0:1789403592.518917:0:22783:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.143@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1789403592.518925:0:22783:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.143@tcp lock: ffff90a270185000/0x5fb08b1e5b762c49 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb08b1e5b762c50 expref: -99 pid: 22783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403592.518936:0:22783:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.143@tcp lock: ffff90a270185000/0x5fb08b1e5b762c49 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb08b1e5b762c50 expref: -99 pid: 22783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789403592.518945:0:22783:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1789403592.518947:0:22783:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff90a144559800 from 13 10000000:01000000:1.0:1789403592.518950:0:22783:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1789403592.518974:0:22783:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.143@tcp lock: ffff90a281b04600/0x5fb08b1e5b762c57 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 22783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403592.518982:0:22783:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.143@tcp lock: ffff90a281b04600/0x5fb08b1e5b762c57 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 22783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403592.518991:0:22783:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.143@tcp lock: ffff90a281b04600/0x5fb08b1e5b762c57 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 22783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789403592.519009:0:22783:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a1443ffb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7ccb4038-daf9-4dcd-9b85-da9390181204:22783:1876325050872576:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1789403592.519054:0:22783:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789403592.519079:0:22783:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a245ca70c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789403592.519098:0:22780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050872576 00000100:00100000:1.0:1789403592.519104:0:22780:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050872576 00000100:00100000:1.0:1789403592.519126:0:22780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:1.0:1789403592.519132:0:22780:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a276a75c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7ccb4038-daf9-4dcd-9b85-da9390181204+23:22783:x1876325050872576:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789403592.519142:0:22780:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789403592.519152:0:22780:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff90a281b05e00/0x5fb08b1e5b762c5e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x5fb08b1e5b762c57 expref: -99 pid: 22780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403592.519171:0:22780:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff90a281b05e00/0x5fb08b1e5b762c5e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x5fb08b1e5b762c57 expref: 24 pid: 22780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403592.519180:0:22780:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff90a281b05e00/0x5fb08b1e5b762c5e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x5fb08b1e5b762c57 expref: 24 pid: 22780 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403592.519188:0:22780:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a281b05e00, rc 0) 00000100:00100000:1.0:1789403592.519219:0:22780:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a276a75c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7ccb4038-daf9-4dcd-9b85-da9390181204+24:22783:x1876325050872576:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 86us (164us total) trans 0 rc 0/0 00000100:00100000:1.0:1789403592.519225:0:22780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00100000:1.0:1789403592.519261:0:22783:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a1443ffb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7ccb4038-daf9-4dcd-9b85-da9390181204:22783:1876325050872576:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789403592.519274:0:22783:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.143@tcp lock: ffff90a281b04600/0x5fb08b1e5b762c57 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb08b1e5b762c5e expref: -99 pid: 22783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403592.519283:0:22783:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.143@tcp lock: ffff90a281b04600/0x5fb08b1e5b762c57 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x5fb08b1e5b762c5e expref: -99 pid: 22783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789403592.519325:0:22783:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a1443ffb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7ccb4038-daf9-4dcd-9b85-da9390181204:22783:1876325050872704:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789403592.519356:0:22783:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789403592.519370:0:22783:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a245ca70c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789403592.519383:0:22780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050872704 00000100:00100000:1.0:1789403592.519413:0:22780:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050872704 00000100:00100000:1.0:1789403592.519431:0:22780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:1.0:1789403592.519437:0:22780:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a276a75050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7ccb4038-daf9-4dcd-9b85-da9390181204+24:22783:x1876325050872704:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789403592.519522:0:22780:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a276a75050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7ccb4038-daf9-4dcd-9b85-da9390181204+24:22783:x1876325050872704:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 84us (164us total) trans 0 rc 0/0 00000100:00100000:1.0:1789403592.519528:0:22780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00100000:1.0:1789403592.519555:0:22783:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a1443ffb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7ccb4038-daf9-4dcd-9b85-da9390181204:22783:1876325050872704:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789403592.519576:0:22783:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a1443ffb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7ccb4038-daf9-4dcd-9b85-da9390181204:22783:1876325050872832:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789403592.519610:0:22783:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789403592.519627:0:22783:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a245ca70c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789403592.519638:0:22780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050872832 00000100:00100000:1.0:1789403592.519641:0:22780:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050872832 00000100:00100000:1.0:1789403592.519658:0:22780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164 00000100:00100000:1.0:1789403592.519664:0:22780:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a276a77450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7ccb4038-daf9-4dcd-9b85-da9390181204+24:22783:x1876325050872832:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789403592.519731:0:22780:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a276a77450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:7ccb4038-daf9-4dcd-9b85-da9390181204+24:22783:x1876325050872832:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 67us (120us total) trans 0 rc 0/0 00000100:00100000:1.0:1789403592.519750:0:22780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164 00000100:00100000:1.0:1789403592.519790:0:22783:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a1443ffb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:7ccb4038-daf9-4dcd-9b85-da9390181204:22783:1876325050872832:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1789403592.520480:0:25831:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:1.0:1789403592.520524:0:22783:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:1.0:1789403592.520538:0:22783:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.143@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1789403592.520546:0:22783:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.143@tcp lock: ffff90a281b04600/0x5fb08b1e5b762c57 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb08b1e5b762c5e expref: -99 pid: 22783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403592.520563:0:22783:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.143@tcp lock: ffff90a281b04600/0x5fb08b1e5b762c57 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x5fb08b1e5b762c5e expref: -99 pid: 22783 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789403592.599698:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:3.0:1789403592.599791:0:25827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038191488 00000100:00100000:3.0:1789403592.599804:0:25827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038191488 00000100:00100000:3.0:1789403592.599877:0:25827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 39 00000100:00100000:3.0:1789403592.599889:0:25827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a1443ffb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5aa3c32d-0021-4831-930f-6e88a8b78157+17:18697:x1876325038191488:12345-192.168.203.43@tcp:101:lfs.0 00010000:00010000:3.0:1789403592.599931:0:25827:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789403592.599961:0:25827:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a259947400/0x5fb08b1e5b762c65 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1acb85b3eb128df8 expref: -99 pid: 25827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789403592.600136:0:25827:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x1:0x0]: returning size 4096 00010000:00010000:3.0:1789403592.600264:0:25827:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90a259947400/0x5fb08b1e5b762c65 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb128df8 expref: 19 pid: 25827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403592.600281:0:25827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff90a1434a7200) 00010000:00010000:3.0:1789403592.600284:0:25827:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1789403592.600290:0:25827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a259947400/0x5fb08b1e5b762c65 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb128df8 expref: 19 pid: 25827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403592.600306:0:25827:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a259947400, rc 0) 00000100:00100000:3.0:1789403592.600385:0:25827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a1443ffb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5aa3c32d-0021-4831-930f-6e88a8b78157+18:18697:x1876325038191488:12345-192.168.203.43@tcp:101:lfs.0 Request processed in 498us (700us total) trans 12884901898 rc 301/301 00000100:00100000:3.0:1789403592.600682:0:25827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 39 00000100:00100000:2.0:1789403592.604559:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:3.0:1789403592.604915:0:22790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038191744 00000100:00100000:3.0:1789403592.604937:0:22790:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038191744 00000100:00100000:3.0:1789403592.605003:0:22790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 6 00000100:00100000:3.0:1789403592.605016:0:22790:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a142503480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5aa3c32d-0021-4831-930f-6e88a8b78157+18:18697:x1876325038191744:12345-192.168.203.43@tcp:35:lfs.0 00000100:00100000:3.0:1789403592.605316:0:22790:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a142503480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5aa3c32d-0021-4831-930f-6e88a8b78157+19:18697:x1876325038191744:12345-192.168.203.43@tcp:35:lfs.0 Request processed in 303us (771us total) trans 12884901899 rc 0/0 00000100:00100000:3.0:1789403592.605325:0:22790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 6 00000100:00100000:0.0:1789403592.658209:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:3.0:1789403592.658945:0:22788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038192000 00000100:00100000:3.0:1789403592.658960:0:22788:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038192000 00000100:00100000:3.0:1789403592.659056:0:22788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 40 00000100:00100000:3.0:1789403592.659069:0:22788:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a144049880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5aa3c32d-0021-4831-930f-6e88a8b78157+19:18700:x1876325038192000:12345-192.168.203.43@tcp:101:lfs.0 00010000:00010000:3.0:1789403592.659103:0:22788:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789403592.659145:0:22788:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a259947400/0x5fb08b1e5b762c73 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1acb85b3eb128dff expref: -99 pid: 22788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403592.659294:0:22788:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a248af0600/0x5fb08b1e5b762c7a lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 22788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403592.659312:0:22788:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a248af0600/0x5fb08b1e5b762c7a lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403592.659328:0:22788:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a248af0600/0x5fb08b1e5b762c7a lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22788 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789403592.659342:0:22788:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00000004:00020000:3.0:1789403592.659350:0:22788:0:(mdt_open.c:646:mdt_finish_open()) 4 open_flags 2207655133185 00010000:00010000:2.0:1789403592.660080:0:22788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a259947400/0x5fb08b1e5b762c73 lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb128dff expref: 22 pid: 22788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403592.660109:0:22788:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90a248af0600/0x5fb08b1e5b762c7a lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb128dff expref: 21 pid: 22788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403592.660136:0:22788:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff90a142163600) 00010000:00010000:2.0:1789403592.660140:0:22788:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789403592.660144:0:22788:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a248af0600, rc 0) 00000100:00100000:2.0:1789403592.660234:0:22788:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a144049880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5aa3c32d-0021-4831-930f-6e88a8b78157+21:18700:x1876325038192000:12345-192.168.203.43@tcp:101:lfs.0 Request processed in 1167us (2040us total) trans 12884901900 rc 0/0 00000100:00100000:2.0:1789403592.660244:0:22788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 40 00000100:00100000:1.0:1789403592.669251:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:1.0:1789403592.669356:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:3.0:1789403592.669945:0:23939:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038192256 00000100:00100000:3.0:1789403592.669960:0:23939:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038192256 00000100:00100000:3.0:1789403592.670057:0:23939:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 0 00000100:00100000:3.0:1789403592.670070:0:23939:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a1443fd500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5aa3c32d-0021-4831-930f-6e88a8b78157+21:2390:x1876325038192256:12345-192.168.203.43@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789403592.670090:0:23939:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789403592.670130:0:23939:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a248af0600/0x5fb08b1e5b762c7a lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb128dff expref: 21 pid: 22788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403592.670155:0:23939:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff90a142163600) 00010000:00010000:3.0:1789403592.670162:0:23939:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789403592.670237:0:23939:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a1443fd500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5aa3c32d-0021-4831-930f-6e88a8b78157+20:2390:x1876325038192256:12345-192.168.203.43@tcp:103:ldlm_bl.0 Request processed in 170us (881us total) trans 0 rc 0/0 00000100:00100000:3.0:1789403592.670246:0:23939:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 0 00000100:00100000:2.0:1789403592.674605:0:22787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038192128 00000100:00100000:2.0:1789403592.674627:0:22787:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038192128 00000100:00100000:2.0:1789403592.674750:0:22787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 41 00000100:00100000:2.0:1789403592.674762:0:22787:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a1443ff480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5aa3c32d-0021-4831-930f-6e88a8b78157+20:18700:x1876325038192128:12345-192.168.203.43@tcp:54:lfs.0 00010000:00010000:2.0:1789403592.674850:0:22787:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a270185c00/0x5fb08b1e5b762c88 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 22787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403592.674871:0:22787:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a270185c00/0x5fb08b1e5b762c88 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403592.674885:0:22787:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a270185c00/0x5fb08b1e5b762c88 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403592.674942:0:22787:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a270185c00/0x5fb08b1e5b762c88 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403592.674951:0:22787:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a270185c00/0x5fb08b1e5b762c88 lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 22787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403592.674958:0:22787:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90a270185c00/0x5fb08b1e5b762c88 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 22787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403592.674964:0:22787:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a270185c00 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:2.0:1789403592.674994:0:22787:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a270185c00/0x5fb08b1e5b762c88 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 22787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403592.675003:0:22787:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a270185c00/0x5fb08b1e5b762c88 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 22787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403592.675018:0:22787:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff90a142163600) 00010000:00010000:2.0:1789403592.675021:0:22787:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1789403592.675026:0:22787:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90a270185c00/0x5fb08b1e5b762c88 lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 22787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403592.675034:0:22787:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a270185c00/0x5fb08b1e5b762c88 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 22787 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789403592.675683:0:22787:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a1443ff480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5aa3c32d-0021-4831-930f-6e88a8b78157+20:18700:x1876325038192128:12345-192.168.203.43@tcp:54:lfs.0 Request processed in 917us (6439us total) trans 0 rc 0/0 00000100:00100000:2.0:1789403592.675694:0:22787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 41 00000100:00100000:1.0:1789403592.678115:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:3.0:1789403592.678576:0:22790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038192512 00000100:00100000:3.0:1789403592.678600:0:22790:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038192512 00000100:00100000:3.0:1789403592.678672:0:22790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 7 00000100:00100000:3.0:1789403592.678715:0:22790:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a1443fed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5aa3c32d-0021-4831-930f-6e88a8b78157+20:18700:x1876325038192512:12345-192.168.203.43@tcp:35:lfs.0 00000100:00100000:3.0:1789403592.679058:0:22790:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a1443fed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5aa3c32d-0021-4831-930f-6e88a8b78157+21:18700:x1876325038192512:12345-192.168.203.43@tcp:35:lfs.0 Request processed in 346us (968us total) trans 12884901901 rc 0/0 00000100:00100000:3.0:1789403592.679067:0:22790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 7 00000100:00100000:1.0:1789403592.934798:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:0.0:1789403592.939551:0:22786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038192768 00000100:00100000:0.0:1789403592.939573:0:22786:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038192768 00000100:00100000:0.0:1789403592.939796:0:22786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 42 00000100:00100000:0.0:1789403592.939810:0:22786:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a144b28380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5aa3c32d-0021-4831-930f-6e88a8b78157+21:18731:x1876325038192768:12345-192.168.203.43@tcp:101:cat.0 00010000:00010000:0.0:1789403592.939850:0:22786:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789403592.939875:0:22786:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a2821e8800/0x5fb08b1e5b762c8f lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1acb85b3eb128e06 expref: -99 pid: 22786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403592.940140:0:22786:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a2821e8400/0x5fb08b1e5b762c96 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 22786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403592.940158:0:22786:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a2821e8400/0x5fb08b1e5b762c96 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403592.940172:0:22786:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a2821e8400/0x5fb08b1e5b762c96 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22786 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789403592.940186:0:22786:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00000004:00020000:0.0:1789403592.940197:0:22786:0:(mdt_open.c:646:mdt_finish_open()) 4 open_flags 2199065198593 00010000:00010000:0.0:1789403592.940362:0:22786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a2821e8800/0x5fb08b1e5b762c8f lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb128e06 expref: 24 pid: 22786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403592.940384:0:22786:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90a2821e8400/0x5fb08b1e5b762c96 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb128e06 expref: 23 pid: 22786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403592.940437:0:22786:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff90a142163600) 00010000:00010000:0.0:1789403592.940441:0:22786:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789403592.940445:0:22786:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a2821e8400, rc 0) 00000100:00100000:0.0:1789403592.940540:0:22786:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a144b28380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5aa3c32d-0021-4831-930f-6e88a8b78157+23:18731:x1876325038192768:12345-192.168.203.43@tcp:101:cat.0 Request processed in 733us (5757us total) trans 12884901902 rc 0/0 00000100:00100000:0.0:1789403592.940548:0:22786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 42 00000100:00100000:2.0:1789403592.944329:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:3.0:1789403592.944421:0:22772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038192896 00000100:00100000:3.0:1789403592.944434:0:22772:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038192896 00000100:00100000:2.0:1789403592.944465:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:3.0:1789403592.944514:0:22772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 1 00000100:00100000:3.0:1789403592.944528:0:22772:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a142500a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5aa3c32d-0021-4831-930f-6e88a8b78157+23:2390:x1876325038192896:12345-192.168.203.43@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789403592.944549:0:22772:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1789403592.944573:0:22790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038193152 00000100:00100000:1.0:1789403592.944579:0:22790:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038193152 00010000:00010000:3.0:1789403592.944581:0:22772:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a2821e8400/0x5fb08b1e5b762c96 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb128e06 expref: 23 pid: 22786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403592.944614:0:22772:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff90a142163600) 00000100:00100000:1.0:1789403592.944618:0:22790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 8 00010000:00010000:3.0:1789403592.944623:0:22772:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789403592.944629:0:22790:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a142501180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5aa3c32d-0021-4831-930f-6e88a8b78157+23:18731:x1876325038193152:12345-192.168.203.43@tcp:35:cat.0 00000100:00100000:3.0:1789403592.944696:0:22772:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a142500a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5aa3c32d-0021-4831-930f-6e88a8b78157+23:2390:x1876325038192896:12345-192.168.203.43@tcp:103:ldlm_bl.0 Request processed in 170us (379us total) trans 0 rc 0/0 00000100:00100000:3.0:1789403592.944705:0:22772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 1 00000100:00100000:1.0:1789403592.944963:0:22790:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a142501180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5aa3c32d-0021-4831-930f-6e88a8b78157+23:18731:x1876325038193152:12345-192.168.203.43@tcp:35:cat.0 Request processed in 336us (498us total) trans 12884901903 rc 0/0 00000100:00100000:1.0:1789403592.944971:0:22790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 8 00000040:00080000:1.0:1789403592.946493:0:23539:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:2.0:1789403593.004448:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:3.0:1789403593.004741:0:25827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038193408 00000100:00100000:3.0:1789403593.004757:0:25827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038193408 00000100:00100000:3.0:1789403593.004855:0:25827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 43 00000100:00100000:3.0:1789403593.004868:0:25827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a142502d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5aa3c32d-0021-4831-930f-6e88a8b78157+23:18737:x1876325038193408:12345-192.168.203.43@tcp:101:dd.0 00010000:00010000:3.0:1789403593.004900:0:25827:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789403593.004929:0:25827:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a248af0000/0x5fb08b1e5b762ca4 lrc: 2/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1acb85b3eb128e0d expref: -99 pid: 25827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:1.0:1789403593.005127:0:22782:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1789403593.005299:0:25827:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90a248af0600/0x5fb08b1e5b762cab lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 25827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403593.005331:0:25827:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90a270185a00/0x5fb08b1e5b762c0a lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb128de3 expref: 24 pid: 22787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403593.005339:0:25827:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90a259946600/0x5fb08b1e5b762c26 lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb128df1 expref: 24 pid: 22788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403593.005347:0:25827:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a248af0600/0x5fb08b1e5b762cab lrc: 5/0,1 mode: --/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 25827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403593.005417:0:25827:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90a259946600/0x5fb08b1e5b762c26 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb128df1 expref: 24 pid: 22788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403593.005433:0:25827:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90a259946600/0x5fb08b1e5b762c26 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb128df1 expref: 24 pid: 22788 timeout: 739 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789403593.005448:0:25827:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a14251d880 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:25827:1876325050872960:192.168.203.43@tcp:104: 00010000:00010000:3.0:1789403593.005566:0:25827:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90a270185a00/0x5fb08b1e5b762c0a lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb128de3 expref: 24 pid: 22787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403593.005576:0:25827:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90a270185a00/0x5fb08b1e5b762c0a lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb128de3 expref: 24 pid: 22787 timeout: 739 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789403593.005586:0:25827:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a14251ed80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:25827:1876325050873088:192.168.203.43@tcp:104: 00000100:00100000:3.0:1789403593.005611:0:25827:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a281bb6300 going to sleep for 11 seconds 00000100:00100000:2.0:1789403593.007967:0:25827:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a14251d880 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:25827:1876325050872960:192.168.203.43@tcp:104: 00000100:00100000:2.0:1789403593.008050:0:25827:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a14251ed80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:25827:1876325050873088:192.168.203.43@tcp:104: 00010000:00010000:2.0:1789403593.008078:0:25827:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90a248af0600/0x5fb08b1e5b762cab lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 25827 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789403593.008863:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:3.0:1789403593.009090:0:23939:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038193536 00000100:00100000:3.0:1789403593.009098:0:23939:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038193536 00010000:00010000:3.0:1789403593.009146:0:23939:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a259946600/0x5fb08b1e5b762c26 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb128df1 expref: 25 pid: 22788 timeout: 739 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789403593.009191:0:23939:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 17 00000100:00100000:3.0:1789403593.009323:0:23939:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a142503b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5aa3c32d-0021-4831-930f-6e88a8b78157+25:2389:x1876325038193536:12345-192.168.203.43@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789403593.009338:0:23939:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789403593.009346:0:23939:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90a259946600/0x5fb08b1e5b762c26 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb128df1 expref: 25 pid: 22788 timeout: 739 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403593.009359:0:23939:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90a259946600/0x5fb08b1e5b762c26 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb128df1 expref: 25 pid: 22788 timeout: 739 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403593.009382:0:23939:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a259946600/0x5fb08b1e5b762c26 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb128df1 expref: 25 pid: 22788 timeout: 739 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403593.009438:0:23939:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff90a142163600) 00010000:00010000:3.0:1789403593.009454:0:23939:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff90a248af0600/0x5fb08b1e5b762cab lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 25827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403593.009464:0:23939:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff90a248af0600/0x5fb08b1e5b762cab lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 25827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403593.009470:0:23939:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789403593.009517:0:23939:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a142503b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5aa3c32d-0021-4831-930f-6e88a8b78157+24:2389:x1876325038193536:12345-192.168.203.43@tcp:103:ldlm_bl.0 Request processed in 317us (657us total) trans 0 rc 0/0 00000100:00100000:3.0:1789403593.009525:0:23939:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 17 00000100:00100000:3.0:1789403593.009787:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:2.0:1789403593.014743:0:22772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038193664 00000100:00100000:2.0:1789403593.014758:0:22772:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038193664 00010000:00010000:2.0:1789403593.014909:0:22772:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a270185a00/0x5fb08b1e5b762c0a lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb128de3 expref: 24 pid: 22787 timeout: 739 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789403593.014976:0:22772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 18 00000100:00100000:2.0:1789403593.014985:0:22772:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a248411450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5aa3c32d-0021-4831-930f-6e88a8b78157+24:2389:x1876325038193664:12345-192.168.203.43@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789403593.015000:0:22772:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789403593.015007:0:22772:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90a270185a00/0x5fb08b1e5b762c0a lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb128de3 expref: 24 pid: 22787 timeout: 739 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403593.015019:0:22772:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90a270185a00/0x5fb08b1e5b762c0a lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb128de3 expref: 24 pid: 22787 timeout: 739 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403593.015038:0:22772:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a270185a00/0x5fb08b1e5b762c0a lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb128de3 expref: 24 pid: 22787 timeout: 739 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403593.015053:0:22772:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff90a142163600) 00010000:00010000:2.0:1789403593.015058:0:22772:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff90a248af0600/0x5fb08b1e5b762cab lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 25827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403593.015066:0:22772:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90a248af0600/0x5fb08b1e5b762cab lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 25827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403593.015073:0:22772:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a248af0600/0x5fb08b1e5b762cab lrc: 4/0,1 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 25827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403593.015104:0:22772:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789403593.015164:0:22772:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a248411450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5aa3c32d-0021-4831-930f-6e88a8b78157+23:2389:x1876325038193664:12345-192.168.203.43@tcp:103:ldlm_bl.0 Request processed in 181us (5378us total) trans 0 rc 0/0 00000100:00100000:2.0:1789403593.015171:0:22772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 18 00010000:00010000:3.0:1789403593.015290:0:25827:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90a248af0600/0x5fb08b1e5b762cab lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 25827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403593.015306:0:25827:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a248af0600/0x5fb08b1e5b762cab lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 25827 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789403593.015325:0:25827:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00000004:00020000:3.0:1789403593.015342:0:25827:0:(mdt_open.c:646:mdt_finish_open()) 4 open_flags 2199602070082 00010000:00010000:3.0:1789403593.015506:0:25827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a248af0000/0x5fb08b1e5b762ca4 lrc: 0/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb128e0d expref: 24 pid: 25827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403593.015525:0:25827:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90a248af0600/0x5fb08b1e5b762cab lrc: 3/0,0 mode: CW/CW res: [0x2000013a1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb128e0d expref: 23 pid: 25827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403593.015532:0:25827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff90a142163600) 00010000:00010000:3.0:1789403593.015535:0:25827:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1789403593.015538:0:25827:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a248af0600, rc 0) 00000100:00100000:3.0:1789403593.015565:0:25827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a142502d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5aa3c32d-0021-4831-930f-6e88a8b78157+23:18737:x1876325038193408:12345-192.168.203.43@tcp:101:dd.0 Request processed in 10702us (11133us total) trans 12884901904 rc 0/0 00000100:00100000:3.0:1789403593.015573:0:25827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 43 00000040:00080000:0.0:1789403593.017300:0:22826:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:3.0:1789403593.020375:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:2.0:1789403593.020858:0:22788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038193792 00000100:00100000:2.0:1789403593.020982:0:22788:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038193792 00000100:00100000:2.0:1789403593.021045:0:22788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 44 00000100:00100000:2.0:1789403593.021056:0:22788:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a14251d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5aa3c32d-0021-4831-930f-6e88a8b78157+23:18737:x1876325038193792:12345-192.168.203.43@tcp:101:dd.0 00010000:00010000:2.0:1789403593.021079:0:22788:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789403593.021098:0:22788:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a270185c00/0x5fb08b1e5b762cb9 lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1acb85b3eb128e14 expref: -99 pid: 22788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403593.021132:0:22788:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a270184c00/0x5fb08b1e5b762cc0 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 22788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403593.021146:0:22788:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a270184c00/0x5fb08b1e5b762cc0 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403593.021158:0:22788:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a270184c00/0x5fb08b1e5b762cc0 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403593.021264:0:22788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a270185c00/0x5fb08b1e5b762cb9 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb128e14 expref: 25 pid: 22788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403593.021282:0:22788:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90a270184c00/0x5fb08b1e5b762cc0 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb128e14 expref: 24 pid: 22788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403593.021291:0:22788:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff90a142163600) 00010000:00010000:2.0:1789403593.021294:0:22788:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1789403593.021298:0:22788:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a270184c00, rc 0) 00000100:00100000:2.0:1789403593.021356:0:22788:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a14251d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5aa3c32d-0021-4831-930f-6e88a8b78157+24:18737:x1876325038193792:12345-192.168.203.43@tcp:101:dd.0 Request processed in 303us (989us total) trans 0 rc 0/0 00000100:00100000:2.0:1789403593.021364:0:22788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 44 00000100:00100000:1.0:1789403593.029951:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:2.0:1789403593.030048:0:22787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038194048 00000100:00100000:2.0:1789403593.030073:0:22787:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038194048 00000100:00100000:2.0:1789403593.030138:0:22787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 45 00000100:00100000:2.0:1789403593.030149:0:22787:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a144b2bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5aa3c32d-0021-4831-930f-6e88a8b78157+24:18737:x1876325038194048:12345-192.168.203.43@tcp:36:dd.0 00010000:00010000:2.0:1789403593.030384:0:22787:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90a270185c00/0x5fb08b1e5b762cc7 lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 22787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403593.030439:0:22787:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a270185c00/0x5fb08b1e5b762cc7 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403593.030450:0:22787:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a270185c00/0x5fb08b1e5b762cc7 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22787 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789403593.030492:0:22787:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901905 00000004:00010000:2.0:1789403593.030517:0:22787:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000007d31a8f4 reply state 000000003c64ef4e transno 12884901906 ns: mdt-lustre-MDT0000_UUID lock: ffff90a270185c00/0x5fb08b1e5b762cc7 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403593.030529:0:22787:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a270185c00/0x5fb08b1e5b762cc7 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403593.030536:0:22787:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff90a142163600) 00010000:00010000:2.0:1789403593.030539:0:22787:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1789403593.030543:0:22787:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1789403593.030746:0:22787:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a144b2bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5aa3c32d-0021-4831-930f-6e88a8b78157+27:18737:x1876325038194048:12345-192.168.203.43@tcp:36:dd.0 Request processed in 596us (801us total) trans 12884901906 rc 0/0 00000100:00100000:0.0:1789403593.030755:0:22787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 45 00000020:00080000:0.0:1789403593.030770:0:22787:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1789403593.038654:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:0.0:1789403593.038772:0:22786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038194176 00000100:00100000:0.0:1789403593.038782:0:22786:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038194176 00000100:00100000:0.0:1789403593.038846:0:22786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 46 00000100:00100000:0.0:1789403593.038856:0:22786:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a144b28a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5aa3c32d-0021-4831-930f-6e88a8b78157+27:18737:x1876325038194176:12345-192.168.203.43@tcp:101:dd.0 00010000:00010000:0.0:1789403593.038879:0:22786:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789403593.038899:0:22786:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a2821e8800/0x5fb08b1e5b762cce lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1acb85b3eb128e1b expref: -99 pid: 22786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403593.038954:0:22786:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a2821e8800/0x5fb08b1e5b762cce lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb128e1b expref: 28 pid: 22786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403593.038969:0:22786:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90a2821e8800/0x5fb08b1e5b762cce lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb128e1b expref: 28 pid: 22786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403593.038987:0:22786:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff90a142163600) 00010000:00010000:0.0:1789403593.038990:0:22786:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1789403593.038994:0:22786:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a2821e8800, rc 0) 00000100:00100000:0.0:1789403593.039060:0:22786:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a144b28a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5aa3c32d-0021-4831-930f-6e88a8b78157+28:18737:x1876325038194176:12345-192.168.203.43@tcp:101:dd.0 Request processed in 205us (413us total) trans 0 rc 0/0 00000100:00100000:0.0:1789403593.039067:0:22786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 46 00000100:00100000:1.0:1789403593.059558:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:3.0:1789403593.059664:0:22771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038194432 00000100:00100000:3.0:1789403593.059673:0:22771:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038194432 00000100:00100000:3.0:1789403593.059751:0:22771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 2 00000100:00100000:3.0:1789403593.059762:0:22771:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a144b28700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5aa3c32d-0021-4831-930f-6e88a8b78157+28:18737:x1876325038194432:12345-192.168.203.43@tcp:103:dd.0 00010000:00010000:3.0:1789403593.059778:0:22771:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789403593.059801:0:22771:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a2821e8800/0x5fb08b1e5b762cce lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb128e1b expref: 28 pid: 22786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403593.059821:0:22771:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff90a142163600) 00010000:00010000:3.0:1789403593.059839:0:22771:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789403593.059898:0:22771:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a144b28700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5aa3c32d-0021-4831-930f-6e88a8b78157+27:18737:x1876325038194432:12345-192.168.203.43@tcp:103:dd.0 Request processed in 138us (348us total) trans 0 rc 0/0 00000100:00100000:3.0:1789403593.059906:0:22771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 2 00000100:00100000:1.0:1789403593.066695:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:0.0:1789403593.066865:0:22787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038194560 00000100:00100000:0.0:1789403593.066875:0:22787:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038194560 00000100:00100000:0.0:1789403593.066940:0:22787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 47 00000100:00100000:0.0:1789403593.066952:0:22787:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a144b29500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5aa3c32d-0021-4831-930f-6e88a8b78157+27:18737:x1876325038194560:12345-192.168.203.43@tcp:58:dd.0 00010000:00010000:0.0:1789403593.067065:0:22787:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90a2821e9e00/0x5fb08b1e5b762cd5 lrc: 3/0,1 mode: --/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 22787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403593.067102:0:22787:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a2821e9e00/0x5fb08b1e5b762cd5 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403593.067113:0:22787:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a2821e9e00/0x5fb08b1e5b762cd5 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22787 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1789403593.069855:0:22787:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1789403593.069889:0:22787:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].3, 64 off8384 00000040:00080000:0.0:1789403593.070825:0:22787:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x14:0x0].1, 136 off8328 00000100:00100000:0.0:1789403593.070984:0:22787:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a144b29500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5aa3c32d-0021-4831-930f-6e88a8b78157+27:18737:x1876325038194560:12345-192.168.203.43@tcp:58:dd.0 Request processed in 4029us (4293us total) trans 0 rc 0/0 00000100:00100000:0.0:1789403593.070995:0:22787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 47 00000100:00100000:1.0:1789403593.088489:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:0.0:1789403593.088586:0:22786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038194688 00000100:00100000:0.0:1789403593.088596:0:22786:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038194688 00000100:00100000:0.0:1789403593.088707:0:22786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 48 00000100:00100000:0.0:1789403593.088718:0:22786:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a144b2a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5aa3c32d-0021-4831-930f-6e88a8b78157+27:18737:x1876325038194688:12345-192.168.203.43@tcp:101:dd.0 00010000:00010000:0.0:1789403593.088748:0:22786:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789403593.088769:0:22786:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a2821e8000/0x5fb08b1e5b762cdc lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1acb85b3eb128e22 expref: -99 pid: 22786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403593.088821:0:22786:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90a2821e9e00/0x5fb08b1e5b762cd5 lrc: 2/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 22787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403593.088841:0:22786:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a2821e8000/0x5fb08b1e5b762cdc lrc: 4/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb128e22 expref: 28 pid: 22786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403593.088859:0:22786:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff90a2821e9e00/0x5fb08b1e5b762cd5 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 22787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403593.088891:0:22786:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90a2821e8000/0x5fb08b1e5b762cdc lrc: 3/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb128e22 expref: 28 pid: 22786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403593.088905:0:22786:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff90a142163600) 00010000:00010000:0.0:1789403593.088908:0:22786:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1789403593.088912:0:22786:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff90a2821e8000/0x5fb08b1e5b762cdc lrc: 3/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb128e22 expref: 28 pid: 22786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403593.088919:0:22786:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a2821e8000, rc 0) 00000100:00100000:0.0:1789403593.088975:0:22786:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a144b2a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5aa3c32d-0021-4831-930f-6e88a8b78157+28:18737:x1876325038194688:12345-192.168.203.43@tcp:101:dd.0 Request processed in 260us (593us total) trans 0 rc 0/0 00000100:00100000:0.0:1789403593.088981:0:22786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 48 00010000:00010000:1.0:1789403593.459383:0:22774:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789403593.972884:0:3626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a142500a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3626:1876325050873344:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1789403593.972906:0:3628:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789403593.972934:0:3628:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a14251ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3628:1876325050873216:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1789403593.972987:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789403593.972992:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789403593.973033:0:3626:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789403593.973051:0:3626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a246f3e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3626:1876325050873472:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1789403593.973053:0:24295:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050873216 00000100:00100000:3.0:1789403593.973063:0:24295:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050873216 00000100:00100000:1.0:1789403593.973086:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1789403593.973103:0:22782:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789403593.973127:0:24295:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1789403593.973136:0:24295:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a14251d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3628:x1876325050873216:12345-0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1789403593.973152:0:22792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050873344 00000100:00100000:1.0:1789403593.973158:0:22792:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050873344 00002000:00000024:3.0:1789403593.973162:0:24295:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3915849728 avail 3684327424 00000100:00100000:1.0:1789403593.973199:0:22792:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050873472 00000100:00100000:1.0:1789403593.973204:0:22792:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050873472 00000100:00100000:3.0:1789403593.973212:0:24295:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a14251d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3628:x1876325050873216:12345-0@lo:13:osp-pre-0-1.0 Request processed in 76us (223us total) trans 0 rc 0/0 00000100:00100000:3.0:1789403593.973220:0:24295:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1789403593.973225:0:22792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1789403593.973234:0:22792:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a276e98000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3626:x1876325050873344:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1789403593.973258:0:22792:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446289408 avail 1300049920 00000100:00100000:3.0:1789403593.973268:0:3628:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a14251ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3628:1876325050873216:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1789403593.973303:0:22792:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a276e98000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3626:x1876325050873344:12345-0@lo:41:osp-pre-0-1.0 Request processed in 69us (317us total) trans 0 rc 0/0 00000100:00100000:1.0:1789403593.973311:0:22792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1789403593.973325:0:22792:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1789403593.973332:0:22792:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a276e9a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3626:x1876325050873472:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1789403593.973347:0:22792:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:1.0:1789403593.973378:0:22792:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a276e9a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3626:x1876325050873472:12345-0@lo:41:osp-pre-1-0.0 Request processed in 47us (293us total) trans 0 rc 0/0 00000100:00100000:1.0:1789403593.973384:0:22792:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1789403593.973454:0:3626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a246f3e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3626:1876325050873472:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1789403593.973467:0:3626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a142500a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3626:1876325050873344:0@lo:41:osp-pre-0-1.0 00000040:00080000:0.0:1789403594.033614:0:22826:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:0.0:1789403594.033624:0:22826:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x14:0x0] at index 3 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1789403594.033671:0:22826:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x14:0x0] index 2 count 2 00000040:00080000:0.0:1789403594.033680:0:22826:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 4 count 2 00000100:00100000:0.0:1789403594.033901:0:22826:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a246f3d180 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:22826:1876325050873600:192.168.203.43@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1789403594.034017:0:22826:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a25278d900 going to sleep for 11 seconds 00000100:00100000:1.0:1789403594.042613:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:3.0:1789403594.042760:0:25827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038194816 00000100:00100000:3.0:1789403594.042770:0:25827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038194816 00000100:00100000:3.0:1789403594.042840:0:25827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 49 00000100:00100000:3.0:1789403594.042850:0:25827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a276e99f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5aa3c32d-0021-4831-930f-6e88a8b78157+29:18738:x1876325038194816:12345-192.168.203.43@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1789403594.042880:0:25827:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x2000013a1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1789403594.042996:0:25827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a276e99f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5aa3c32d-0021-4831-930f-6e88a8b78157+29:18738:x1876325038194816:12345-192.168.203.43@tcp:53:lhsmtool_posix.0 Request processed in 147us (392us total) trans 0 rc 0/0 00000100:00100000:3.0:1789403594.043003:0:25827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 49 00000100:00100000:0.0:1789403594.043211:0:22826:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a246f3d180 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:22826:1876325050873600:192.168.203.43@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1789403594.050341:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:2.0:1789403594.050494:0:22788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038194944 00000100:00100000:2.0:1789403594.050505:0:22788:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038194944 00000100:00100000:2.0:1789403594.050570:0:22788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 50 00000100:00100000:2.0:1789403594.050580:0:22788:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a14251ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5aa3c32d-0021-4831-930f-6e88a8b78157+28:18738:x1876325038194944:12345-192.168.203.43@tcp:34:lhsmtool_posix.0 00010000:00010000:2.0:1789403594.050649:0:22788:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a270184600/0x5fb08b1e5b762ce3 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 22788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403594.050665:0:22788:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a270184600/0x5fb08b1e5b762ce3 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403594.050696:0:22788:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a270184600/0x5fb08b1e5b762ce3 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403594.050769:0:22788:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a270185e00/0x5fb08b1e5b762cea lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 22788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403594.050778:0:22788:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a270185e00/0x5fb08b1e5b762cea lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403594.050789:0:22788:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a270185e00/0x5fb08b1e5b762cea lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403594.050826:0:22788:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a270185a00/0x5fb08b1e5b762cf1 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 22788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403594.050837:0:22788:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a270185a00/0x5fb08b1e5b762cf1 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 22788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403594.050844:0:22788:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a270185a00/0x5fb08b1e5b762cf1 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 22788 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789403594.050891:0:22788:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00000004:00200000:2.0:1789403594.050896:0:22788:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1789403594.050908:0:22788:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90a270185a00/0x5fb08b1e5b762cf1 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 22788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403594.050919:0:22788:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a270184600/0x5fb08b1e5b762ce3 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403594.050926:0:22788:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a270184600/0x5fb08b1e5b762ce3 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 22788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403594.050943:0:22788:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90a270184600/0x5fb08b1e5b762ce3 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 22788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403594.050949:0:22788:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a270184600 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:2.0:1789403594.050953:0:22788:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a270184600/0x5fb08b1e5b762ce3 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 22788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403594.050973:0:22788:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a270184600/0x5fb08b1e5b762ce3 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 22788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403594.051110:0:22788:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff90a1434a7c00) 00010000:00010000:2.0:1789403594.051115:0:22788:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789403594.051120:0:22788:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90a270184600/0x5fb08b1e5b762ce3 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 22788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403594.051127:0:22788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a270184600/0x5fb08b1e5b762ce3 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 22788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403594.051141:0:22788:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a270185e00/0x5fb08b1e5b762cea lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403594.051147:0:22788:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a270185e00/0x5fb08b1e5b762cea lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 22788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403594.051153:0:22788:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90a270185e00/0x5fb08b1e5b762cea lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403594.051158:0:22788:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a270185e00 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:2.0:1789403594.051161:0:22788:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a270185e00/0x5fb08b1e5b762cea lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403594.051179:0:22788:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a270185e00/0x5fb08b1e5b762cea lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 22788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403594.051187:0:22788:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x925dcd63 (ffff90a142163800) 00010000:00010000:2.0:1789403594.051190:0:22788:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789403594.051193:0:22788:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90a270185e00/0x5fb08b1e5b762cea lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403594.051199:0:22788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a270185e00/0x5fb08b1e5b762cea lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x925dcd63 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403594.051213:0:22788:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a270185a00/0x5fb08b1e5b762cf1 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 22788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403594.051220:0:22788:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a270185a00/0x5fb08b1e5b762cf1 lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 22788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403594.051226:0:22788:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90a270185a00/0x5fb08b1e5b762cf1 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 22788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403594.051231:0:22788:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a270185a00 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:2.0:1789403594.051234:0:22788:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a270185a00/0x5fb08b1e5b762cf1 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 22788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403594.051240:0:22788:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a270185a00/0x5fb08b1e5b762cf1 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 22788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403594.051248:0:22788:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff90a142163600) 00010000:00010000:2.0:1789403594.051250:0:22788:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789403594.051253:0:22788:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90a270185a00/0x5fb08b1e5b762cf1 lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 22788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403594.051268:0:22788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a270185a00/0x5fb08b1e5b762cf1 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 22788 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789403594.051350:0:22788:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a14251ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5aa3c32d-0021-4831-930f-6e88a8b78157+28:18738:x1876325038194944:12345-192.168.203.43@tcp:34:lhsmtool_posix.0 Request processed in 770us (1016us total) trans 0 rc 0/0 00000100:00100000:2.0:1789403594.051358:0:22788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 50 00000100:00100000:2.0:1789403594.057254:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:3.0:1789403594.057365:0:25827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038195200 00000100:00100000:3.0:1789403594.058415:0:25827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038195200 00000100:00100000:3.0:1789403594.058601:0:25827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 51 00000100:00100000:3.0:1789403594.058614:0:25827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a142503b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5aa3c32d-0021-4831-930f-6e88a8b78157+28:18738:x1876325038195200:12345-192.168.203.43@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789403594.058636:0:25827:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789403594.058656:0:25827:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c6200/0x5fb08b1e5b762cf8 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1acb85b3eb128e29 expref: -99 pid: 25827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403594.058791:0:25827:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c7e00/0x5fb08b1e5b762cff lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 25827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403594.058815:0:25827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c7e00/0x5fb08b1e5b762cff lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 25827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403594.058829:0:25827:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c7e00/0x5fb08b1e5b762cff lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 25827 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789403594.058840:0:25827:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x2000013a1:0x2:0x0]: returning size 0 00000004:00020000:3.0:1789403594.058850:0:25827:0:(mdt_open.c:646:mdt_finish_open()) 4 open_flags 2207621578753 00010000:00010000:3.0:1789403594.058920:0:25827:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c7e00/0x5fb08b1e5b762cff lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 25827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403594.058928:0:25827:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c7e00/0x5fb08b1e5b762cff lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 25827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403594.058935:0:25827:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c7e00/0x5fb08b1e5b762cff lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 25827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403594.058942:0:25827:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a1425c7e00 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:3.0:1789403594.058946:0:25827:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c7e00/0x5fb08b1e5b762cff lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 25827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403594.058953:0:25827:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c7e00/0x5fb08b1e5b762cff lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 25827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403594.058976:0:25827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff90a142163600) 00010000:00010000:3.0:1789403594.058979:0:25827:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1789403594.058995:0:25827:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c7e00/0x5fb08b1e5b762cff lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 25827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403594.059003:0:25827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c7e00/0x5fb08b1e5b762cff lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 25827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403594.059045:0:25827:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c6200/0x5fb08b1e5b762cf8 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb128e29 expref: 30 pid: 25827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403594.059055:0:25827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff90a1434a7c00) 00010000:00010000:3.0:1789403594.059058:0:25827:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1789403594.059061:0:25827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c6200/0x5fb08b1e5b762cf8 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb128e29 expref: 30 pid: 25827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403594.059071:0:25827:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a1425c6200, rc 0) 00000100:00100000:3.0:1789403594.059143:0:25827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a142503b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5aa3c32d-0021-4831-930f-6e88a8b78157+29:18738:x1876325038195200:12345-192.168.203.43@tcp:101:lhsmtool_posix.0 Request processed in 531us (1898us total) trans 12884901907 rc 301/301 00000100:00100000:3.0:1789403594.059152:0:25827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 51 00000100:00100000:1.0:1789403594.064120:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:2.0:1789403594.064224:0:22788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038195328 00000100:00100000:2.0:1789403594.064233:0:22788:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038195328 00000100:00100000:2.0:1789403594.064291:0:22788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 52 00000100:00100000:2.0:1789403594.064301:0:22788:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a276e98700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5aa3c32d-0021-4831-930f-6e88a8b78157+29:18738:x1876325038195328:12345-192.168.203.43@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1789403594.064333:0:22788:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x2000013a1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1789403594.064491:0:22788:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a276e98700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5aa3c32d-0021-4831-930f-6e88a8b78157+29:18738:x1876325038195328:12345-192.168.203.43@tcp:53:lhsmtool_posix.0 Request processed in 192us (380us total) trans 0 rc 0/0 00000100:00100000:2.0:1789403594.064499:0:22788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 52 00000100:00100000:0.0:1789403594.103229:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:1.0:1789403594.103425:0:22787:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038195584 00000100:00100000:1.0:1789403594.103435:0:22787:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038195584 00000100:00100000:1.0:1789403594.103539:0:22787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 53 00000100:00100000:1.0:1789403594.103551:0:22787:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a246f3d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5aa3c32d-0021-4831-930f-6e88a8b78157+29:18738:x1876325038195584:12345-192.168.203.43@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789403594.103586:0:22787:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789403594.103606:0:22787:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a281b05a00/0x5fb08b1e5b762d0d lrc: 2/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1acb85b3eb128e30 expref: -99 pid: 22787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1789403594.104527:0:22787:0:(osp_internal.h:553:osp_update_last_fid()) Gap in objids: start=[0x2c0000401:0x6:0x0], count =60 00000004:00080000:1.0:1789403594.104537:0:22787:0:(osp_object.c:1645:osp_create()) Writing gap [0x2c0000401:0x6:0x0]+60 in llog 00000004:00080000:1.0:1789403594.104558:0:22787:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x42:0x0], index 1: 0 00010000:00010000:1.0:1789403594.104713:0:22787:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a281b05600/0x5fb08b1e5b762d14 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 22787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403594.104737:0:22787:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a281b05600/0x5fb08b1e5b762d14 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403594.104750:0:22787:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a281b05600/0x5fb08b1e5b762d14 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22787 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00020000:1.0:1789403594.104757:0:22787:0:(mdt_open.c:1779:mdt_reint_open()) 2 open_flags 2233382994115 00000004:00020000:1.0:1789403594.104768:0:22787:0:(mdt_open.c:646:mdt_finish_open()) 4 open_flags 2233382994115 00010000:00010000:1.0:1789403594.104828:0:22787:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a281b05a00/0x5fb08b1e5b762d0d lrc: 0/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb128e30 expref: 32 pid: 22787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403594.104846:0:22787:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90a281b05600/0x5fb08b1e5b762d14 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb128e30 expref: 31 pid: 22787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403594.104854:0:22787:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff90a142629700) 00010000:00010000:1.0:1789403594.104857:0:22787:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789403594.104861:0:22787:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a281b05600, rc 0) 00000100:00100000:1.0:1789403594.105887:0:22787:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a246f3d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:5aa3c32d-0021-4831-930f-6e88a8b78157+31:18738:x1876325038195584:12345-192.168.203.43@tcp:101:lhsmtool_posix.0 Request processed in 2331us (2658us total) trans 12884901908 rc 0/0 00000100:00100000:1.0:1789403594.105925:0:22787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 53 00000100:00100000:1.0:1789403594.115563:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:2.0:1789403594.116132:0:22788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038195840 00000100:00100000:2.0:1789403594.116144:0:22788:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038195840 00000100:00100000:2.0:1789403594.116247:0:22788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 54 00000100:00100000:2.0:1789403594.116258:0:22788:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a276e9b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5aa3c32d-0021-4831-930f-6e88a8b78157+31:18738:x1876325038195840:12345-192.168.203.43@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1789403594.116318:0:22788:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789403594.116344:0:22788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a281b05600/0x5fb08b1e5b762d14 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb128e30 expref: 31 pid: 22787 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403594.116363:0:22788:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff90a142629700) 00010000:00010000:2.0:1789403594.116373:0:22788:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789403594.116465:0:22788:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90a270185e00/0x5fb08b1e5b762d22 lrc: 3/0,1 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 22788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403594.116490:0:22788:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a270185e00/0x5fb08b1e5b762d22 lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403594.116501:0:22788:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a270185e00/0x5fb08b1e5b762d22 lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403594.116515:0:22788:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90a270184600/0x5fb08b1e5b762d29 lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x1:0x0].0x5789fb08 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 22788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403594.116522:0:22788:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a270184600/0x5fb08b1e5b762d29 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x5789fb08 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403594.116528:0:22788:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a270184600/0x5fb08b1e5b762d29 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x5789fb08 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 22788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403594.116570:0:22788:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff90a270185e00/0x5fb08b1e5b762d22 lrc: 3/0,1 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403594.116577:0:22788:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a270185e00/0x5fb08b1e5b762d22 lrc: 2/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 22788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403594.116584:0:22788:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90a270185e00/0x5fb08b1e5b762d22 lrc: 3/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403594.116590:0:22788:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a270185e00 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:2.0:1789403594.116606:0:22788:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a270185e00/0x5fb08b1e5b762d22 lrc: 3/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403594.116615:0:22788:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a270185e00/0x5fb08b1e5b762d22 lrc: 4/0,0 mode: CW/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 22788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403594.116771:0:22788:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff90a142629000) 00010000:00010000:2.0:1789403594.116774:0:22788:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789403594.116779:0:22788:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90a270185e00/0x5fb08b1e5b762d22 lrc: 2/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403594.116785:0:22788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a270185e00/0x5fb08b1e5b762d22 lrc: 0/0,0 mode: --/CW res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403594.116796:0:22788:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90a270184600/0x5fb08b1e5b762d29 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x5789fb08 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403594.116802:0:22788:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a270184600/0x5fb08b1e5b762d29 lrc: 2/0,0 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x5789fb08 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 22788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403594.116807:0:22788:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90a270184600/0x5fb08b1e5b762d29 lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x5789fb08 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403594.116813:0:22788:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a270184600 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:2.0:1789403594.116815:0:22788:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a270184600/0x5fb08b1e5b762d29 lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x5789fb08 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403594.116821:0:22788:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a270184600/0x5fb08b1e5b762d29 lrc: 4/0,0 mode: PW/PW res: [0x2000013a1:0x1:0x0].0x5789fb08 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 22788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403594.116828:0:22788:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x5789fb08 (ffff90a142163800) 00010000:00010000:2.0:1789403594.116830:0:22788:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789403594.116833:0:22788:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90a270184600/0x5fb08b1e5b762d29 lrc: 2/0,0 mode: --/PW res: [0x2000013a1:0x1:0x0].0x5789fb08 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403594.116838:0:22788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a270184600/0x5fb08b1e5b762d29 lrc: 0/0,0 mode: --/PW res: [0x2000013a1:0x1:0x0].0x5789fb08 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22788 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789403594.117205:0:22788:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a276e9b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5aa3c32d-0021-4831-930f-6e88a8b78157+30:18738:x1876325038195840:12345-192.168.203.43@tcp:36:lhsmtool_posix.0 Request processed in 946us (1651us total) trans 0 rc -2/-2 00000100:00100000:2.0:1789403594.117213:0:22788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 54 00000100:00100000:2.0:1789403594.122934:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:3.0:1789403594.123072:0:25827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038195968 00000100:00100000:3.0:1789403594.123081:0:25827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038195968 00000100:00100000:3.0:1789403594.123140:0:25827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 55 00000100:00100000:3.0:1789403594.123150:0:25827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a142502a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5aa3c32d-0021-4831-930f-6e88a8b78157+30:18738:x1876325038195968:12345-192.168.203.43@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789403594.123169:0:25827:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789403594.123191:0:25827:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c6200/0x5fb08b1e5b762d30 lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1acb85b3eb128e37 expref: -99 pid: 25827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403594.123250:0:25827:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c7e00/0x5fb08b1e5b762d37 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 25827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403594.123264:0:25827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c7e00/0x5fb08b1e5b762d37 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 25827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403594.123275:0:25827:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c7e00/0x5fb08b1e5b762d37 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 25827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403594.123379:0:25827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c6200/0x5fb08b1e5b762d30 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb128e37 expref: 32 pid: 25827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403594.123426:0:25827:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c7e00/0x5fb08b1e5b762d37 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb128e37 expref: 31 pid: 25827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403594.123446:0:25827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff90a1434a7500) 00010000:00010000:3.0:1789403594.123449:0:25827:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1789403594.123451:0:25827:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a1425c7e00, rc 0) 00000100:00100000:3.0:1789403594.123517:0:25827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a142502a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5aa3c32d-0021-4831-930f-6e88a8b78157+31:18738:x1876325038195968:12345-192.168.203.43@tcp:101:lhsmtool_posix.0 Request processed in 368us (594us total) trans 0 rc 0/0 00000100:00100000:3.0:1789403594.123525:0:25827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 55 00000100:00100000:1.0:1789403594.127326:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:2.0:1789403594.127838:0:22786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038196224 00000100:00100000:2.0:1789403594.127849:0:22786:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038196224 00000100:00100000:2.0:1789403594.127902:0:22786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 56 00000100:00100000:2.0:1789403594.127923:0:22786:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a276e99c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5aa3c32d-0021-4831-930f-6e88a8b78157+31:18738:x1876325038196224:12345-192.168.203.43@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1789403594.128116:0:22786:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90a270185a00/0x5fb08b1e5b762d3e lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 22786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403594.128134:0:22786:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a270185a00/0x5fb08b1e5b762d3e lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403594.128147:0:22786:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a270185a00/0x5fb08b1e5b762d3e lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22786 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1789403594.128311:0:22786:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x12:0x0].2, 88 off8344 00000004:00080000:2.0:1789403594.128322:0:22786:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 640126932079ns, next at 641126929607ns, rc = 0 00000004:00010000:2.0:1789403594.128367:0:22786:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000011dce940 reply state 00000000d7787ee0 transno 12884901909 ns: mdt-lustre-MDT0000_UUID lock: ffff90a270185a00/0x5fb08b1e5b762d3e lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 22786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403594.128381:0:22786:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a270185a00/0x5fb08b1e5b762d3e lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403594.128741:0:22786:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff90a1434a7500) 00010000:00010000:2.0:1789403594.128746:0:22786:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:2.0:1789403594.128749:0:22786:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1789403594.128916:0:22786:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a276e99c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5aa3c32d-0021-4831-930f-6e88a8b78157+33:18738:x1876325038196224:12345-192.168.203.43@tcp:36:lhsmtool_posix.0 Request processed in 993us (1597us total) trans 12884901909 rc 0/0 00000100:00100000:2.0:1789403594.128925:0:22786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 56 00000100:00100000:2.0:1789403594.133564:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:3.0:1789403594.135177:0:25827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038196352 00000100:00100000:3.0:1789403594.135190:0:25827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038196352 00000100:00100000:3.0:1789403594.135250:0:25827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 57 00000100:00100000:3.0:1789403594.135260:0:25827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a142501f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5aa3c32d-0021-4831-930f-6e88a8b78157+33:18738:x1876325038196352:12345-192.168.203.43@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789403594.135282:0:25827:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789403594.135303:0:25827:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c6600/0x5fb08b1e5b762d45 lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1acb85b3eb128e3e expref: -99 pid: 25827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403594.135374:0:25827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c6600/0x5fb08b1e5b762d45 lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb128e3e expref: 34 pid: 25827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403594.135416:0:25827:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c6600/0x5fb08b1e5b762d45 lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb128e3e expref: 34 pid: 25827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403594.135446:0:25827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff90a1434a7500) 00010000:00010000:3.0:1789403594.135450:0:25827:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1789403594.135454:0:25827:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a1425c6600, rc 0) 00000100:00100000:3.0:1789403594.135522:0:25827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a142501f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5aa3c32d-0021-4831-930f-6e88a8b78157+34:18738:x1876325038196352:12345-192.168.203.43@tcp:101:lhsmtool_posix.0 Request processed in 262us (1965us total) trans 0 rc 0/0 00000100:00100000:3.0:1789403594.135529:0:25827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 57 00000100:00100000:1.0:1789403594.142540:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:2.0:1789403594.142740:0:24293:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038196480 00000100:00100000:2.0:1789403594.142750:0:24293:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038196480 00000100:00100000:2.0:1789403594.142820:0:24293:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 20 00000100:00100000:2.0:1789403594.142831:0:24293:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a276e99180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5aa3c32d-0021-4831-930f-6e88a8b78157+5:2389:x1876325038196480:12345-192.168.203.43@tcp:2:lhsmtool_posix.0 00000100:00100000:2.0:1789403594.143227:0:24293:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a276e99180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5aa3c32d-0021-4831-930f-6e88a8b78157+6:2389:x1876325038196480:12345-192.168.203.43@tcp:2:lhsmtool_posix.0 Request processed in 397us (695us total) trans 12884901891 rc 0/0 00000100:00100000:2.0:1789403594.143235:0:24293:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 20 00000100:00080000:0.0:1789403594.143849:0:22782:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789403594.146860:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:3.0:1789403594.146942:0:22789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038196736 00000100:00100000:3.0:1789403594.146952:0:22789:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038196736 00000100:00100000:3.0:1789403594.147083:0:22789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 9 00000100:00100000:3.0:1789403594.147095:0:22789:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a142500e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5aa3c32d-0021-4831-930f-6e88a8b78157+34:18738:x1876325038196736:12345-192.168.203.43@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1789403594.147304:0:22789:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a142500e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5aa3c32d-0021-4831-930f-6e88a8b78157+35:18738:x1876325038196736:12345-192.168.203.43@tcp:35:lhsmtool_posix.0 Request processed in 211us (451us total) trans 12884901910 rc 0/0 00000100:00100000:3.0:1789403594.147311:0:22789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 9 00000100:00100000:1.0:1789403594.150171:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:2.0:1789403594.150271:0:22788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038196992 00000100:00100000:2.0:1789403594.150280:0:22788:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038196992 00000100:00100000:2.0:1789403594.150340:0:22788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 58 00000100:00100000:2.0:1789403594.150351:0:22788:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a276e9b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5aa3c32d-0021-4831-930f-6e88a8b78157+35:18738:x1876325038196992:12345-192.168.203.43@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1789403594.150492:0:22788:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a276e9b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5aa3c32d-0021-4831-930f-6e88a8b78157+35:18738:x1876325038196992:12345-192.168.203.43@tcp:57:lhsmtool_posix.0 Request processed in 142us (327us total) trans 0 rc 0/0 00000100:00100000:2.0:1789403594.150499:0:22788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 58 00000100:00100000:2.0:1789403594.153892:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:3.0:1789403594.153997:0:25827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038197120 00000100:00100000:3.0:1789403594.154007:0:25827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038197120 00000100:00100000:3.0:1789403594.154062:0:25827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 59 00000100:00100000:3.0:1789403594.154072:0:25827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a142501500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5aa3c32d-0021-4831-930f-6e88a8b78157+35:18738:x1876325038197120:12345-192.168.203.43@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789403594.154091:0:25827:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789403594.154123:0:25827:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c6200/0x5fb08b1e5b762d4c lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1acb85b3eb128e45 expref: -99 pid: 25827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403594.154189:0:25827:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c6000/0x5fb08b1e5b762d53 lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 25827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403594.154203:0:25827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c6000/0x5fb08b1e5b762d53 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 25827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403594.154215:0:25827:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c6000/0x5fb08b1e5b762d53 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 25827 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789403594.154256:0:25827:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1789403594.154274:0:25827:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c6000/0x5fb08b1e5b762d53 lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 25827 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403594.154299:0:25827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c6200/0x5fb08b1e5b762d4c lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb128e45 expref: 37 pid: 25827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403594.154317:0:25827:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c6000/0x5fb08b1e5b762d53 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb128e45 expref: 36 pid: 25827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403594.154325:0:25827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff90a1434a7500) 00010000:00010000:3.0:1789403594.154328:0:25827:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1789403594.154331:0:25827:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a1425c6000, rc 0) 00000100:00100000:3.0:1789403594.154443:0:25827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a142501500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5aa3c32d-0021-4831-930f-6e88a8b78157+36:18738:x1876325038197120:12345-192.168.203.43@tcp:101:lhsmtool_posix.0 Request processed in 362us (549us total) trans 0 rc 0/0 00000100:00100000:3.0:1789403594.154450:0:25827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 59 00000100:00100000:1.0:1789403594.158334:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:2.0:1789403594.158446:0:25213:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038197248 00000100:00100000:2.0:1789403594.158455:0:25213:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038197248 00000100:00100000:2.0:1789403594.158506:0:25213:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 21 00000100:00100000:2.0:1789403594.158514:0:25213:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a276e9aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:5aa3c32d-0021-4831-930f-6e88a8b78157+6:2390:x1876325038197248:12345-192.168.203.43@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789403594.158529:0:25213:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789403594.158548:0:25213:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000cc32c499/0x5fb08b1e5b762d5a lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1acb85b3eb128e4c expref: -99 pid: 25213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789403594.158583:0:25213:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x42:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6aa821ca, blocks: 0x0 00010000:00010000:2.0:1789403594.158602:0:25213:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x42:0x0].0x0 since=640s v=(0 0) 00010000:00010000:2.0:1789403594.158607:0:25213:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789403594.158615:0:25213:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000cc32c499/0x5fb08b1e5b762d5a lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb128e4c expref: 7 pid: 25213 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403594.158921:0:25213:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000cc32c499/0x5fb08b1e5b762d5a lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb128e4c expref: 7 pid: 25213 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403594.158937:0:25213:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a259946600, rc 0) 00000100:00100000:2.0:1789403594.159005:0:25213:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a276e9aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:5aa3c32d-0021-4831-930f-6e88a8b78157+7:2390:x1876325038197248:12345-192.168.203.43@tcp:101:lhsmtool_posix.0 Request processed in 491us (679us total) trans 0 rc 0/0 00000100:00100000:2.0:1789403594.159013:0:25213:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 21 00000100:00100000:2.0:1789403594.162604:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:1.0:1789403594.163169:0:22788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038197504 00000100:00100000:1.0:1789403594.163180:0:22788:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038197504 00000100:00100000:1.0:1789403594.163291:0:22788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 60 00000100:00100000:1.0:1789403594.163303:0:22788:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a142502680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5aa3c32d-0021-4831-930f-6e88a8b78157+36:18738:x1876325038197504:12345-192.168.203.43@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1789403594.163460:0:22788:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a142502680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5aa3c32d-0021-4831-930f-6e88a8b78157+36:18738:x1876325038197504:12345-192.168.203.43@tcp:57:lhsmtool_posix.0 Request processed in 159us (864us total) trans 0 rc 0/0 00000100:00100000:1.0:1789403594.163467:0:22788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 60 00000100:00100000:2.0:1789403594.166489:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:3.0:1789403594.166607:0:25827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038197632 00000100:00100000:3.0:1789403594.166617:0:25827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038197632 00000100:00100000:3.0:1789403594.166703:0:25827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 61 00000100:00100000:3.0:1789403594.166715:0:25827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a142503100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5aa3c32d-0021-4831-930f-6e88a8b78157+36:18738:x1876325038197632:12345-192.168.203.43@tcp:44:lhsmtool_posix.0 00000001:00080000:3.0:1789403594.169283:0:22766:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 12884901910 is committed 00000004:00080000:3.0:1789403594.169299:0:22766:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2 committed 00000001:00080000:3.0:1789403594.169347:0:22766:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 12884901895 is committed 00000100:00100000:3.0:1789403594.169534:0:25827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a142503100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5aa3c32d-0021-4831-930f-6e88a8b78157+19:18738:x1876325038197632:12345-192.168.203.43@tcp:44:lhsmtool_posix.0 Request processed in 2816us (3047us total) trans 0 rc 0/0 00000100:00100000:3.0:1789403594.169545:0:25827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 61 00010000:00010000:2.0:1789403594.169841:0:3613:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90a270184000/0x5fb08b1e5b762ba1 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403594.169853:0:3613:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a270184000/0x5fb08b1e5b762ba1 lrc: 2/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 22787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403594.169861:0:3613:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90a270184000/0x5fb08b1e5b762ba1 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 22787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403594.169868:0:3613:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a270184000 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:2.0:1789403594.169872:0:3613:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a270184000/0x5fb08b1e5b762ba1 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 22787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403594.169886:0:3613:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a270184000/0x5fb08b1e5b762ba1 lrc: 4/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 22787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403594.169902:0:3613:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff90a142629000) 00010000:00010000:2.0:1789403594.169904:0:3613:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00010000:00010000:2.0:1789403594.169920:0:3613:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90a270184000/0x5fb08b1e5b762ba1 lrc: 2/0,0 mode: --/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 22787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403594.169926:0:3613:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a270184000/0x5fb08b1e5b762ba1 lrc: 0/0,0 mode: --/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 22787 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789403594.172441:0:3629:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1789403594.172461:0:3629:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a246f3c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3629:1876325050873728:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1789403594.172520:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789403594.172639:0:24292:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050873728 00000100:00100000:0.0:1789403594.172646:0:24292:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050873728 00000100:00100000:0.0:1789403594.172700:0:24292:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1789403594.172710:0:24292:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a142500380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3629:x1876325050873728:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1789403594.172850:0:24292:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x42:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1789403594.172854:0:24292:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x42:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:0.0:1789403594.172857:0:24292:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x42:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1789403594.172859:0:24292:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x42:0x0] updating lvb ctime from disk: 1789403594 -> 1789403594 00002000:00010000:0.0:1789403594.172861:0:24292:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x42:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:0.0:1789403594.172900:0:24292:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a142500380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3629:x1876325050873728:12345-0@lo:2:osp-syn-1-0.0 Request processed in 191us (379us total) trans 12884901892 rc 0/0 00000100:00100000:0.0:1789403594.172917:0:24292:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00080000:2.0:1789403594.173134:0:22782:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000004:00080000:2.0:1789403594.173168:0:3629:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff90a246f3c000/2, rc 0, transno 12884901892 00000100:00100000:2.0:1789403594.173175:0:3629:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a246f3c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3629:1876325050873728:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1789403594.173469:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:3.0:1789403594.173584:0:24293:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038197760 00000100:00100000:3.0:1789403594.173590:0:24293:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038197760 00000100:00100000:3.0:1789403594.173636:0:24293:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 23 00000100:00100000:3.0:1789403594.173645:0:24293:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a142503800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5aa3c32d-0021-4831-930f-6e88a8b78157+7:2389:x1876325038197760:12345-192.168.203.43@tcp:16:lhsmtool_posix.0 00000100:00100000:3.0:1789403594.173721:0:24293:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a142503800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5aa3c32d-0021-4831-930f-6e88a8b78157+7:2389:x1876325038197760:12345-192.168.203.43@tcp:16:lhsmtool_posix.0 Request processed in 76us (252us total) trans 0 rc 0/0 00000100:00100000:3.0:1789403594.173738:0:24293:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 23 00010000:00010000:1.0:1789403594.176372:0:3612:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90a281b05400/0x5fb08b1e5b762b4d lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403594.176411:0:3612:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a281b05400/0x5fb08b1e5b762b4d lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 22788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403594.176419:0:3612:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90a281b05400/0x5fb08b1e5b762b4d lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403594.176425:0:3612:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a281b05400 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:1.0:1789403594.176429:0:3612:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a281b05400/0x5fb08b1e5b762b4d lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403594.176446:0:3612:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a281b05400/0x5fb08b1e5b762b4d lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 22788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403594.176480:0:3612:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xa6028a67 (ffff90a142629800) 00010000:00010000:1.0:1789403594.176483:0:3612:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789403594.176489:0:3612:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90a281b05400/0x5fb08b1e5b762b4d lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403594.176496:0:3612:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a281b05400/0x5fb08b1e5b762b4d lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xa6028a67 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403594.176520:0:3612:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90a281b05800/0x5fb08b1e5b762b54 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 22788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403594.176526:0:3612:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a281b05800/0x5fb08b1e5b762b54 lrc: 2/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 22788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403594.176531:0:3612:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90a281b05800/0x5fb08b1e5b762b54 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 22788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403594.176536:0:3612:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a281b05800 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:1.0:1789403594.176539:0:3612:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a281b05800/0x5fb08b1e5b762b54 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 22788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403594.176545:0:3612:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a281b05800/0x5fb08b1e5b762b54 lrc: 4/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 22788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403594.176552:0:3612:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0x0 (ffff90a142629000) 00010000:00010000:1.0:1789403594.176554:0:3612:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789403594.176558:0:3612:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90a281b05800/0x5fb08b1e5b762b54 lrc: 2/0,0 mode: --/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 22788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403594.176563:0:3612:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a281b05800/0x5fb08b1e5b762b54 lrc: 0/0,0 mode: --/TXN res: [0x2000013a1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 22788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403594.176591:0:3612:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90a270185800/0x5fb08b1e5b762c03 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 22787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403594.176597:0:3612:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a270185800/0x5fb08b1e5b762c03 lrc: 2/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 22787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403594.176602:0:3612:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90a270185800/0x5fb08b1e5b762c03 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403594.176607:0:3612:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a270185800 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:1.0:1789403594.176609:0:3612:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a270185800/0x5fb08b1e5b762c03 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 22787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403594.176614:0:3612:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a270185800/0x5fb08b1e5b762c03 lrc: 4/0,0 mode: TXN/TXN res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 22787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403594.176621:0:3612:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x1:0x0].0xb42112bc (ffff90a142163300) 00010000:00010000:1.0:1789403594.176623:0:3612:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789403594.176626:0:3612:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90a270185800/0x5fb08b1e5b762c03 lrc: 2/0,0 mode: --/TXN res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403594.176837:0:3612:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a270185800/0x5fb08b1e5b762c03 lrc: 0/0,0 mode: --/TXN res: [0x2000013a1:0x1:0x0].0xb42112bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 22787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403594.176855:0:3612:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90a270185c00/0x5fb08b1e5b762cc7 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 22787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403594.176861:0:3612:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a270185c00/0x5fb08b1e5b762cc7 lrc: 2/0,0 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 22787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403594.176867:0:3612:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90a270185c00/0x5fb08b1e5b762cc7 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 22787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403594.176879:0:3612:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a270185c00 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:1.0:1789403594.176882:0:3612:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a270185c00/0x5fb08b1e5b762cc7 lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 22787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403594.176888:0:3612:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a270185c00/0x5fb08b1e5b762cc7 lrc: 4/0,0 mode: TXN/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 22787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403594.176897:0:3612:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff90a142163600) 00010000:00010000:1.0:1789403594.176899:0:3612:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789403594.176902:0:3612:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90a270185c00/0x5fb08b1e5b762cc7 lrc: 2/0,0 mode: --/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 22787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403594.176919:0:3612:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a270185c00/0x5fb08b1e5b762cc7 lrc: 0/0,0 mode: --/TXN res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 22787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403594.176931:0:3612:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff90a270185a00/0x5fb08b1e5b762d3e lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403594.176937:0:3612:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a270185a00/0x5fb08b1e5b762d3e lrc: 2/0,0 mode: TXN/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 22786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403594.176943:0:3612:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90a270185a00/0x5fb08b1e5b762d3e lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403594.176948:0:3612:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a270185a00 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:1.0:1789403594.176951:0:3612:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a270185a00/0x5fb08b1e5b762d3e lrc: 3/0,0 mode: TXN/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 22786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403594.177063:0:3612:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a270185a00/0x5fb08b1e5b762d3e lrc: 4/0,0 mode: TXN/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 22786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403594.177083:0:3612:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff90a1434a7500) 00010000:00010000:1.0:1789403594.177085:0:3612:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1789403594.177089:0:3612:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90a270185a00/0x5fb08b1e5b762d3e lrc: 2/0,0 mode: --/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403594.177095:0:3612:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a270185a00/0x5fb08b1e5b762d3e lrc: 0/0,0 mode: --/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 22786 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789403594.178316:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:0.0:1789403594.178739:0:22786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038198016 00000100:00100000:0.0:1789403594.178749:0:22786:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038198016 00000100:00100000:0.0:1789403594.178807:0:22786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 62 00000100:00100000:0.0:1789403594.178817:0:22786:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a144465f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5aa3c32d-0021-4831-930f-6e88a8b78157+15:18738:x1876325038198016:12345-192.168.203.43@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1789403594.178865:0:22786:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789403594.178888:0:22786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c6000/0x5fb08b1e5b762d53 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb128e45 expref: 15 pid: 25827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403594.178904:0:22786:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff90a1434a7500) 00010000:00010000:0.0:1789403594.178918:0:22786:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789403594.178948:0:22786:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90a2821e9200/0x5fb08b1e5b762d61 lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 22786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403594.178968:0:22786:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a2821e9200/0x5fb08b1e5b762d61 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403594.178978:0:22786:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a2821e9200/0x5fb08b1e5b762d61 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22786 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789403594.179102:0:22786:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000001299d5f3 reply state 00000000c256ff95 transno 12884901911 ns: mdt-lustre-MDT0000_UUID lock: ffff90a2821e9200/0x5fb08b1e5b762d61 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403594.179128:0:22786:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a2821e9200/0x5fb08b1e5b762d61 lrc: 3/0,1 mode: TXN/TXN res: [0x2000013a1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403594.179133:0:22786:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff90a1434a7500) 00010000:00010000:0.0:1789403594.179135:0:22786:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1789403594.179137:0:22786:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1789403594.179240:0:22786:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a144465f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5aa3c32d-0021-4831-930f-6e88a8b78157+16:18738:x1876325038198016:12345-192.168.203.43@tcp:36:lhsmtool_posix.0 Request processed in 423us (930us total) trans 12884901911 rc 0/0 00000100:00100000:0.0:1789403594.179247:0:22786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 62 00000100:00100000:3.0:1789403594.185716:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:2.0:1789403594.185919:0:25213:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038198144 00000100:00100000:2.0:1789403594.185929:0:25213:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038198144 00000100:00100000:2.0:1789403594.186056:0:25213:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 24 00000100:00100000:2.0:1789403594.186068:0:25213:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a144466300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:5aa3c32d-0021-4831-930f-6e88a8b78157+7:18738:x1876325038198144:12345-192.168.203.43@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789403594.186088:0:25213:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789403594.186106:0:25213:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005b450484/0x5fb08b1e5b762d68 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1acb85b3eb128e53 expref: -99 pid: 25213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403594.186137:0:25213:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000cc32c499/0x5fb08b1e5b762d5a lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb128e4c expref: 8 pid: 25213 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403594.186160:0:25213:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789403594.186164:0:25213:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789403594.186170:0:25213:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005b450484/0x5fb08b1e5b762d68 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb128e53 expref: 8 pid: 25213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403594.186204:0:25213:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000cc32c499/0x5fb08b1e5b762d5a lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb128e4c expref: 8 pid: 25213 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403594.186219:0:25213:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000cc32c499/0x5fb08b1e5b762d5a lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb128e4c expref: 8 pid: 25213 timeout: 740 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789403594.186233:0:25213:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a142500a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:25213:1876325050873856:192.168.203.43@tcp:104: 00000100:00100000:2.0:1789403594.186316:0:25213:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a25ecdf300 going to sleep for 11 seconds 00000100:00100000:2.0:1789403594.190262:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:1.0:1789403594.190342:0:22773:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038198272 00000100:00100000:1.0:1789403594.190351:0:22773:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038198272 00010000:00010000:1.0:1789403594.190386:0:22773:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000cc32c499/0x5fb08b1e5b762d5a lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb128e4c expref: 9 pid: 25213 timeout: 740 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789403594.190453:0:22773:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 19 00000100:00100000:1.0:1789403594.190462:0:22773:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a142500700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5aa3c32d-0021-4831-930f-6e88a8b78157+9:2389:x1876325038198272:12345-192.168.203.43@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789403594.190476:0:22773:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789403594.190495:0:22773:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000cc32c499/0x5fb08b1e5b762d5a lrc: 5/0,0 mode: PR/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb128e4c expref: 9 pid: 25213 timeout: 740 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403594.190508:0:22773:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000cc32c499/0x5fb08b1e5b762d5a lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb128e4c expref: 9 pid: 25213 timeout: 740 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403594.190531:0:22773:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789403594.190535:0:22773:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789403594.190543:0:22773:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000005b450484/0x5fb08b1e5b762d68 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50080000000000 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb128e53 expref: 9 pid: 25213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403594.190571:0:22773:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005b450484/0x5fb08b1e5b762d68 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50080000000000 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb128e53 expref: 9 pid: 25213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403594.190607:0:22773:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000005b450484/0x5fb08b1e5b762d68 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb128e53 expref: 9 pid: 25213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789403594.190621:0:22773:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a276e99500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:22773:1876325050873984:192.168.203.43@tcp:105: 00000100:00100000:1.0:1789403594.190815:0:22773:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a1426303c0 going to sleep for 11 seconds 00010000:00010000:0.0:1789403594.191318:0:25213:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000cc32c499/0x5fb08b1e5b762d5a lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb128e4c expref: 9 pid: 25213 timeout: 740 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789403594.191335:0:25213:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a142500a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:25213:1876325050873856:192.168.203.43@tcp:104: 00010000:00010000:0.0:1789403594.191358:0:25213:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000005b450484/0x5fb08b1e5b762d68 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb128e53 expref: 8 pid: 25213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403594.191369:0:25213:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a259947400, rc 0) 00000100:00100000:0.0:1789403594.191467:0:25213:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a144466300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:5aa3c32d-0021-4831-930f-6e88a8b78157+8:18738:x1876325038198144:12345-192.168.203.43@tcp:101:lhsmtool_posix.0 Request processed in 5401us (5760us total) trans 0 rc 0/0 00000100:00100000:0.0:1789403594.191475:0:25213:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 24 00000100:00100000:1.0:1789403594.196332:0:22773:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a276e99500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:22773:1876325050873984:192.168.203.43@tcp:105: 00010000:00010000:1.0:1789403594.196359:0:22773:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789403594.196447:0:22773:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a142500700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5aa3c32d-0021-4831-930f-6e88a8b78157+7:2389:x1876325038198272:12345-192.168.203.43@tcp:103:ldlm_bl.0 Request processed in 5985us (6193us total) trans 0 rc 0/0 00000100:00100000:1.0:1789403594.196458:0:22773:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 19 00000100:00100000:2.0:1789403594.197359:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:0.0:1789403594.198372:0:24926:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038198400 00000100:00100000:0.0:1789403594.198383:0:24926:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038198400 00000100:00100000:0.0:1789403594.198594:0:24926:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 25 00000100:00100000:0.0:1789403594.198605:0:24926:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a142500a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:5aa3c32d-0021-4831-930f-6e88a8b78157+7:2389:x1876325038198400:12345-192.168.203.43@tcp:2:lhsmtool_posix.0 00002000:00010000:0.0:1789403594.198835:0:24926:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x42:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1789403594.198850:0:24926:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x42:0x0] updating lvb mtime from disk: 0 -> 1789403593 00002000:00010000:0.0:1789403594.198853:0:24926:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x42:0x0] updating lvb atime from disk: 0 -> 1789403592 00002000:00010000:0.0:1789403594.198854:0:24926:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x42:0x0] updating lvb ctime from disk: 1789403594 -> 1789403593 00002000:00010000:0.0:1789403594.198856:0:24926:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x42:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:0.0:1789403594.198925:0:24926:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a142500a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:5aa3c32d-0021-4831-930f-6e88a8b78157+8:2389:x1876325038198400:12345-192.168.203.43@tcp:2:lhsmtool_posix.0 Request processed in 322us (1568us total) trans 12884901893 rc 0/0 00000100:00100000:0.0:1789403594.198932:0:24926:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 25 00000100:00100000:3.0:1789403594.201855:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:2.0:1789403594.202112:0:24290:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038198528 00000100:00100000:2.0:1789403594.202123:0:24290:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038198528 00000100:00100000:2.0:1789403594.202187:0:24290:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 26 00000100:00100000:2.0:1789403594.202198:0:24290:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a144464380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5aa3c32d-0021-4831-930f-6e88a8b78157+8:2390:x1876325038198528:12345-192.168.203.43@tcp:1:lhsmtool_posix.0 00010000:00010000:2.0:1789403594.202242:0:24290:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000eefe2e87/0x5fb08b1e5b762d6f lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24290 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403594.202265:0:24290:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000005b450484/0x5fb08b1e5b762d68 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb128e53 expref: 8 pid: 25213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403594.202293:0:24290:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789403594.202298:0:24290:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x42:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1789403594.202302:0:24290:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000eefe2e87/0x5fb08b1e5b762d6f lrc: 4/1,0 mode: --/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 24290 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403594.202339:0:24290:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000005b450484/0x5fb08b1e5b762d68 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000020020 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb128e53 expref: 8 pid: 25213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403594.202353:0:24290:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000005b450484/0x5fb08b1e5b762d68 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400020020 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb128e53 expref: 8 pid: 25213 timeout: 740 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789403594.202367:0:24290:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a144183b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:24290:1876325050874112:192.168.203.43@tcp:104: 00000100:00100000:2.0:1789403594.202486:0:24290:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a25ecdf300 going to sleep for 11 seconds 00000100:00100000:2.0:1789403594.206177:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:0.0:1789403594.206288:0:24290:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a144183b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:24290:1876325050874112:192.168.203.43@tcp:104: 00010000:00010000:0.0:1789403594.206313:0:24290:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000eefe2e87/0x5fb08b1e5b762d6f lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 24290 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789403594.207223:0:22771:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038198656 00000100:00100000:3.0:1789403594.207233:0:22771:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038198656 00010000:00010000:3.0:1789403594.207274:0:22771:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000005b450484/0x5fb08b1e5b762d68 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb128e53 expref: 9 pid: 25213 timeout: 740 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789403594.207315:0:22771:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 20 00000100:00100000:3.0:1789403594.207324:0:22771:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a1443fd180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5aa3c32d-0021-4831-930f-6e88a8b78157+9:2389:x1876325038198656:12345-192.168.203.43@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789403594.207340:0:22771:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789403594.207374:0:22771:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000005b450484/0x5fb08b1e5b762d68 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb128e53 expref: 9 pid: 25213 timeout: 740 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403594.207404:0:22771:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000005b450484/0x5fb08b1e5b762d68 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400020020 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb128e53 expref: 9 pid: 25213 timeout: 740 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403594.207537:0:22771:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005b450484/0x5fb08b1e5b762d68 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400020020 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb128e53 expref: 9 pid: 25213 timeout: 740 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403594.207557:0:22771:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x42:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1789403594.207562:0:22771:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x42:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1789403594.207567:0:22771:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000eefe2e87/0x5fb08b1e5b762d6f lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 24290 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403594.207577:0:22771:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000eefe2e87/0x5fb08b1e5b762d6f lrc: 4/1,0 mode: PR/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 24290 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403594.207611:0:22771:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789403594.207680:0:22771:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a1443fd180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5aa3c32d-0021-4831-930f-6e88a8b78157+8:2389:x1876325038198656:12345-192.168.203.43@tcp:103:ldlm_bl.0 Request processed in 356us (1511us total) trans 0 rc 0/0 00000100:00100000:3.0:1789403594.207689:0:22771:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 20 00010000:00010000:0.0:1789403594.208342:0:24290:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000eefe2e87/0x5fb08b1e5b762d6f lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 24290 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403594.208354:0:24290:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000eefe2e87/0x5fb08b1e5b762d6f lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 24290 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403594.208377:0:24290:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000eefe2e87/0x5fb08b1e5b762d6f lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 24290 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403594.208385:0:24290:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000eefe2e87/0x5fb08b1e5b762d6f lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 24290 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403594.208419:0:24290:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000eefe2e87/0x5fb08b1e5b762d6f lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 24290 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403594.208567:0:24290:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a270185800 already unused, calling callback (ffffffffc0c0b8b0) 00010000:00010000:0.0:1789403594.208572:0:24290:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000eefe2e87/0x5fb08b1e5b762d6f lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 24290 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403594.208580:0:24290:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000eefe2e87/0x5fb08b1e5b762d6f lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 24290 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403594.208595:0:24290:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000eefe2e87/0x5fb08b1e5b762d6f lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 24290 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403594.208602:0:24290:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000eefe2e87/0x5fb08b1e5b762d6f lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 24290 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789403594.208796:0:24290:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a144464380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:5aa3c32d-0021-4831-930f-6e88a8b78157+7:2390:x1876325038198528:12345-192.168.203.43@tcp:1:lhsmtool_posix.0 Request processed in 6598us (6946us total) trans 0 rc 0/0 00000100:00100000:0.0:1789403594.208805:0:24290:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 26 00000100:00100000:2.0:1789403594.216580:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:1.0:1789403594.216669:0:22788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038198912 00000100:00100000:1.0:1789403594.216680:0:22788:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038198912 00000100:00100000:1.0:1789403594.216748:0:22788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 63 00000100:00100000:1.0:1789403594.216759:0:22788:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a1443fc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5aa3c32d-0021-4831-930f-6e88a8b78157+16:18738:x1876325038198912:12345-192.168.203.43@tcp:57:lhsmtool_posix.0 00010000:00010000:1.0:1789403594.216843:0:22788:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90a281b05400/0x5fb08b1e5b762d76 lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 22788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403594.216862:0:22788:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90a270184c00/0x5fb08b1e5b762cc0 lrc: 2/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb128e14 expref: 16 pid: 22788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403594.216872:0:22788:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a281b05400/0x5fb08b1e5b762d76 lrc: 4/0,1 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 22788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403594.216931:0:22788:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90a270184c00/0x5fb08b1e5b762cc0 lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb128e14 expref: 16 pid: 22788 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403594.216945:0:22788:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90a270184c00/0x5fb08b1e5b762cc0 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb128e14 expref: 16 pid: 22788 timeout: 740 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789403594.217113:0:22788:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a276e99500 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:22788:1876325050874240:192.168.203.43@tcp:104: 00000100:00100000:1.0:1789403594.217196:0:22788:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a1426303c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789403594.220860:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:3.0:1789403594.220940:0:22772:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038199040 00000100:00100000:3.0:1789403594.220949:0:22772:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038199040 00010000:00010000:3.0:1789403594.221099:0:22772:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a270184c00/0x5fb08b1e5b762cc0 lrc: 5/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb128e14 expref: 17 pid: 22788 timeout: 740 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789403594.221144:0:22772:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 21 00000100:00100000:3.0:1789403594.221167:0:22772:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a1443fd500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5aa3c32d-0021-4831-930f-6e88a8b78157+17:2389:x1876325038199040:12345-192.168.203.43@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789403594.221181:0:22772:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789403594.221188:0:22772:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90a270184c00/0x5fb08b1e5b762cc0 lrc: 5/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb128e14 expref: 17 pid: 22788 timeout: 740 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403594.221201:0:22772:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90a270184c00/0x5fb08b1e5b762cc0 lrc: 4/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb128e14 expref: 17 pid: 22788 timeout: 740 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403594.221222:0:22772:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff90a142163600) 00010000:00010000:3.0:1789403594.221229:0:22772:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff90a2821e8000/0x5fb08b1e5b762cdc lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb128e22 expref: 17 pid: 22786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403594.221239:0:22772:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff90a281b05400/0x5fb08b1e5b762d76 lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 22788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403594.221247:0:22772:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90a281b05400/0x5fb08b1e5b762d76 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT flags: 0x50290000000000 pid: 22788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403594.221255:0:22772:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a281b05400/0x5fb08b1e5b762d76 lrc: 4/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT flags: 0x50290000000000 pid: 22788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403594.221274:0:22772:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789403594.221371:0:22772:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a1443fd500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5aa3c32d-0021-4831-930f-6e88a8b78157+17:2389:x1876325038199040:12345-192.168.203.43@tcp:103:ldlm_bl.0 Request processed in 205us (518us total) trans 0 rc 0/0 00000100:00100000:3.0:1789403594.221379:0:22772:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 21 00010000:00010000:1.0:1789403594.221694:0:22788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a270184c00/0x5fb08b1e5b762cc0 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb128e14 expref: 16 pid: 22788 timeout: 740 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789403594.221714:0:22788:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a276e99500 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:22788:1876325050874240:192.168.203.43@tcp:104: 00010000:00010000:1.0:1789403594.221746:0:22788:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90a281b05400/0x5fb08b1e5b762d76 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403594.221755:0:22788:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90a281b05400/0x5fb08b1e5b762d76 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403594.221762:0:22788:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a281b05400/0x5fb08b1e5b762d76 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403594.222082:0:22788:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90a281b05800/0x5fb08b1e5b762d7d lrc: 3/0,1 mode: --/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 22788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403594.222095:0:22788:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c6600/0x5fb08b1e5b762d45 lrc: 2/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb128e3e expref: 16 pid: 25827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403594.222102:0:22788:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a281b05800/0x5fb08b1e5b762d7d lrc: 4/0,1 mode: --/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 22788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403594.222139:0:22788:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c6600/0x5fb08b1e5b762d45 lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb128e3e expref: 16 pid: 25827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403594.222153:0:22788:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c6600/0x5fb08b1e5b762d45 lrc: 4/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb128e3e expref: 16 pid: 25827 timeout: 740 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789403594.222167:0:22788:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a276e99500 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:22788:1876325050874368:192.168.203.43@tcp:104: 00000100:00100000:1.0:1789403594.222225:0:22788:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a142630c00 going to sleep for 11 seconds 00000100:00100000:0.0:1789403594.227211:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:2.0:1789403594.228121:0:23939:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038199168 00000100:00100000:2.0:1789403594.228132:0:23939:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038199168 00010000:00010000:2.0:1789403594.228175:0:23939:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c6600/0x5fb08b1e5b762d45 lrc: 5/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb128e3e expref: 17 pid: 25827 timeout: 740 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789403594.228218:0:23939:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 22 00000100:00100000:2.0:1789403594.228228:0:23939:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a246f3df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5aa3c32d-0021-4831-930f-6e88a8b78157+17:2390:x1876325038199168:12345-192.168.203.43@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789403594.228243:0:23939:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789403594.228268:0:23939:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c6600/0x5fb08b1e5b762d45 lrc: 5/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb128e3e expref: 17 pid: 25827 timeout: 740 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403594.228281:0:23939:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c6600/0x5fb08b1e5b762d45 lrc: 4/0,0 mode: CR/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb128e3e expref: 17 pid: 25827 timeout: 740 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403594.228303:0:23939:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff90a1434a7500) 00010000:00010000:2.0:1789403594.228309:0:23939:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff90a281b05800/0x5fb08b1e5b762d7d lrc: 3/0,1 mode: --/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 22788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403594.228318:0:23939:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90a281b05800/0x5fb08b1e5b762d7d lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 22788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403594.228326:0:23939:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a281b05800/0x5fb08b1e5b762d7d lrc: 4/0,1 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 22788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403594.228345:0:23939:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789403594.228427:0:23939:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a246f3df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5aa3c32d-0021-4831-930f-6e88a8b78157+17:2390:x1876325038199168:12345-192.168.203.43@tcp:103:ldlm_bl.0 Request processed in 199us (1226us total) trans 0 rc 0/0 00000100:00100000:2.0:1789403594.228446:0:23939:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 22 00010000:00010000:1.0:1789403594.230419:0:22788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c6600/0x5fb08b1e5b762d45 lrc: 0/0,0 mode: --/CR res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb128e3e expref: 16 pid: 25827 timeout: 740 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789403594.230454:0:22788:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a276e99500 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:22788:1876325050874368:192.168.203.43@tcp:104: 00010000:00010000:1.0:1789403594.230479:0:22788:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90a281b05800/0x5fb08b1e5b762d7d lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403594.230489:0:22788:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90a281b05800/0x5fb08b1e5b762d7d lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403594.230494:0:22788:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a281b05800/0x5fb08b1e5b762d7d lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 22788 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789403594.230625:0:22788:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901912 00000001:00080000:1.0:1789403594.230752:0:22788:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901913 00000001:00080000:1.0:1789403594.230787:0:22788:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901914 00000100:00100000:1.0:1789403594.230864:0:22788:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a276e99500 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:22788:1876325050874496:0@lo:1000:mdt00_002.0 00000100:00100000:1.0:1789403594.230930:0:22788:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789403594.231025:0:22788:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a142630900 going to sleep for 11 seconds 00000100:00100000:0.0:1789403594.231289:0:22791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050874496 00000100:00100000:0.0:1789403594.231296:0:22791:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050874496 00000100:00100000:0.0:1789403594.231347:0:22791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1789403594.231356:0:22791:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a276e9bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:22788:x1876325050874496:12345-0@lo:1000:mdt00_002.0 00000100:00100000:0.0:1789403594.231489:0:22791:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a276e9bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:22788:x1876325050874496:12345-0@lo:1000:mdt00_002.0 Request processed in 133us (557us total) trans 0 rc 0/0 00000100:00100000:0.0:1789403594.231497:0:22791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1789403594.231651:0:22788:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a276e99500 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:22788:1876325050874496:0@lo:1000:mdt00_002.0 00000001:00080000:3.0:1789403594.231815:0:22788:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901915 00000100:00100000:3.0:1789403594.231866:0:22788:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a144464a80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:22788:1876325050874624:0@lo:1000:mdt00_002.0 00000100:00100000:3.0:1789403594.232097:0:22788:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789403594.232129:0:22788:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a141b50b40 going to sleep for 11 seconds 00000100:00100000:0.0:1789403594.232195:0:24931:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050874624 00000100:00100000:0.0:1789403594.232201:0:24931:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050874624 00000100:00100000:0.0:1789403594.232238:0:24931:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1789403594.232246:0:24931:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a144467b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:22788:x1876325050874624:12345-0@lo:1000:mdt00_002.0 00000100:00100000:0.0:1789403594.232356:0:24931:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a144467b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+7:22788:x1876325050874624:12345-0@lo:1000:mdt00_002.0 Request processed in 111us (449us total) trans 12884901894 rc 0/0 00000100:00100000:0.0:1789403594.232362:0:24931:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1789403594.232671:0:22788:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a144464a80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:22788:1876325050874624:0@lo:1000:mdt00_002.0 00010000:00010000:3.0:1789403594.232708:0:22788:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90a281b05800/0x5fb08b1e5b762d7d lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 22788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403594.232718:0:22788:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a281b05800/0x5fb08b1e5b762d7d lrc: 2/0,0 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 22788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403594.232737:0:22788:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90a281b05800/0x5fb08b1e5b762d7d lrc: 3/0,0 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 22788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403594.232743:0:22788:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a281b05800 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:3.0:1789403594.232748:0:22788:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a281b05800/0x5fb08b1e5b762d7d lrc: 3/0,0 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 22788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403594.232756:0:22788:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a281b05800/0x5fb08b1e5b762d7d lrc: 4/0,0 mode: EX/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 22788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403594.232770:0:22788:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff90a1434a7500) 00010000:00010000:3.0:1789403594.232773:0:22788:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1789403594.232778:0:22788:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90a281b05800/0x5fb08b1e5b762d7d lrc: 2/0,0 mode: --/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 22788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403594.232783:0:22788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a281b05800/0x5fb08b1e5b762d7d lrc: 0/0,0 mode: --/EX res: [0x2000013a1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 22788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403594.232817:0:22788:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90a2821e9e00/0x5fb08b1e5b762cd5 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 22787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403594.232824:0:22788:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a2821e9e00/0x5fb08b1e5b762cd5 lrc: 2/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 22787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403594.232842:0:22788:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90a2821e9e00/0x5fb08b1e5b762cd5 lrc: 3/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 22787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403594.232847:0:22788:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a2821e9e00 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:3.0:1789403594.232850:0:22788:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a2821e9e00/0x5fb08b1e5b762cd5 lrc: 3/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 22787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403594.232856:0:22788:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a2821e9e00/0x5fb08b1e5b762cd5 lrc: 4/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 22787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403594.232864:0:22788:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff90a142163600) 00010000:00010000:3.0:1789403594.232867:0:22788:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1789403594.232875:0:22788:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff90a2821e8000/0x5fb08b1e5b762cdc lrc: 2/0,0 mode: --/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb128e22 expref: 19 pid: 22786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403594.232886:0:22788:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90a2821e8000/0x5fb08b1e5b762cdc lrc: 2/0,0 mode: CR/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb128e22 expref: 19 pid: 22786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403594.232895:0:22788:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a2821e8000/0x5fb08b1e5b762cdc lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb128e22 expref: 19 pid: 22786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403594.233080:0:22788:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff90a2821e8000/0x5fb08b1e5b762cdc lrc: 3/0,0 mode: CR/CR res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb128e22 expref: 19 pid: 22786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789403594.233096:0:22788:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a144467100 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:22788:1876325050874752:192.168.203.43@tcp:105: 00000100:00100000:3.0:1789403594.233200:0:22788:0:(client.c:2716:ptlrpc_set_wait()) set ffff90a141b50e40 going to sleep for 11 seconds 00000100:00100000:0.0:1789403594.237321:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:1.0:1789403594.237455:0:22789:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038199296 00000100:00100000:1.0:1789403594.237465:0:22789:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038199296 00000100:00100000:1.0:1789403594.237511:0:22789:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 10 00000100:00100000:1.0:1789403594.237521:0:22789:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a143538450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5aa3c32d-0021-4831-930f-6e88a8b78157+20:18737:x1876325038199296:12345-192.168.203.43@tcp:49:dd.0 00000100:00100000:1.0:1789403594.237805:0:22789:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a143538450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:5aa3c32d-0021-4831-930f-6e88a8b78157+20:18737:x1876325038199296:12345-192.168.203.43@tcp:49:dd.0 Request processed in 285us (491us total) trans 0 rc 0/0 00000100:00100000:1.0:1789403594.237813:0:22789:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 10 00000100:00100000:3.0:1789403594.244565:0:22788:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a144467100 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:22788:1876325050874752:192.168.203.43@tcp:105: 00010000:00010000:3.0:1789403594.244612:0:22788:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90a2821e9e00/0x5fb08b1e5b762cd5 lrc: 2/0,0 mode: --/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 22787 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403594.244624:0:22788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a2821e9e00/0x5fb08b1e5b762cd5 lrc: 0/0,0 mode: --/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 22787 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789403594.244842:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:3.0:1789403594.244923:0:22786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038199424 00000100:00100000:3.0:1789403594.244931:0:22786:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038199424 00000100:00100000:3.0:1789403594.245102:0:22786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 64 00000100:00100000:3.0:1789403594.245113:0:22786:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a276e9b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5aa3c32d-0021-4831-930f-6e88a8b78157+20:18737:x1876325038199424:12345-192.168.203.43@tcp:101:dd.0 00010000:00010000:3.0:1789403594.245133:0:22786:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789403594.245149:0:22786:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c6200/0x5fb08b1e5b762d84 lrc: 2/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1acb85b3eb128e5a expref: -99 pid: 22786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403594.245178:0:22786:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c6400/0x5fb08b1e5b762d8b lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 22786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403594.245191:0:22786:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90a281b05400/0x5fb08b1e5b762d76 lrc: 2/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 22788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403594.245199:0:22786:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c6400/0x5fb08b1e5b762d8b lrc: 4/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 22786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403594.245214:0:22786:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff90a281b05400/0x5fb08b1e5b762d76 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT flags: 0x40210400000020 pid: 22788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403594.245224:0:22786:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c6400/0x5fb08b1e5b762d8b lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 22786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403594.245318:0:22788:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90a270185800/0x5fb08b1e5b762d92 lrc: 3/0,1 mode: --/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 22788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403594.245329:0:22788:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a270185800/0x5fb08b1e5b762d92 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 22788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403594.245339:0:22788:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a270185800/0x5fb08b1e5b762d92 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 22788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403594.245350:0:22788:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff90a270185800/0x5fb08b1e5b762d92 lrc: 3/0,1 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 22788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403594.245369:0:22788:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a270185800/0x5fb08b1e5b762d92 lrc: 2/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 22788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403594.245375:0:22788:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90a270185800/0x5fb08b1e5b762d92 lrc: 3/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 22788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403594.245380:0:22788:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a270185800 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:2.0:1789403594.245383:0:22788:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a270185800/0x5fb08b1e5b762d92 lrc: 3/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 22788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403594.245415:0:22788:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a270185800/0x5fb08b1e5b762d92 lrc: 4/0,0 mode: EX/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 22788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403594.245426:0:22788:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff90a142163600) 00010000:00010000:2.0:1789403594.245429:0:22788:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789403594.245442:0:22788:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90a270185800/0x5fb08b1e5b762d92 lrc: 2/0,0 mode: --/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 22788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403594.245447:0:22788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a270185800/0x5fb08b1e5b762d92 lrc: 0/0,0 mode: --/EX res: [0x2000013a1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 22788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403594.245458:0:22788:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90a281b05400/0x5fb08b1e5b762d76 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210400000020 pid: 22788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403594.245464:0:22788:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a281b05400/0x5fb08b1e5b762d76 lrc: 2/0,0 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210400000020 pid: 22788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403594.245468:0:22788:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90a281b05400/0x5fb08b1e5b762d76 lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 22788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403594.245472:0:22788:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a281b05400 already unused, calling callback (ffffffffc181e4f0) 00010000:00010000:2.0:1789403594.245482:0:22788:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a281b05400/0x5fb08b1e5b762d76 lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 22788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403594.245488:0:22788:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a281b05400/0x5fb08b1e5b762d76 lrc: 4/0,0 mode: PW/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40218400000020 pid: 22788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403594.245496:0:22788:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff90a142163600) 00010000:00010000:2.0:1789403594.245498:0:22788:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1789403594.245501:0:22788:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c6400/0x5fb08b1e5b762d8b lrc: 3/1,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 22786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403594.245508:0:22788:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c6400/0x5fb08b1e5b762d8b lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 22786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403594.245513:0:22788:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c6400/0x5fb08b1e5b762d8b lrc: 4/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 22786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403594.245533:0:22788:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90a281b05400/0x5fb08b1e5b762d76 lrc: 2/0,0 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x44a19400000020 pid: 22788 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403594.245539:0:22788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a281b05400/0x5fb08b1e5b762d76 lrc: 0/0,0 mode: --/PW res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x44a19400000020 pid: 22788 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789403594.245694:0:22788:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a1443fc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5aa3c32d-0021-4831-930f-6e88a8b78157+21:18738:x1876325038198912:12345-192.168.203.43@tcp:57:lhsmtool_posix.0 Request processed in 28936us (29123us total) trans 12884901916 rc 0/0 00000100:00100000:2.0:1789403594.245702:0:22788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 63 00000020:00080000:2.0:1789403594.245707:0:22788:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:1.0:1789403594.245920:0:22826:0:(llog.c:805:llog_process_thread()) index: 3, lh_last_idx: 3 synced_idx: 3 lgh_last_idx: 3 00000040:00080000:1.0:1789403594.245925:0:22826:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x14:0x0] at index 3 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1789403594.245942:0:22826:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x14:0x0] index 2 count 2 00000040:00080000:1.0:1789403594.245948:0:22826:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 4 count 2 00010000:00010000:3.0:1789403594.246200:0:22786:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c6400/0x5fb08b1e5b762d8b lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403594.246219:0:22786:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c6400/0x5fb08b1e5b762d8b lrc: 3/1,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 22786 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403594.246329:0:22786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c6200/0x5fb08b1e5b762d84 lrc: 0/0,0 mode: --/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb128e5a expref: 21 pid: 22786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403594.246345:0:22786:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff90a1425c6400/0x5fb08b1e5b762d8b lrc: 3/0,0 mode: PR/PR res: [0x2000013a1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.43@tcp remote: 0x1acb85b3eb128e5a expref: 20 pid: 22786 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789403594.246354:0:22786:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x2:0x0].0x0 (ffff90a142163600) 00010000:00010000:3.0:1789403594.246357:0:22786:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1789403594.246359:0:22786:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff90a1425c6400, rc 0) 00000100:00100000:3.0:1789403594.246514:0:22786:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a276e9b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:5aa3c32d-0021-4831-930f-6e88a8b78157+20:18737:x1876325038199424:12345-192.168.203.43@tcp:101:dd.0 Request processed in 1402us (1672us total) trans 0 rc 0/0 00000100:00100000:3.0:1789403594.246521:0:22786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 64 00000100:00100000:2.0:1789403594.249652:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:0.0:1789403594.249733:0:22790:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038199680 00000100:00100000:0.0:1789403594.249744:0:22790:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038199680 00000100:00100000:0.0:1789403594.249801:0:22790:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 11 00000100:00100000:0.0:1789403594.249811:0:22790:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a1443fed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5aa3c32d-0021-4831-930f-6e88a8b78157+20:18738:x1876325038199680:12345-192.168.203.43@tcp:35:lhsmtool_posix.0 00000004:00080000:0.0:1789403594.250087:0:22790:0:(mdd_object.c:4014:mdd_close()) Object [0x2000013a1:0x3:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:0.0:1789403594.250120:0:22790:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 12884901917 00010000:00010000:0.0:1789403594.250154:0:22790:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90a2821e8400/0x5fb08b1e5b762d99 lrc: 3/0,1 mode: --/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 22790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403594.250170:0:22790:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff90a2821e8400/0x5fb08b1e5b762d99 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010080000000 pid: 22790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403594.250184:0:22790:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff90a2821e8400/0x5fb08b1e5b762d99 lrc: 3/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 22790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403594.250192:0:22790:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90a2821e8400/0x5fb08b1e5b762d99 lrc: 4/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 22790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403594.250198:0:22790:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff90a2821e8400/0x5fb08b1e5b762d99 lrc: 4/0,1 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 22790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403594.250203:0:22790:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff90a2821e8400/0x5fb08b1e5b762d99 lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 22790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403594.250239:0:22790:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1789403594.250320:0:22790:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a1443fed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:5aa3c32d-0021-4831-930f-6e88a8b78157+22:18738:x1876325038199680:12345-192.168.203.43@tcp:35:lhsmtool_posix.0 Request processed in 510us (676us total) trans 12884901918 rc 0/0 00000100:00100000:0.0:1789403594.250328:0:22790:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 11 00000020:00080000:0.0:1789403594.250332:0:22790:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1789403594.251897:0:22775:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789403594.251918:0:22775:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff90a2821e8400/0x5fb08b1e5b762d99 lrc: 2/0,0 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 22790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403594.251944:0:22775:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a2821e8400 already unused, calling callback (ffffffffc0c0b8b0) 00010000:00010000:2.0:1789403594.251948:0:22775:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a2821e8400/0x5fb08b1e5b762d99 lrc: 2/0,0 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 22790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403594.251967:0:22775:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff90a2821e8400/0x5fb08b1e5b762d99 lrc: 3/0,0 mode: PW/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40018480000000 pid: 22790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403594.251982:0:22775:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2000013a1:0x3:0x0].0x0 (ffff90a1434a7500) 00010000:00010000:2.0:1789403594.251985:0:22775:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1789403594.251990:0:22775:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff90a2821e8400/0x5fb08b1e5b762d99 lrc: 1/0,0 mode: --/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 22790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403594.251996:0:22775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff90a2821e8400/0x5fb08b1e5b762d99 lrc: 0/0,0 mode: --/PW res: [0x2000013a1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 22790 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403594.252011:0:22775:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789403594.252013:0:22775:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789403594.252015:0:22775:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789403594.277658:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:1.0:1789403594.278016:0:24296:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038199808 00000100:00100000:1.0:1789403594.278027:0:24296:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038199808 00000100:00100000:1.0:1789403594.278105:0:24296:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 0 00000100:00100000:1.0:1789403594.278117:0:24296:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a1442ee300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:5aa3c32d-0021-4831-930f-6e88a8b78157+7:2390:x1876325038199808:12345-192.168.203.43@tcp:4:dd.0 00002000:00010000:1.0:1789403594.278166:0:24296:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x42:0x0] initial LVB size: 0, mtime: 0x6aa821c9, atime: 0x6aa821c8, ctime: 0x6aa821c9, blocks: 0x0 00010000:00010000:1.0:1789403594.278176:0:24296:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002f76ee42/0x5fb08b1e5b762da0 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 24296 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403594.278192:0:24296:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x42:0x0].0x0 since=640s v=(0 0) 00010000:00010000:1.0:1789403594.278197:0:24296:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789403594.278203:0:24296:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002f76ee42/0x5fb08b1e5b762da0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 24296 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789403594.278218:0:24296:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002f76ee42/0x5fb08b1e5b762da0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 24296 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789403594.286632:0:3621:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:3.0:1789403594.286834:0:24298:0:(service.c:3467:ptlrpc_start_thread()) ost_io[0] started 3 min 3 max 116 00000100:00100000:3.0:1789403594.286844:0:24298:0:(service.c:3526:ptlrpc_start_thread()) starting thread 'll_ost_io00_003' 00000100:00100000:0.0:1789403594.287584:0:24298:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038199936 00000100:00100000:0.0:1789403594.287594:0:24298:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038199936 00000100:00100000:2.0:1789403594.290807:0:25832:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 1 00000100:00100000:2.0:1789403594.290896:0:25832:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a1442ed500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:5aa3c32d-0021-4831-930f-6e88a8b78157+9:2390:x1876325038199936:12345-192.168.203.43@tcp:4:dd.0 00010000:00010000:2.0:1789403594.290940:0:25832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000eefe2e87/0x5fb08b1e5b762da7 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 25832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403594.290958:0:25832:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789403594.290964:0:25832:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x42:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789403594.290970:0:25832:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000eefe2e87/0x5fb08b1e5b762da7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 25832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403594.290993:0:25832:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000eefe2e87/0x5fb08b1e5b762da7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 25832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789403594.318174:0:3619:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:2.0:1789403594.318305:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:2.0:1789403594.318345:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:0.0:1789403594.318417:0:25827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038200320 00000100:00100000:0.0:1789403594.318426:0:25827:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038200320 00000100:00100000:2.0:1789403594.318471:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:2.0:1789403594.318493:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:2.0:1789403594.318510:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:2.0:1789403594.318530:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:2.0:1789403594.318556:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:2.0:1789403594.318595:0:3620:0:(events.c:344:request_in_callback()) peer: 12345-192.168.203.43@tcp (source: 12345-192.168.203.43@tcp) 00000100:00100000:2.0:1789403594.318618:0:22788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038200832 00000100:00100000:2.0:1789403594.318622:0:22788:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038200832 00000100:00080000:2.0:1789403594.318645:0:22782:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1789403594.318686:0:22788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038200192 00000100:00100000:2.0:1789403594.318689:0:22788:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038200192 00000100:00100000:2.0:1789403594.318702:0:22788:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038200704 00000100:00100000:2.0:1789403594.318704:0:22788:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038200704 00000100:00080000:2.0:1789403594.318715:0:22782:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789403594.318740:0:22788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 54 00000100:00100000:2.0:1789403594.318750:0:22788:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a1441d9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:64a26033-a2bf-42a8-98b4-c36979dfd570+5:2388:x1876325038200832:12345-192.168.203.43@tcp:400:kworker.0 00000100:00100000:2.0:1789403594.318830:0:22788:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a1441d9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:64a26033-a2bf-42a8-98b4-c36979dfd570+5:2388:x1876325038200832:12345-192.168.203.43@tcp:400:kworker.0 Request processed in 79us (355us total) trans 0 rc 0/0 00000100:00100000:2.0:1789403594.318837:0:22788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 54 00000100:00100000:2.0:1789403594.318854:0:22788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 55 00000100:00100000:2.0:1789403594.318862:0:22788:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a1441dbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5aa3c32d-0021-4831-930f-6e88a8b78157+22:2388:x1876325038200192:12345-192.168.203.43@tcp:400:kworker.0 00000100:00100000:2.0:1789403594.318898:0:22788:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a1441dbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:5aa3c32d-0021-4831-930f-6e88a8b78157+22:2388:x1876325038200192:12345-192.168.203.43@tcp:400:kworker.0 Request processed in 39us (388us total) trans 0 rc 0/0 00000100:00100000:2.0:1789403594.318904:0:22788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 55 00000100:00100000:2.0:1789403594.318915:0:22788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 56 00000100:00100000:2.0:1789403594.318920:0:22788:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a1441d9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:64a26033-a2bf-42a8-98b4-c36979dfd570+6:2388:x1876325038200704:12345-192.168.203.43@tcp:400:kworker.0 00000100:00100000:2.0:1789403594.318940:0:22788:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a1441d9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:64a26033-a2bf-42a8-98b4-c36979dfd570+6:2388:x1876325038200704:12345-192.168.203.43@tcp:400:kworker.0 Request processed in 20us (386us total) trans 0 rc 0/0 00000100:00100000:2.0:1789403594.318945:0:22788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 56 00000100:00100000:2.0:1789403594.318976:0:24293:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038200576 00000100:00100000:2.0:1789403594.318980:0:24293:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038200576 00000100:00100000:2.0:1789403594.319014:0:24293:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038201088 00000100:00100000:2.0:1789403594.319017:0:24293:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038201088 00000100:00100000:2.0:1789403594.319035:0:24293:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038200448 00000100:00100000:2.0:1789403594.319038:0:24293:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038200448 00000100:00100000:2.0:1789403594.319048:0:24293:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038200960 00000100:00100000:2.0:1789403594.319050:0:24293:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038200960 00000100:00100000:2.0:1789403594.319063:0:24293:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 12 00000100:00100000:2.0:1789403594.319069:0:24293:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a1441d9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5aa3c32d-0021-4831-930f-6e88a8b78157+11:2388:x1876325038200576:12345-192.168.203.43@tcp:400:kworker.0 00000100:00100000:2.0:1789403594.319297:0:24293:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a1441d9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5aa3c32d-0021-4831-930f-6e88a8b78157+11:2388:x1876325038200576:12345-192.168.203.43@tcp:400:kworker.0 Request processed in 227us (951us total) trans 0 rc 0/0 00000100:00100000:2.0:1789403594.319304:0:24293:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 12 00000100:00100000:2.0:1789403594.319315:0:24293:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 13 00000100:00100000:2.0:1789403594.319319:0:24293:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a1441d8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:64a26033-a2bf-42a8-98b4-c36979dfd570+5:2388:x1876325038201088:12345-192.168.203.43@tcp:400:kworker.0 00000100:00100000:2.0:1789403594.319335:0:24293:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a1441d8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:64a26033-a2bf-42a8-98b4-c36979dfd570+5:2388:x1876325038201088:12345-192.168.203.43@tcp:400:kworker.0 Request processed in 16us (842us total) trans 0 rc 0/0 00000100:00100000:2.0:1789403594.319346:0:24293:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 13 00000100:00100000:2.0:1789403594.319354:0:24293:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 14 00000100:00100000:2.0:1789403594.319357:0:24293:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a26c8e9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5aa3c32d-0021-4831-930f-6e88a8b78157+5:2388:x1876325038200448:12345-192.168.203.43@tcp:400:kworker.0 00000100:00100000:2.0:1789403594.319373:0:24293:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a26c8e9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:5aa3c32d-0021-4831-930f-6e88a8b78157+5:2388:x1876325038200448:12345-192.168.203.43@tcp:400:kworker.0 Request processed in 16us (843us total) trans 0 rc 0/0 00000100:00100000:2.0:1789403594.319376:0:24293:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 14 00000100:00100000:2.0:1789403594.319496:0:24293:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 15 00000100:00100000:2.0:1789403594.319503:0:24293:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a1441d8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:64a26033-a2bf-42a8-98b4-c36979dfd570+5:2388:x1876325038200960:12345-192.168.203.43@tcp:400:kworker.0 00000100:00100000:2.0:1789403594.319525:0:24293:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a1441d8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:64a26033-a2bf-42a8-98b4-c36979dfd570+5:2388:x1876325038200960:12345-192.168.203.43@tcp:400:kworker.0 Request processed in 23us (930us total) trans 0 rc 0/0 00000100:00100000:2.0:1789403594.319532:0:24293:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 15 00000100:00100000:2.0:1789403594.319556:0:22780:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325038200064 00000100:00100000:2.0:1789403594.319560:0:22780:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325038200064 00000100:00100000:2.0:1789403594.319586:0:22780:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 165 00000100:00100000:2.0:1789403594.319593:0:22780:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a276a77050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:126a363a-19e5-4afb-856a-0efed33190d2+13:2388:x1876325038200064:12345-192.168.203.43@tcp:400:kworker.0 00000100:00100000:2.0:1789403594.319618:0:22780:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a276a77050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:126a363a-19e5-4afb-856a-0efed33190d2+13:2388:x1876325038200064:12345-192.168.203.43@tcp:400:kworker.0 Request processed in 25us (1455us total) trans 0 rc 0/0 00000100:00100000:2.0:1789403594.319623:0:22780:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 165 00000100:00080000:2.0:1789403594.319644:0:22782:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1789403594.319647:0:22782:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1789403594.319648:0:22782:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789403594.319776:0:25827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.43@tcp, seq: 57 00000100:00100000:0.0:1789403594.319786:0:25827:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a141aac380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5aa3c32d-0021-4831-930f-6e88a8b78157+5:2388:x1876325038200320:12345-192.168.203.43@tcp:400:kworker.0 00000100:00100000:0.0:1789403594.319810:0:25827:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a141aac380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:5aa3c32d-0021-4831-930f-6e88a8b78157+5:2388:x1876325038200320:12345-192.168.203.43@tcp:400:kworker.0 Request processed in 28us (1506us total) trans 0 rc 0/0 00000100:00100000:0.0:1789403594.319815:0:25827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 57 00000001:00080000:0.0:1789403594.350975:0:25106:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 12884901895 is committed 00000001:00080000:0.0:1789403594.351056:0:25106:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 12884901894 is committed 00002000:00010000:2.0:1789403594.351489:0:24296:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x42:0x0] updating lvb size from disk: 0 -> 4194304 00002000:00010000:2.0:1789403594.351494:0:24296:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x42:0x0] updating lvb mtime from disk: 1789403593 -> 1789403594 00002000:00010000:2.0:1789403594.351497:0:24296:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x42:0x0] updating lvb ctime from disk: 1789403593 -> 1789403594 00002000:00010000:2.0:1789403594.351512:0:24296:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x42:0x0] updating lvb blocks from disk: 0 -> 8192 00010000:00010000:2.0:1789403594.351530:0:24296:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002f76ee42/0x5fb08b1e5b762da0 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 24296 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403594.351543:0:24296:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002f76ee42/0x5fb08b1e5b762da0 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 24296 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403594.351551:0:24296:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002f76ee42/0x5fb08b1e5b762da0 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 24296 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403594.351558:0:24296:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a281b04000 already unused, calling callback (ffffffffc0c0b8b0) 00010000:00010000:2.0:1789403594.351564:0:24296:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002f76ee42/0x5fb08b1e5b762da0 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 24296 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403594.351573:0:24296:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002f76ee42/0x5fb08b1e5b762da0 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 24296 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403594.351594:0:24296:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002f76ee42/0x5fb08b1e5b762da0 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 24296 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789403594.351601:0:24296:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002f76ee42/0x5fb08b1e5b762da0 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 3 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 24296 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789403594.351775:0:24296:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a1442ee300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:5aa3c32d-0021-4831-930f-6e88a8b78157+7:2390:x1876325038199808:12345-192.168.203.43@tcp:4:dd.0 Request processed in 73656us (74122us total) trans 12884901895 rc 0/0 00000100:00100000:2.0:1789403594.351785:0:24296:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 0 00000001:00080000:2.0:1789403594.370224:0:25106:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 12884901896 is committed 00002000:00010000:0.0:1789403594.372605:0:25832:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x42:0x0] updating lvb size from disk: 4194304 -> 7654321 00002000:00010000:0.0:1789403594.372615:0:25832:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x42:0x0] updating lvb blocks from disk: 8192 -> 14952 00010000:00010000:0.0:1789403594.372770:0:25832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000eefe2e87/0x5fb08b1e5b762da7 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 25832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403594.372784:0:25832:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000eefe2e87/0x5fb08b1e5b762da7 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 25832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403594.372793:0:25832:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000eefe2e87/0x5fb08b1e5b762da7 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 25832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403594.372822:0:25832:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff90a270185800 already unused, calling callback (ffffffffc0c0b8b0) 00010000:00010000:0.0:1789403594.372826:0:25832:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000eefe2e87/0x5fb08b1e5b762da7 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 25832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403594.372836:0:25832:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000eefe2e87/0x5fb08b1e5b762da7 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 25832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403594.372855:0:25832:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000eefe2e87/0x5fb08b1e5b762da7 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 25832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789403594.372864:0:25832:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000eefe2e87/0x5fb08b1e5b762da7 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x42:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 25832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789403594.373021:0:25832:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a1442ed500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:5aa3c32d-0021-4831-930f-6e88a8b78157+5:2390:x1876325038199936:12345-192.168.203.43@tcp:4:dd.0 Request processed in 82126us (86392us total) trans 12884901896 rc 0/0 00000100:00100000:0.0:1789403594.373036:0:25832:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.43@tcp, seq: 1 00010000:00010000:1.0:1789403594.481578:0:25221:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789403594.481834:0:3628:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789403594.481856:0:3628:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a1441da680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3628:1876325050874880:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789403594.481925:0:3628:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789403594.482022:0:24294:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050874880 00000100:00100000:1.0:1789403594.482029:0:24294:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050874880 00000100:00100000:1.0:1789403594.482097:0:24294:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1789403594.482106:0:24294:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a144467100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3628:x1876325050874880:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789403594.482127:0:24294:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3915849728 avail 3684327424 00000100:00100000:1.0:1789403594.482175:0:24294:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a144467100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3628:x1876325050874880:12345-0@lo:13:osp-pre-0-0.0 Request processed in 70us (250us total) trans 0 rc 0/0 00000100:00100000:1.0:1789403594.482181:0:24294:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1789403594.482225:0:3628:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a1441da680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3628:1876325050874880:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1789403594.482329:0:22782:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789403594.482643:0:3627:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789403594.482655:0:3627:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a144465c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3627:1876325050875008:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789403594.482685:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789403594.482714:0:25580:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050875008 00000100:00100000:3.0:1789403594.482718:0:25580:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050875008 00000100:00100000:3.0:1789403594.482755:0:25580:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1789403594.482762:0:25580:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a144466d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3627:x1876325050875008:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789403594.482780:0:25580:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 4218880 granted 26324672 pending 0 free 3923513344 avail 3684286464 00000100:00100000:3.0:1789403594.482812:0:25580:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a144466d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3627:x1876325050875008:12345-0@lo:13:osp-pre-1-0.0 Request processed in 51us (126us total) trans 0 rc 0/0 00000100:00100000:3.0:1789403594.482818:0:25580:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1789403594.482843:0:3627:0:(client.c:3126:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 12884901894 gen 2 00000004:00080000:3.0:1789403594.482847:0:3627:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff90a246f3c000, transno 12884901892 00000004:00080000:3.0:1789403594.482856:0:3627:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 12884901894 committed transno 12884901894 00000100:00100000:3.0:1789403594.482873:0:3627:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a144465c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3627:1876325050875008:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789403594.483198:0:3629:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a1441d8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3629:1876325050875392:0@lo:400:kworker.0 00000100:00100000:2.0:1789403594.483230:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789403594.483246:0:3629:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a1442efb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3629:1876325050875904:0@lo:400:kworker.0 00000100:00100000:2.0:1789403594.483265:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789403594.483278:0:3629:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a281911500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3629:1876325050876416:0@lo:400:kworker.0 00000100:00100000:2.0:1789403594.483295:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789403594.483311:0:3629:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:2.0:1789403594.483316:0:3629:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a1441d9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3629:1876325050875264:0@lo:400:kworker.0 00000100:00100000:2.0:1789403594.483338:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789403594.483368:0:3629:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a27a64d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3629:1876325050875776:0@lo:400:kworker.0 00000100:00100000:2.0:1789403594.483413:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789403594.483431:0:3629:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a281913b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3629:1876325050876288:0@lo:400:kworker.0 00000100:00100000:2.0:1789403594.483449:0:3629:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789403594.483472:0:24931:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050875264 00000100:00100000:2.0:1789403594.483476:0:24931:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050875264 00000100:00100000:2.0:1789403594.483504:0:24931:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1789403594.483510:0:24931:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a141aace00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3629:x1876325050875264:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789403594.483547:0:24931:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a141aace00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3629:x1876325050875264:12345-0@lo:400:kworker.0 Request processed in 37us (208us total) trans 0 rc 0/0 00000100:00100000:2.0:1789403594.483552:0:24931:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1789403594.483569:0:3627:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a1441d8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7ccb4038-daf9-4dcd-9b85-da9390181204:3627:1876325050875136:0@lo:400:kworker.0 00000100:00100000:2.0:1789403594.483593:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789403594.483633:0:3627:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a1441da680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3627:1876325050875648:0@lo:400:kworker.0 00000100:00100000:2.0:1789403594.483655:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789403594.483671:0:3627:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a281910380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3627:1876325050876160:0@lo:400:kworker.0 00000100:00100000:2.0:1789403594.483703:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789403594.483716:0:3627:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:2.0:1789403594.483731:0:3627:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a1441dad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3627:1876325050875520:0@lo:400:kworker.0 00000100:00100000:2.0:1789403594.483753:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789403594.483768:0:3627:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a1442ec700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3627:1876325050876032:0@lo:400:kworker.0 00000100:00100000:2.0:1789403594.483784:0:3627:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789403594.483804:0:24292:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050875776 00000100:00100000:2.0:1789403594.483808:0:24292:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050875776 00000100:00100000:2.0:1789403594.483839:0:24292:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050875648 00000100:00100000:2.0:1789403594.483842:0:24292:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050875648 00000100:00100000:2.0:1789403594.483859:0:24292:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1789403594.483864:0:24292:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a144048380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3629:x1876325050875776:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789403594.483896:0:24292:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a144048380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3629:x1876325050875776:12345-0@lo:400:kworker.0 Request processed in 32us (483us total) trans 0 rc 0/0 00000100:00100000:2.0:1789403594.483902:0:24292:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1789403594.483916:0:24292:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1789403594.483921:0:24292:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a144049500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3627:x1876325050875648:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789403594.483954:0:24292:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a144049500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3627:x1876325050875648:12345-0@lo:400:kworker.0 Request processed in 33us (298us total) trans 0 rc 0/0 00000100:00100000:2.0:1789403594.483960:0:24292:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00080000:2.0:1789403594.483980:0:22782:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789403594.484004:0:3629:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a1441d9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3629:1876325050875264:0@lo:400:kworker.0 00000100:00100000:2.0:1789403594.484018:0:3629:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a27a64d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3629:1876325050875776:0@lo:400:kworker.0 00000100:00100000:2.0:1789403594.484042:0:3627:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a1441da680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3627:1876325050875648:0@lo:400:kworker.0 00000100:00100000:3.0:1789403594.484510:0:22786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050875392 00000100:00100000:3.0:1789403594.484515:0:22786:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050875392 00000100:00100000:3.0:1789403594.484541:0:22786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050875904 00000100:00100000:3.0:1789403594.484543:0:22786:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050875904 00000100:00100000:3.0:1789403594.484554:0:22786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050876416 00000100:00100000:3.0:1789403594.484557:0:22786:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050876416 00000100:00100000:3.0:1789403594.484582:0:22786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050876288 00000100:00100000:3.0:1789403594.484585:0:22786:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050876288 00000100:00100000:3.0:1789403594.484612:0:22786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050876160 00000100:00100000:3.0:1789403594.484615:0:22786:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050876160 00000100:00100000:3.0:1789403594.484627:0:22786:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050876032 00000100:00100000:3.0:1789403594.484629:0:22786:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050876032 00000100:00100000:3.0:1789403594.484644:0:22786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1789403594.484651:0:22786:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a281910e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3629:x1876325050875392:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789403594.484700:0:22786:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a281910e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3629:x1876325050875392:12345-0@lo:400:kworker.0 Request processed in 50us (1469us total) trans 0 rc 0/0 00000100:00100000:3.0:1789403594.484707:0:22786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1789403594.484729:0:22786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1789403594.484736:0:22786:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a281913800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3629:x1876325050875904:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789403594.484763:0:22786:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a281913800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3629:x1876325050875904:12345-0@lo:400:kworker.0 Request processed in 28us (1496us total) trans 0 rc 0/0 00000100:00100000:3.0:1789403594.484778:0:22786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1789403594.484790:0:22786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1789403594.484795:0:22786:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a281913480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3629:x1876325050876416:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789403594.484825:0:22786:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a281913480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3629:x1876325050876416:12345-0@lo:400:kworker.0 Request processed in 30us (1528us total) trans 0 rc 0/0 00000100:00100000:3.0:1789403594.484830:0:22786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1789403594.484839:0:22786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1789403594.484845:0:22786:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a14404b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3629:x1876325050876288:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789403594.484869:0:22786:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a14404b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3629:x1876325050876288:12345-0@lo:400:kworker.0 Request processed in 25us (1419us total) trans 0 rc 0/0 00000100:00100000:3.0:1789403594.484874:0:22786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1789403594.484885:0:22786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1789403594.484890:0:22786:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a14404ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3627:x1876325050876160:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789403594.484919:0:22786:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a14404ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3627:x1876325050876160:12345-0@lo:400:kworker.0 Request processed in 29us (1215us total) trans 0 rc 0/0 00000100:00100000:3.0:1789403594.484923:0:22786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1789403594.484934:0:22786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1789403594.484939:0:22786:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a1443e6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3627:x1876325050876032:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789403594.484961:0:22786:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a1443e6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3627:x1876325050876032:12345-0@lo:400:kworker.0 Request processed in 23us (1175us total) trans 0 rc 0/0 00000100:00100000:3.0:1789403594.484966:0:22786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1789403594.484983:0:22781:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050875136 00000100:00100000:3.0:1789403594.484986:0:22781:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050875136 00000100:00100000:3.0:1789403594.485010:0:22781:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 166 00000100:00100000:3.0:1789403594.485016:0:22781:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a27c943450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7ccb4038-daf9-4dcd-9b85-da9390181204+24:3627:x1876325050875136:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789403594.485054:0:22781:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a27c943450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:7ccb4038-daf9-4dcd-9b85-da9390181204+24:3627:x1876325050875136:12345-0@lo:400:kworker.0 Request processed in 39us (1460us total) trans 0 rc 0/0 00000100:00100000:3.0:1789403594.485060:0:22781:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 166 00000100:00100000:3.0:1789403594.485087:0:22791:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050875520 00000100:00100000:3.0:1789403594.485090:0:22791:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050875520 00000100:00100000:3.0:1789403594.485113:0:22791:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1789403594.485119:0:22791:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a1443e6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3627:x1876325050875520:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789403594.485148:0:22791:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a1443e6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3627:x1876325050875520:12345-0@lo:400:kworker.0 Request processed in 29us (1394us total) trans 0 rc 0/0 00000100:00100000:3.0:1789403594.485154:0:22791:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1789403594.485195:0:3629:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a281913b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3629:1876325050876288:0@lo:400:kworker.0 00000100:00100000:3.0:1789403594.485206:0:3629:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a1441d8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3629:1876325050875392:0@lo:400:kworker.0 00000100:00100000:3.0:1789403594.485216:0:3629:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a1442efb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3629:1876325050875904:0@lo:400:kworker.0 00010000:00080000:3.0:1789403594.485228:0:3629:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90a281911500 x1876325050876416/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789403610 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789403594.485237:0:3629:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a281911500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3629:1876325050876416:0@lo:400:kworker.0 00000100:00100000:3.0:1789403594.485268:0:3627:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a1441dad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3627:1876325050875520:0@lo:400:kworker.0 00000100:00100000:3.0:1789403594.485279:0:3627:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a1442ec700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3627:1876325050876032:0@lo:400:kworker.0 00000100:00100000:3.0:1789403594.485289:0:3627:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a1441d8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:7ccb4038-daf9-4dcd-9b85-da9390181204:3627:1876325050875136:0@lo:400:kworker.0 00010000:00080000:3.0:1789403594.485299:0:3627:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff90a281910380 x1876325050876160/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789403610 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789403594.485308:0:3627:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a281910380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3627:1876325050876160:0@lo:400:kworker.0 00000100:00100000:0.0:1789403594.485757:0:3626:0:(client.c:1920:ptlrpc_send_new_req()) Sending RPC req@ffff90a276e9ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3626:1876325050876544:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1789403594.485794:0:3626:0:(events.c:344:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1789403594.485953:0:22782:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789403594.485965:0:22782:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1789403594.486486:0:24295:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876325050876544 00000100:00100000:1.0:1789403594.486494:0:24295:0:(service.c:2371:ptlrpc_server_handle_req_in()) got req x1876325050876544 00000100:00100000:1.0:1789403594.486540:0:24295:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1789403594.486548:0:24295:0:(service.c:2557:ptlrpc_server_handle_request()) Handling RPC req@ffff90a246f3d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3626:x1876325050876544:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1789403594.486567:0:24295:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 4218880 granted 26324672 pending 0 free 3923513344 avail 3684286464 00000100:00100000:1.0:1789403594.490367:0:24295:0:(service.c:2615:ptlrpc_server_handle_request()) Handled RPC req@ffff90a246f3d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3626:x1876325050876544:12345-0@lo:13:osp-pre-1-1.0 Request processed in 3434us (4186us total) trans 0 rc 0/0 00000100:00100000:1.0:1789403594.490384:0:24295:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1789403594.495736:0:3626:0:(client.c:2415:ptlrpc_check_set()) Completed RPC req@ffff90a276e9ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3626:1876325050876544:0@lo:13:osp-pre-1-1.0 00000040:00080000:3.0:1789403594.994447:0:23539:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1789403595.508885:0:22774:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1789403596.138197:0:25870:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: sanity-pcc test_1d: @@@@@@ FAIL: expected /mnt/pcc.d1d.sanity-pcc/d1d.sanity-pcc/13a3/0x2000013a1:0x2:0x0 size: 7654321 got: 0 00010000:00010000:2.0:1789403596.532597:0:22775:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789403597.558982:0:25221:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) Debug log: 13778 lines, 13778 kept, 0 dropped, 0 bad.